Erik Johnston
|
d080b3425c
|
Merge pull request #1105 from matrix-org/erikj/make_notif_highlight_query_fast
Optimise /notifications query
|
2016-09-12 14:34:12 +01:00 |
|
Erik Johnston
|
03a98aff3c
|
Create new index concurrently
|
2016-09-12 14:27:01 +01:00 |
|
Erik Johnston
|
fa20c9ce94
|
Change the index to be stream_ordering, highlight
|
2016-09-12 14:04:08 +01:00 |
|
Erik Johnston
|
5ef5435529
|
Remove unused import
|
2016-09-12 13:32:58 +01:00 |
|
Mark Haines
|
aa7b890cfe
|
Merge pull request #1104 from matrix-org/markjh/direct_to_device_federation_sync
Fix direct to device messages recieved over federation to notify sync
|
2016-09-12 13:25:23 +01:00 |
|
Erik Johnston
|
7cd6edb947
|
Use register_background_index_update
|
2016-09-12 12:54:48 +01:00 |
|
Erik Johnston
|
0294c14ec4
|
Add back in query change
|
2016-09-12 12:43:56 +01:00 |
|
Erik Johnston
|
7fe42cf949
|
Merge branch 'develop' of github.com:matrix-org/synapse into erikj/make_notif_highlight_query_fast
|
2016-09-12 12:37:09 +01:00 |
|
Erik Johnston
|
15ca0c6a4d
|
Make reindex happen in bg
|
2016-09-12 12:36:36 +01:00 |
|
Mark Haines
|
a232e06100
|
Fix direct to device messages recieved over federation to notify sync
|
2016-09-12 12:30:46 +01:00 |
|
Mark Haines
|
31f85f9db9
|
Add comments to existing schema deltas that used "CREATE INDEX" directly
|
2016-09-12 11:00:26 +01:00 |
|
Erik Johnston
|
54417999b6
|
Revert "Add index to event_push_actions"
|
2016-09-12 10:39:55 +01:00 |
|
Erik Johnston
|
897d57bc58
|
Change state fetch query for postgres to be faster
It turns out that postgres doesn't like doing a list of OR's and is
about 1000x slower, so we just issue a query for each specific type
seperately.
|
2016-09-12 10:05:07 +01:00 |
|
David Baker
|
b91e2833b3
|
Merge remote-tracking branch 'origin/develop' into dbkr/make_notif_highlight_query_fast
|
2016-09-09 19:11:34 +01:00 |
|
David Baker
|
f2acc3dcf9
|
Add index to event_push_actions
and remove room_id caluse so it uses it
Mostly from @negativemjark
|
2016-09-09 18:54:54 +01:00 |
|
Mark Haines
|
647c724573
|
Use the previous MAX value if any to set the stream_id
|
2016-09-09 11:52:44 +01:00 |
|
Mark Haines
|
6a6cbfcf1e
|
Track the max_stream_device_id in a separate table, since we delete from the inbox table
|
2016-09-09 11:48:23 +01:00 |
|
Mark Haines
|
303b6f29f0
|
Merge pull request #1087 from matrix-org/markjh/reapply_delta
Reapply 34/device_outbox in 35/device_outbox_again.py since the schem…
|
2016-09-09 11:24:27 +01:00 |
|
Erik Johnston
|
1fe7ca1362
|
Merge branch 'release-v0.17.3' of github.com:matrix-org/synapse into develop
|
2016-09-09 11:15:40 +01:00 |
|
Mark Haines
|
0877157353
|
Just move the schema and add some DROPs
|
2016-09-09 11:04:47 +01:00 |
|
Erik Johnston
|
2ffec928e2
|
Reduce batch size to be under SQL limit
|
2016-09-09 11:03:31 +01:00 |
|
Matthew Hodgson
|
b8f84f99ff
|
Merge pull request #1081 from matrix-org/dbkr/notifications_only_highlight
Implement `only=highlight` on `/notifications`
|
2016-09-09 00:09:51 +01:00 |
|
Mark Haines
|
43b77c5d97
|
Only catch databas errors
|
2016-09-08 17:44:21 +01:00 |
|
Mark Haines
|
7d5b142547
|
Add a stub run_upgrade
|
2016-09-08 17:39:11 +01:00 |
|
David Baker
|
c3276aef25
|
Merge pull request #1080 from matrix-org/dbkr/fix_notifications_api_with_from
Fix /notifications API when used with `from` param
|
2016-09-08 17:35:35 +01:00 |
|
Mark Haines
|
fa722a699c
|
Reapply 34/device_outbox in 35/device_outbox_again.py since the schema was bumped before it landed on develop
|
2016-09-08 17:35:16 +01:00 |
|
Erik Johnston
|
5c688739d6
|
Merge branch 'develop' of github.com:matrix-org/synapse into erikj/reindex_state_groups
|
2016-09-08 16:52:09 +01:00 |
|
Erik Johnston
|
ebb46497ba
|
Add delta file
|
2016-09-08 16:38:54 +01:00 |
|
Erik Johnston
|
5beda10bbd
|
Reindex state_groups_state after pruning
|
2016-09-08 16:18:01 +01:00 |
|
Mark Haines
|
a1c8f268e5
|
Support wildcard device_ids for direct to device messages
|
2016-09-08 15:13:05 +01:00 |
|
Mark Haines
|
fa9d36e050
|
Merge branch 'develop' into markjh/direct_to_device_federation
|
2016-09-08 13:43:43 +01:00 |
|
David Baker
|
4ef222ab61
|
Implement only=highlight on /notifications
|
2016-09-08 13:43:35 +01:00 |
|
Erik Johnston
|
61cd9af09b
|
Log delta files we're applying
|
2016-09-08 13:40:46 +01:00 |
|
David Baker
|
c5b49eb7ca
|
Fix /notifications API when used with from param
|
2016-09-08 09:40:10 +01:00 |
|
Erik Johnston
|
b568ca309c
|
Temporarily disable sequential scans for state fetching
|
2016-09-08 09:38:54 +01:00 |
|
Mark Haines
|
3c320c006c
|
Merge pull request #1077 from matrix-org/markjh/device_logging
Log the types and values when failing to store devices
|
2016-09-07 18:24:24 +01:00 |
|
Mark Haines
|
85b51fdd6b
|
Log the types and values when failing to store devices
|
2016-09-07 17:19:18 +01:00 |
|
Mark Haines
|
2a0159b8ae
|
Fix the stream change cache to work over replication
|
2016-09-07 15:58:00 +01:00 |
|
Mark Haines
|
31a07d2335
|
Add stream change caches for device messages
|
2016-09-07 15:27:07 +01:00 |
|
Erik Johnston
|
513188aa56
|
Comment
|
2016-09-07 14:53:23 +01:00 |
|
Erik Johnston
|
fadb01551a
|
Add appopriate framing clause
|
2016-09-07 14:39:01 +01:00 |
|
Erik Johnston
|
d25c20ccbe
|
Use windowing function to make use of index
|
2016-09-07 14:22:22 +01:00 |
|
Mark Haines
|
7d893beebe
|
Comment the add_messages storage functions
|
2016-09-07 12:03:37 +01:00 |
|
Mark Haines
|
d4a35ada28
|
Send device messages over federation
|
2016-09-06 18:16:20 +01:00 |
|
Mark Haines
|
e020834e4f
|
Add storage methods for federated device messages
|
2016-09-06 15:12:13 +01:00 |
|
Mark Haines
|
2ad72da931
|
Add tables for federated device messages
Adds tables for storing the messages that need to be sent to a
remote device and for deduplicating messages received.
|
2016-09-06 15:10:40 +01:00 |
|
Mark Haines
|
f4164edb70
|
Move _add_messages_to_device_inbox_txn into a separate method
|
2016-09-06 11:26:37 +01:00 |
|
Erik Johnston
|
0595413c0f
|
Scale the batch size so that we're not bitten by the minimum
|
2016-09-05 15:49:57 +01:00 |
|
Erik Johnston
|
a7032abb2e
|
Correctly handle reindexing state groups that already have an edge
|
2016-09-05 15:07:23 +01:00 |
|
Erik Johnston
|
9e6d88f4e2
|
Merge branch 'develop' of github.com:matrix-org/synapse into erikj/state_storage
|
2016-09-05 15:01:33 +01:00 |
|
Erik Johnston
|
70332a12dd
|
Take value in a better way
|
2016-09-05 14:57:14 +01:00 |
|
Erik Johnston
|
373654c635
|
Comment about sqlite and WITH RECURSIVE
|
2016-09-05 14:50:36 +01:00 |
|
Erik Johnston
|
485d999c8a
|
Correctly delete old state groups in purge history API
|
2016-09-05 14:49:08 +01:00 |
|
Erik Johnston
|
bb36b93f71
|
Merge branch 'develop' of github.com:matrix-org/synapse into erikj/state_storage
|
2016-09-05 11:53:11 +01:00 |
|
Erik Johnston
|
caed150363
|
Remove unused imports
|
2016-09-05 10:52:01 +01:00 |
|
Erik Johnston
|
80a6a445fa
|
Only fetch local pushers
|
2016-09-05 10:43:32 +01:00 |
|
Erik Johnston
|
628e65721b
|
Add comments
|
2016-09-05 10:41:27 +01:00 |
|
Erik Johnston
|
a99e933550
|
Add upgrade script that will slowly prune state_groups_state entries
|
2016-09-05 10:05:36 +01:00 |
|
Erik Johnston
|
3847fa38c4
|
Make bulk_get_push_rules_for_room use get_joined_users_from_context cache
|
2016-09-05 10:02:38 +01:00 |
|
Mark Haines
|
81b94c5750
|
Merge pull request #1066 from matrix-org/markjh/direct_to_device_lowerbound
Only return new device messages in /sync
|
2016-09-02 16:18:34 +01:00 |
|
Mark Haines
|
65fa37ac5e
|
Only return new device messages in /sync
|
2016-09-02 15:50:37 +01:00 |
|
Erik Johnston
|
3baf641a48
|
Merge branch 'develop' of github.com:matrix-org/synapse into erikj/state_storage
|
2016-09-02 14:54:07 +01:00 |
|
Erik Johnston
|
cce957e254
|
Bump max_entries on get_destination_retry_timings
|
2016-09-02 14:08:33 +01:00 |
|
Erik Johnston
|
657847e4c6
|
Merge branch 'develop' of github.com:matrix-org/synapse into erikj/state_storage
|
2016-09-02 11:04:48 +01:00 |
|
Erik Johnston
|
598317927c
|
Limit the length of state chains
|
2016-09-02 10:41:38 +01:00 |
|
Erik Johnston
|
9e25443db8
|
Move to storing state_groups_state as deltas
|
2016-09-01 14:31:26 +01:00 |
|
Erik Johnston
|
44982606ee
|
Merge pull request #1060 from matrix-org/erikj/state_ids
Assign state groups in state handler.
|
2016-09-01 14:20:42 +01:00 |
|
Erik Johnston
|
0cfd6c3161
|
Use state_groups table to test existence
|
2016-08-31 16:25:57 +01:00 |
|
Erik Johnston
|
5405351b14
|
Lower get_linearized_receipts_for_room cache size
|
2016-08-31 16:19:44 +01:00 |
|
Erik Johnston
|
1671913287
|
Merge pull request #1059 from matrix-org/erikj/sent_transaction_delete
Clean up old sent transactions
|
2016-08-31 15:07:33 +01:00 |
|
Erik Johnston
|
c10cb581c6
|
Correctly handle the difference between prev and current state
|
2016-08-31 14:26:22 +01:00 |
|
Erik Johnston
|
ef0cc648cf
|
Clean up old sent transactions
|
2016-08-31 11:12:02 +01:00 |
|
Mark Haines
|
a662252758
|
Return the current stream position from add_messages_to_device_inbox
|
2016-08-31 10:42:52 +01:00 |
|
Mark Haines
|
1aa3e1d287
|
Add a replication stream for direct to device messages
|
2016-08-31 10:38:58 +01:00 |
|
Erik Johnston
|
1bb8ec296d
|
Generate state group ids in state layer
|
2016-08-31 10:09:46 +01:00 |
|
Erik Johnston
|
5dc2a702cf
|
Make _state_groups_id_gen a normal IdGenerator
|
2016-08-30 16:55:11 +01:00 |
|
Erik Johnston
|
55fc17cf4b
|
Merge pull request #1049 from matrix-org/erikj/presence_users_in_room
Use state handler instead of get_users_in_room/get_joined_hosts
|
2016-08-30 10:50:37 +01:00 |
|
Erik Johnston
|
bed10f9880
|
Use state handler instead of get_users_in_room/get_joined_hosts
|
2016-08-26 14:54:30 +01:00 |
|
Mark Haines
|
4bbef62124
|
Merge remote-tracking branch 'origin/develop' into markjh/direct_to_device
|
2016-08-26 14:35:31 +01:00 |
|
Erik Johnston
|
4daa397a00
|
Add is_host_joined to slave storage
|
2016-08-26 13:10:56 +01:00 |
|
Erik Johnston
|
1ccdc1e93a
|
Cache check_host_in_room
|
2016-08-26 10:59:40 +01:00 |
|
Erik Johnston
|
778fa85f47
|
Make sync not pull out full state
|
2016-08-25 18:59:44 +01:00 |
|
Mark Haines
|
ab34fdecb7
|
Merge branch 'develop' into markjh/direct_to_device
|
2016-08-25 18:34:46 +01:00 |
|
Mark Haines
|
641efb6a39
|
Fix the deduplication of incoming direct-to-device messages
|
2016-08-25 18:14:02 +01:00 |
|
Erik Johnston
|
721414d98a
|
Add desc
|
2016-08-25 17:49:05 +01:00 |
|
Mark Haines
|
e993925279
|
Add store-and-forward direct-to-device messaging
|
2016-08-25 17:35:37 +01:00 |
|
Erik Johnston
|
a3dc1e9cbe
|
Replace context.current_state with context.current_state_ids
|
2016-08-25 17:32:22 +01:00 |
|
Erik Johnston
|
17f4f14df7
|
Pull out event ids rather than full events for state
|
2016-08-25 13:42:44 +01:00 |
|
Erik Johnston
|
9219139351
|
Preserve some logcontexts
|
2016-08-24 11:58:40 +01:00 |
|
Erik Johnston
|
122c7a43c9
|
Merge pull request #1038 from matrix-org/erikj/receved_txn_purge
Delete old received_transactions rows
|
2016-08-23 11:02:40 +01:00 |
|
Erik Johnston
|
d143f211c8
|
Merge pull request #1028 from matrix-org/dbkr/notifications_api
Add the Notifications API
|
2016-08-22 18:23:24 +01:00 |
|
Erik Johnston
|
aad8a1a825
|
Delete old received_transactions
|
2016-08-22 16:29:46 +01:00 |
|
Erik Johnston
|
e65bc7d315
|
Merge pull request #1031 from matrix-org/erikj/measure_notifier
Add more Measure blocks
|
2016-08-22 12:13:07 +01:00 |
|
Matthew Hodgson
|
6e80c03d45
|
Merge branch 'develop' into dbkr/notifications_api
|
2016-08-20 00:16:18 +01:00 |
|
Erik Johnston
|
37adde32dc
|
Move defer.returnValue out of Measure
|
2016-08-19 18:23:44 +01:00 |
|
Erik Johnston
|
47dd8f02a1
|
Measure _get_event_from_row
|
2016-08-19 18:23:44 +01:00 |
|
Erik Johnston
|
e6784daf07
|
Merge pull request #1030 from matrix-org/erikj/cache_contexts
Add concept of cache contexts
|
2016-08-19 16:29:58 +01:00 |
|
Erik Johnston
|
c0d7d9d642
|
Rename to on_invalidate
|
2016-08-19 15:13:58 +01:00 |
|
Erik Johnston
|
dc76a3e909
|
Make cache_context an explicit option
|
2016-08-19 15:02:38 +01:00 |
|
Erik Johnston
|
f164fd9220
|
Move _bulk_get_push_rules_for_room to storage layer
|
2016-08-19 14:29:20 +01:00 |
|