Eric Eastwood df8b91ed2b Limit and filter the number of backfill points to get from the database (#13879) ... There is no need to grab thousands of backfill points when we only need 5 to make the `/backfill` request with. We need to grab a few extra in case the first few aren't visible in the history. Previously, we grabbed thousands of backfill points from the database, then sorted and filtered them in the app. Fetching the 4.6k backfill points for `#matrix:matrix.org` from the database takes ~50ms - ~570ms so it's not like this saves a lot of time 🤷. But it might save us more time now that `get_backfill_points_in_room`/`get_insertion_event_backward_extremities_in_room` are more complicated after https://github.com/matrix-org/synapse/pull/13635 This PR moves the filtering and limiting to the SQL query so we just have less data to work with in the first place. Part of https://github.com/matrix-org/synapse/issues/13356		2022-09-28 15:26:16 -05:00
..
__init__.py	Handle the case of remote users leaving a partial join room for device lists (#13885)	2022-09-27 13:01:08 +01:00
account_data.py	Speed up fetching large numbers of push rules (#13592)	2022-08-23 13:15:43 +01:00
appservice.py	Federation Sender & Appservice Pusher Stream Optimisations (#13251)	2022-07-15 09:36:56 +01:00
cache.py	Simplify cache invalidation after event persist txn (#13796)	2022-09-26 16:26:35 +01:00
censor_events.py	Safe async event cache (#13308)	2022-07-19 11:25:29 +00:00
client_ips.py	Optimise _update_client_ips_batch_txn to batch together database operations. (#12252)	2022-04-08 15:29:13 +01:00
deviceinbox.py	Add missing types to opentracing. (#13345)	2022-07-21 12:01:52 +00:00
devices.py	Handle remote device list updates during partial join (#13913)	2022-09-28 13:42:43 +00:00
directory.py	Replace uses of simple_insert_many with simple_insert_many_values. (#11742)	2022-01-13 19:44:18 -05:00
e2e_room_keys.py	Add StreamKeyType class and replace string literals with constants (#12567)	2022-05-16 15:35:31 +00:00
end_to_end_keys.py	Cancel the processing of key query requests when they time out. (#13680)	2022-09-07 12:03:32 +01:00
event_federation.py	Limit and filter the number of backfill points to get from the database (#13879)	2022-09-28 15:26:16 -05:00
event_push_actions.py	Revert "Stop returning an unused column when handling new receipts. (#13933)" (#13935)	2022-09-28 11:01:41 -04:00
events_bg_updates.py	Bg update to populate new events table columns (#13215)	2022-07-15 12:47:26 +01:00
events_forward_extremities.py	Fix returned count of delete extremities admin API (#12496)	2022-04-19 16:49:45 +01:00
events_worker.py	Fix have_seen_event cache not being invalidated (#13863)	2022-09-27 15:55:43 -05:00
events.py	fix: Push notifications for invite over federation (#13719)	2022-09-28 12:31:53 +00:00
filtering.py	Improve type hints in storage classes. (#11652)	2021-12-29 13:04:28 +00:00
keys.py	Add some type hints to datastore (#12485)	2022-04-27 13:05:00 +01:00
lock.py	Require SQLite >= 3.27.0 (#13760)	2022-09-09 11:14:10 +01:00
media_repository.py	Replace noop background updates with DELETE. (#12954)	2022-06-13 14:06:27 -04:00
metrics.py	Add some type hints to datastore (#12717)	2022-05-17 15:29:06 +01:00
monthly_active_users.py	Safe async event cache (#13308)	2022-07-19 11:25:29 +00:00
openid.py	Add type hints to some storage classes (#11307)	2021-11-11 08:47:31 -05:00
presence.py	Revert "Make all process_replication_rows methods async (#13304)" (#13312)	2022-07-18 14:28:14 +01:00
profile.py	Remove remaining pieces of groups code. (#12966)	2022-06-06 13:20:05 -04:00
purge_events.py	Add support to purge rows from MSC2716 and other tables when purging a room (#13825)	2022-09-16 10:56:56 -05:00
push_rule.py	Port the push rule classes to Rust. (#13768)	2022-09-20 12:10:31 +01:00
pusher.py	Track device IDs for pushers (#13831)	2022-09-21 15:31:53 +00:00
receipts.py	Accept & store thread IDs for receipts (implement MSC3771). (#13782)	2022-09-23 14:33:28 +00:00
registration.py	Add timestamp to user's consent (#13741)	2022-09-08 15:41:48 +00:00
rejections.py	Remove redundant "coding: utf-8" lines (#9786)	2021-04-14 15:34:27 +01:00
relations.py	Properly paginate forward in the /relations API. (#13840)	2022-09-22 12:47:49 +00:00
room_batch.py	Correct type hint for room_batch.py (#11310)	2021-11-11 16:49:28 +00:00
room.py	Handle remote device list updates during partial join (#13913)	2022-09-28 13:42:43 +00:00
roommember.py	Handle the case of remote users leaving a partial join room for device lists (#13885)	2022-09-27 13:01:08 +01:00
search.py	Replace noop background updates with DELETE. (#12954)	2022-06-13 14:06:27 -04:00
session.py	Run pyupgrade --py37-plus --keep-percent-format on Synapse (#11685)	2022-01-05 09:53:05 -08:00
signatures.py	remove constantly lib use and switch to enums. (#12624)	2022-05-04 11:26:11 +00:00
state_deltas.py	Wait for lazy join to complete when getting current state (#12872)	2022-06-01 16:02:53 +01:00
state.py	Instrument get_metadata_for_events for tracing (#13730)	2022-09-07 11:41:52 -05:00
stats.py	Require SQLite >= 3.27.0 (#13760)	2022-09-09 11:14:10 +01:00
stream.py	Properly paginate forward in the /relations API. (#13840)	2022-09-22 12:47:49 +00:00
tags.py	Revert "Make all process_replication_rows methods async (#13304)" (#13312)	2022-07-18 14:28:14 +01:00
transactions.py	Require SQLite >= 3.27.0 (#13760)	2022-09-09 11:14:10 +01:00
ui_auth.py	Add some type hints to datastore (#12485)	2022-04-27 13:05:00 +01:00
user_directory.py	Wait for lazy join to complete when getting current state (#12872)	2022-06-01 16:02:53 +01:00
user_erasure_store.py	Annotations for user_erasure_store (#11313)	2021-11-11 19:22:19 +00:00