David Robertson 80d44060c9 Faster joins: omit partial rooms from eager syncs until the resync completes (#14870) ... * Allow `AbstractSet` in `StrCollection` Or else frozensets are excluded. This will be useful in an upcoming commit where I plan to change a function that accepts `List[str]` to accept `StrCollection` instead. * `rooms_to_exclude` -> `rooms_to_exclude_globally` I am about to make use of this exclusion mechanism to exclude rooms for a specific user and a specific sync. This rename helps to clarify the distinction between the global config and the rooms to exclude for a specific sync. * Better function names for internal sync methods * Track a list of excluded rooms on SyncResultBuilder I plan to feed a list of partially stated rooms for this sync to ignore * Exclude partial state rooms during eager sync using the mechanism established in the previous commit * Track un-partial-state stream in sync tokens So that we can work out which rooms have become fully-stated during a given sync period. * Fix mutation of `@cached` return value This was fouling up a complement test added alongside this PR. Excluding a room would mean the set of forgotten rooms in the cache would be extended. This means that room could be erroneously considered forgotten in the future. Introduced in #12310, Synapse 1.57.0. I don't think this had any user-visible side effects (until now). * SyncResultBuilder: track rooms to force as newly joined Similar plan as before. We've omitted rooms from certain sync responses; now we establish the mechanism to reintroduce them into future syncs. * Read new field, to present rooms as newly joined * Force un-partial-stated rooms to be newly-joined for eager incremental syncs only, provided they're still fully stated * Notify user stream listeners to wake up long polling syncs * Changelog * Typo fix Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com> * Unnecessary list cast Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com> * Rephrase comment Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com> * Another comment Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com> * Fixup merge(?) * Poke notifier when receiving un-partial-stated msg over replication * Fixup merge whoops Thanks MV :) Co-authored-by: Mathieu Velen <mathieuv@matrix.org> Co-authored-by: Mathieu Velten <mathieuv@matrix.org> Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com>		2023-01-23 15:44:39 +00:00
..
streams	Enable Faster Remote Room Joins against worker-mode Synapse. (#14752)	2023-01-22 21:10:11 +00:00
__init__.py	Update replication.md with info on TCP module structure (#12621)	2022-05-09 14:46:43 -07:00
client.py	Faster joins: omit partial rooms from eager syncs until the resync completes (#14870)	2023-01-23 15:44:39 +00:00
commands.py	Send USER_IP commands on a different Redis channel, in order to reduce traffic to workers that do not process these commands. (#12809)	2022-05-20 15:28:23 +01:00
external_cache.py	Add opentracing spans to calls to external cache (#12380)	2022-04-07 13:18:29 +01:00
handler.py	Merge account data streams (#14826)	2023-01-13 14:57:43 +00:00
protocol.py	Fix check to ignore blank lines in incoming TCP replication (#14449)	2022-11-17 16:09:56 +00:00
redis.py	Send USER_IP commands on a different Redis channel, in order to reduce traffic to workers that do not process these commands. (#12809)	2022-05-20 15:28:23 +01:00
resource.py	Wait for streams to catch up when processing HTTP replication. (#14820)	2023-01-18 19:35:29 +00:00