synapse-product/synapse/replication/slave/storage
Erik Johnston 664409b169
Fix bug in account data replication stream. (#7656)
* Ensure account data stream IDs are unique.

The account data stream is shared between three tables, and the maximum
allocated ID was tracked in a dedicated table. Updating the max ID
happened outside the transaction that allocated the ID, leading to a
race where if the server was restarted then the same ID could be
allocated but the max ID failed to be updated, leading it to be reused.

The ID generators have support for tracking across multiple tables, so
we may as well use that instead of a dedicated table.

* Fix bug in account data replication stream.

If the same stream ID was used in both global and room account data then
the getting updates for the replication stream would fail due to
`heapq.merge(..)` trying to compare a `str` with a `None`. (This is
because you'd have two rows like `(534, '!room')` and `(534, None)` from
the room and global account data tables).

Fix is just to order by stream ID, since we don't rely on the ordering
beyond that. The bug where stream IDs can be reused should be fixed now,
so this case shouldn't happen going forward.

Fixes #7617
2020-06-09 16:28:57 +01:00
..
__init__.py Add a slaved events store class 2016-04-06 14:18:35 +01:00
_base.py remove redundant __func__ 2020-05-15 19:37:41 +01:00
_slaved_id_tracker.py Fix assertion to stop transaction queue getting wedged 2017-03-15 12:16:55 +00:00
account_data.py Fix bug in account data replication stream. (#7656) 2020-06-09 16:28:57 +01:00
appservice.py Move storage classes into a main "data store". 2019-10-21 16:05:06 +01:00
client_ips.py Allow configuration of Synapse's cache without using synctl or environment variables (#6391) 2020-05-11 18:45:23 +01:00
deviceinbox.py Support any process writing to cache invalidation stream. (#7436) 2020-05-07 13:51:08 +01:00
devices.py Support any process writing to cache invalidation stream. (#7436) 2020-05-07 13:51:08 +01:00
directory.py Move storage classes into a main "data store". 2019-10-21 16:05:06 +01:00
events.py Move event stream handling out of slave store. (#7491) 2020-05-15 16:43:59 +01:00
filtering.py Change DataStores to accept 'database' param. 2019-12-06 13:30:06 +00:00
groups.py Support any process writing to cache invalidation stream. (#7436) 2020-05-07 13:51:08 +01:00
keys.py Move storage classes into a main "data store". 2019-10-21 16:05:06 +01:00
presence.py remove redundant __func__ 2020-05-15 19:37:41 +01:00
profile.py Move storage classes into a main "data store". 2019-10-21 16:05:06 +01:00
push_rule.py Move event stream handling out of slave store. (#7491) 2020-05-15 16:43:59 +01:00
pushers.py Support any process writing to cache invalidation stream. (#7436) 2020-05-07 13:51:08 +01:00
receipts.py Support any process writing to cache invalidation stream. (#7436) 2020-05-07 13:51:08 +01:00
registration.py Move storage classes into a main "data store". 2019-10-21 16:05:06 +01:00
room.py Support any process writing to cache invalidation stream. (#7436) 2020-05-07 13:51:08 +01:00
transactions.py Move storage classes into a main "data store". 2019-10-21 16:05:06 +01:00