Matrix-Mirrors/synapse-product
1
0
Fork 0
mirror of https://git.anonymousland.org/anonymousland/synapse-product.git synced 2026-01-26 17:31:38 -05:00
Code Issues Projects Releases Packages Wiki Activity
20,042 commits 4 branches 609 tags 60 MiB
Commit graph

178 commits

Author SHA1 Message Date
Erik Johnston
6250b95efe
 		Add index to local_group_updates.stream_id (#11231) 
This should speed up startup times and generally increase performance of
groups.
 2021-11-02 15:46:48 +00:00
reivilibre
4c838112dc
 		Remove unnecessary list comprehension in synapse_port_db to fix linting in CI (#11043) 2021-10-11 16:28:29 +01:00
Patrick Cloke
f4b1a9a527
 		Require direct references to configuration variables. (#10985) 
This removes the magic allowing accessing configurable
variables directly from the config object. It is now required
that a specific configuration class is used (e.g. `config.foo`
must be replaced with `config.server.foo`).
 2021-10-06 10:47:41 -04:00
Nick Barrett
c80878d22a
 		Add --run-background-updates option to update_database script. (#10954) 
Signed-off-by: Nick Barrett <nick@beeper.com>
 2021-10-06 11:26:18 +01:00
Sean
924276f482
 		Add a partial index to presence_stream to speed up startups (#10748) 
Signed-off-by: Sean Quah <seanq@element.io>
 2021-09-03 17:16:56 +01:00
Erik Johnston
6655ea5587
 		Add script for getting info about recently registered users (#10290) 2021-07-06 13:03:16 +01:00
Quentin Gliech
bd4919fb72
 		MSC2918 Refresh tokens implementation (#9450) 
This implements refresh tokens, as defined by MSC2918

This MSC has been implemented client side in Hydrogen Web: vector-im/hydrogen-web#235

The basics of the MSC works: requesting refresh tokens on login, having the access tokens expire, and using the refresh token to get a new one.

Signed-off-by: Quentin Gliech <quentingliech@gmail.com>
 2021-06-24 14:33:20 +01:00
Richard van der Hoff
daca7b2794
 		Fix off-by-one-error in synapse_port_db (#9991) 
fixes #9979
 2021-05-24 14:03:00 +01:00
Richard van der Hoff
6482075c95
 		Run black on the scripts (#9981) 
Turns out these scripts weren't getting linted.
 2021-05-14 11:46:35 +01:00
Richard van der Hoff
51065c44bb
 		Fix port_db on empty db (#9930) 
... and test it.
 2021-05-10 13:02:55 +01:00
Erik Johnston
9d25a0ae65
 		Split presence out of master (#9820) 2021-04-23 12:21:55 +01:00
Jonathan de Jong
4b965c862d
 		Remove redundant "coding: utf-8" lines (#9786) 
Part of #9744

Removes all redundant `# -*- coding: utf-8 -*-` lines from files, as python 3 automatically reads source code as utf-8 now.

`Signed-off-by: Jonathan de Jong <jonathan@automatia.nl>`
 2021-04-14 15:34:27 +01:00
Ankit Dobhal
d66f9070cd
 		Fixed code misc. quality issues (#9649) 
- Merge 'isinstance' calls.
- Remove unnecessary dict call outside of comprehension.
- Use 'sys.exit()' calls.
 2021-03-22 11:18:13 -04:00
Erik Johnston
16108c579d
 		Fix SQL delta file taking a long time to run (#9516) 
Fixes #9504
 2021-03-02 14:05:01 +00:00
Patrick Cloke
65a9eb8994
 		Include newly added sequences in the port DB script. (#9449) 
And ensure the consistency of `event_auth_chain_id`.
 2021-02-23 07:33:24 -05:00
Erik Johnston
7036e24e98
 		Add background update for add chain cover index (#9029) 2021-01-14 15:18:27 +00:00
Erik Johnston
b530eaa262
 		Allow running sendToDevice on workers (#9044) 2021-01-07 20:19:26 +00:00
Richard van der Hoff
3ad699cc65
 		Fix generate_log_config script (#8952) 
It used to write an empty file if you gave it a -o arg.
 2020-12-16 14:52:04 +00:00
Erik Johnston
1b15a3d92c
 		Fix port script so that it can be run again after failure. (#8755) 
If the script fails (or is CTRL-C'ed) between porting some of the events table and copying of the sequences then the port script will immediately die if run again due to the postgres DB having inconsistencies between sequences and tables.

The fix is to move the porting of sequences to before porting the tables, so that there is never a period where the Postgres DB is inconsistent. To do that we need to change how we port the sequences so that it calculates the values from the SQLite DB rather than the Postgres DB.

Fixes #8619
 2020-11-13 11:53:51 +00:00
Erik Johnston
41a389934e
 		Fix port script fails when DB has no backfilled events. (#8729) 
Fixes #8618
 2020-11-11 15:08:03 +00:00
Erik Johnston
5829872bec
 		Fix port script to handle foreign key constraints (#8730) 2020-11-11 15:07:34 +00:00
Erik Johnston
1eb9de90c0
 		Improve start time by adding index to e2e_cross_signing_keys (#8694) 
We do a `SELECT MAX(stream_id) FROM e2e_cross_signing_keys` on startup.
 2020-11-02 13:55:56 +00:00
Andrew Morgan
a312e890f5
 		Cast errors generated during synapse_port_db to str (#8585) 
I noticed in https://github.com/matrix-org/synapse/issues/8575 that the `end_error` variable in `synapse_port_db` is set to an `Exception`, even though later we expect it to be a `str`.

This PR simply casts an exception raised to a string. I'm doing this instead of having `end_error` be of type exception as we explicitly set `end_error` to a str here:

d25eb8f370/scripts/synapse_port_db (L542-L547)

This whole file could probably use some heavy refactoring, but until then at least this fix will prevent exception contents from being hidden from us and users.
 2020-10-20 11:47:24 +01:00
Hubert Chathi
3cd78bbe9e
 		Add support for MSC2732: olm fallback keys (#8312) 2020-10-06 13:26:29 -04:00
Erik Johnston
e3debf9682
 		Add logging on startup/shutdown (#8448) 
This is so we can tell what is going on when things are taking a while to start up.

The main change here is to ensure that transactions that are created during startup get correctly logged like normal transactions.
 2020-10-02 15:20:45 +01:00
Dagfinn Ilmari Mannsåker
bd715e1278
 		Add ui_auth_sessions_ips table to synapse_port_db ignore list (#8410) 
This table was created in #8034 (1.20.0).  It references
`ui_auth_sessions`, which is ignored, so this one should be too.

Signed-off-by: Dagfinn Ilmari Mannsåker <ilmari@ilmari.org>
 2020-09-28 15:35:02 +01:00
Erik Johnston
6fdf577593
 		Add new sequences to port DB script (#8387) 2020-09-24 13:43:49 +01:00
Patrick Cloke
13099ae431
 		Mark the shadow_banned column as boolean in synapse_port_db. (#8386) 2020-09-24 08:13:55 -04:00
Jonathan de Jong
837293c314
 		Remove obsolete __future__ imports (#8337) 2020-09-17 08:37:01 -04:00
Brendan Abolivier
2ffd6783c7
 		Revert #7736 (#8039) 2020-08-06 17:15:35 +01:00
Erik Johnston
a7bdf98d01
 		Rename database classes to make some sense (#8033) 2020-08-05 21:38:57 +01:00
Brendan Abolivier
8dff4a1242
 		Re-implement unread counts (#7736) 2020-07-29 18:26:55 +01:00
Richard van der Hoff
c445bc0cad Use a postgres sequence to generate guest user IDs 2020-07-16 13:00:25 +01:00
Patrick Cloke
24110255cd
 		Sync ignored table names in synapse_port_db to current database schema (#7717) 2020-06-23 07:33:25 -04:00
Patrick Cloke
95e41f368b
 		Allow local media to be marked as safe from being quarantined. (#7718) 2020-06-22 08:04:14 -04:00
Patrick Cloke
6418b0379f
 		Ignore the UI Auth sessions when porting from sqlite to postgresql (#7711) 2020-06-17 10:01:18 -04:00
Dagfinn Ilmari Mannsåker
a3f11567d9
 		Replace all remaining six usage with native Python 3 equivalents (#7704) 2020-06-16 08:51:47 -04:00
Erik Johnston
e5c67d04db
 		Add option to move event persistence off master (#7517) 2020-05-22 16:11:35 +01:00
Erik Johnston
d7983b63a6
 		Support any process writing to cache invalidation stream. (#7436) 2020-05-07 13:51:08 +01:00
Ivan Vilata-i-Balaguer
837f62266b Avoid attribute error when password_config present but empty (#6753) 
The old statement returned `None` for such a `password_config` (like the one
created on first run), thus retrieval of the `pepper` key failed with
`AttributeError`.

Fixes #5315

Signed-off-by: Ivan Vilata i Balaguer <ivan@selidor.net>
 2020-01-22 07:32:52 +00:00
Brendan Abolivier
07124d028d
 		Port synapse_port_db to async/await (#6718) 
* Raise an exception if there are pending background updates

So we return with a non-0 code

* Changelog

* Port synapse_port_db to async/await

* Port update_database to async/await

* Add version string to mocked homeservers

* Remove unused imports

* Convert overseen bits to async/await

* Fixup logging contexts

* Fix imports

* Add a way to print an error without raising an exception

* Incorporate review
 2020-01-21 19:04:58 +00:00
Erik Johnston
28c98e51ff
 		Add local_current_membership table (#6655) 
Currently we rely on `current_state_events` to figure out what rooms a
user was in and their last membership event in there. However, if the
server leaves the room then the table may be cleaned up and that
information is lost. So lets add a table that separately holds that
information.
 2020-01-15 14:59:33 +00:00
Richard van der Hoff
bf46821180 Refuse to start if sqlite is older than 3.11.0 2020-01-09 18:11:04 +00:00
Richard van der Hoff
e97d1cf001 Modify check_database to take a connection rather than a cursor 
We might not need the cursor at all.
 2020-01-09 18:05:50 +00:00
Richard van der Hoff
85db7f73be
 		Add a background update to clear tombstoned rooms from the directory (#6648) 
* Add a background update to clear tombstoned rooms from the directory

* use the ABC metaclass
 2020-01-07 14:18:43 +00:00
Richard van der Hoff
08815566bc
 		Automate generation of the sample and debian log configs (#6627) 2020-01-03 17:14:00 +00:00
Erik Johnston
75d8f26ac8
 		Split state groups into a separate data store (#6296) 2019-12-20 10:48:24 +00:00
Richard van der Hoff
b95b762560
 		Add an export_signing_key script (#6546) 
I want to do some key rotation, and it is silly that we don't have a way to do
this.
 2019-12-19 11:11:14 +00:00
Erik Johnston
2284eb3a53
 		Add database config class (#6513) 
This encapsulates config for a given database and is the way to get new
connections.
 2019-12-18 10:45:12 +00:00
Erik Johnston
71ee22c0ba Fix port db script 2019-12-06 16:41:48 +00:00