10047 Commits

Author	SHA1	Message	Date
Richard van der Hoff	b4189b112f	Rename get_events->get_events_from_store_or_dest (#5344) ... We have too many things called get_event, and it's hard to figure out what we mean. Also remove some unused params from the signature, and add some logging.	2019-06-04 18:01:09 +01:00
Brendan Abolivier	f6dd12d1e2	Merge pull request #5341 from matrix-org/babolivier/email_config ... Make account validity renewal emails work when email notifs are disabled	2019-06-04 14:49:06 +01:00
Brendan Abolivier	2f62e1f6ff	Only parse from email if provided	2019-06-04 14:24:36 +01:00
Erik Johnston	d1d38081a7	Merge pull request #5324 from matrix-org/erikj/ignore_null ... Ignore room state with null bytes in for room stats	2019-06-04 14:20:08 +01:00
Brendan Abolivier	1cc5fc1f6c	Lint	2019-06-04 13:51:23 +01:00
Brendan Abolivier	ac3cc32367	Make account validity renewal emails work when email notifs are disabled	2019-06-04 13:47:44 +01:00
Richard van der Hoff	df9c100542	Avoid rapidly backing-off a server if we ignore the retry interval (#5335)	2019-06-04 11:53:29 +01:00
Richard van der Hoff	4d08b8f30c	Don't do long retries when calling the key notary server. (#5334) ... It takes at least 20 minutes to work through the long_retries schedule (11 attempts, each with a 60 second timeout, and 60 seconds between each request), so if the notary server isn't returning within the timeout, we'll just end up blocking whatever request is happening for 20 minutes. Ain't nobody got time for that.	2019-06-04 11:53:07 +01:00
Richard van der Hoff	cb683d3e3c	Merge pull request #5333 from matrix-org/rav/server_keys/09_improve_notary_server ... Fixes for the key-notary server	2019-06-04 11:48:18 +01:00
Richard van der Hoff	5bdb189f86	Improve docstrings on MatrixFederationClient. (#5332)	2019-06-04 11:14:16 +01:00
Amber Brown	b2b90b7d34	Hawkowl/fix missing auth (#5328)	2019-06-04 15:54:27 +10:00
Richard van der Hoff	c5d60eadd5	Notary server: make requests to origins in parallel ... ... else we're guaranteed to time out.	2019-06-04 00:16:56 +01:00
Richard van der Hoff	def5ea4062	Don't bomb out on direct key fetches as soon as one fails	2019-06-04 00:16:56 +01:00
Richard van der Hoff	dce6e9e0c1	Avoid rapidly backing-off a server if we ignore the retry interval	2019-06-03 23:58:42 +01:00
Richard van der Hoff	06a1f3e207	Reduce timeout for outbound /key/v2/server requests.	2019-06-03 23:17:38 +01:00
Richard van der Hoff	fec2dcb1a5	Enforce validity period on server_keys for fed requests. (#5321) ... When handling incoming federation requests, make sure that we have an up-to-date copy of the signing key. We do not yet enforce the validity period for event signatures.	2019-06-03 22:59:51 +01:00
Erik Johnston	0a56966f7d	Fix	2019-06-03 17:42:52 +01:00
Erik Johnston	fa4b54aca5	Ignore room state with null bytes in for room stats	2019-06-03 17:06:54 +01:00
Richard van der Hoff	862b2f9ad5	Merge pull request #5307 from matrix-org/rav/server_keys/07-fix-notary-cache-poison ... Stop overwriting server keys with other keys	2019-06-03 13:19:20 +01:00
Amber Brown	2889b05554	Unify v1 and v2 REST client APIs (#5226)	2019-06-03 21:28:59 +10:00
Richard van der Hoff	d828d1dc57	Merge pull request #5309 from matrix-org/rav/limit_displayname_length ... Limit displaynames and avatar URLs	2019-06-01 11:34:50 +01:00
Richard van der Hoff	d16c6375fe	Limit displaynames and avatar URLs ... These end up in join events everywhere, so let's limit them. Fixes #5079	2019-06-01 10:44:36 +01:00
Richard van der Hoff	37b165620d	Merge pull request #5299 from matrix-org/rav/server_keys/05-rewrite-gsvk-again ... Rewrite get_server_verify_keys, again.	2019-05-31 17:07:31 +01:00
Richard van der Hoff	3600f5568b	Stop overwriting server keys with other keys ... Fix a bug where we would discard a key result which the origin server is no longer returning. Fixes #5305.	2019-05-31 15:58:35 +01:00
Erik Johnston	58cce39f3a	Merge pull request #5276 from matrix-org/babolivier/account_validity_job_delta ... Allow configuring a range for the account validity startup job	2019-05-31 12:11:56 +01:00
Richard van der Hoff	c605da97bf	Merge remote-tracking branch 'origin/develop' into rav/server_keys/05-rewrite-gsvk-again	2019-05-31 11:38:13 +01:00
Richard van der Hoff	fe79b5e521	Merge pull request #5300 from matrix-org/rav/server_keys/06-fix-serverkeys-handling ... Remove some pointless exception handling	2019-05-31 11:35:29 +01:00
Richard van der Hoff	2ae3cc287e	Merge pull request #5296 from matrix-org/rav/server_keys/04-use-attrs-for_verify-request ... use attr.s for VerifyKeyRequest	2019-05-31 11:34:09 +01:00
Brendan Abolivier	4d794dae21	Move delta from +10% to -10%	2019-05-31 11:09:39 +01:00
Erik Johnston	e9981d58ca	Merge pull request #5293 from Kagamihime/messages-federation-format ... Fix ignored filter field in `/messages` endpoint	2019-05-31 10:52:59 +01:00
Erik Johnston	31d44ec4bd	Merge pull request #5294 from matrix-org/erikj/speed_up_room_stats ... Speed up room stats background update	2019-05-31 10:48:51 +01:00
Erik Johnston	5037326d66	Add indices. Remove room_ids accidentally added ... We have to do this by re-inserting a background update and recreating tables, as the tables only get created during a background update and will later be deleted. We also make sure that we remove any entries that should have been removed but weren't due to a race that has been fixed in a previous commit.	2019-05-31 10:26:56 +01:00
Brendan Abolivier	0c2362861e	Gah python	2019-05-31 09:56:52 +01:00
Brendan Abolivier	847b9dcd1c	Make max_delta equal to period * 10%	2019-05-31 09:54:46 +01:00
Richard van der Hoff	8ea2f756a9	Remove some pointless exception handling ... The verify_request deferred already returns a suitable SynapseError, so I don't really know what we expect to achieve by doing more wrapping, other than log spam. Fixes #4278.	2019-05-30 18:29:56 +01:00
Richard van der Hoff	a82c96b87f	Rewrite get_server_verify_keys, again. ... Attempt to simplify the logic in get_server_verify_keys by splitting it into two methods.	2019-05-30 18:20:40 +01:00
Richard van der Hoff	099829d5a9	use attr.s for VerifyKeyRequest ... because namedtuple is awful	2019-05-30 17:39:28 +01:00
Erik Johnston	99113e40ba	Merge branch 'master' into develop	2019-05-30 16:39:49 +01:00
Erik Johnston	c831748f4d	0.99.5.2	2019-05-30 16:29:47 +01:00
Erik Johnston	e2c3660a0f	Add index to temp table	2019-05-30 16:18:40 +01:00
Erik Johnston	06eb408da5	Update synapse/storage/events_bg_updates.py ... Co-Authored-By: Richard van der Hoff <1389908+richvdh@users.noreply.github.com>	2019-05-30 16:15:37 +01:00
Erik Johnston	7386c35f58	Rename constant	2019-05-30 16:15:37 +01:00
Erik Johnston	98f438b52a	Move event background updates to a separate file	2019-05-30 16:15:37 +01:00
Erik Johnston	9b8cd66524	Fixup comments and logging	2019-05-30 16:15:37 +01:00
Erik Johnston	1d818fde14	Log actual number of entries deleted	2019-05-30 16:15:37 +01:00
Erik Johnston	6ebc08c09d	Add DB bg update to cleanup extremities. ... Due to #5269 we may have extremities in our DB that we shouldn't have, so lets add a cleanup task such to remove those.	2019-05-30 16:15:37 +01:00
Erik Johnston	df9d900544	Correctly filter out extremities with soft failed prevs (#5274) ... When we receive a soft failed event we, correctly, *do not* update the forward extremity table with the event. However, if we later receive an event that references the soft failed event we then need to remove the soft failed events prev events from the forward extremities table, otherwise we just build up forward extremities. Fixes #5269	2019-05-30 16:12:50 +01:00
Eisha Chen-yen-su	8824325b82	Fix ignored filter field in /messages endpoint ... This fixes a bug which were causing the "event_format" field to be ignored in the filter of requests to the `/messages` endpoint of the CS API. Signed-off-by: Eisha Chen-yen-su <chenyensu0@gmail.com>	2019-05-30 16:58:53 +02:00
Erik Johnston	5ac75fc9a2	Join against events to use its room_id index	2019-05-30 15:26:55 +01:00
Erik Johnston	e2c46ed851	Move deletion from table inside txn	2019-05-30 15:26:38 +01:00