142 Commits

Author	SHA1	Message	Date
Mark Haines	83f5125d52	Merge pull request #114 from matrix-org/improve_get_event_cache ... Improve get event cache	2015-04-08 16:50:27 +01:00
Erik Johnston	c1b34af441	Move database timer logging to seperate logger	2015-04-08 13:31:19 +01:00
Paul "LeoNerd" Evans	a198894bf7	Appease pep8	2015-03-26 11:53:58 +00:00
Paul "LeoNerd" Evans	953e40f9dc	Implement the main getEvent cache using Cache() instead of a custom application of LruCache; also unify its two-level structure into just one	2015-03-25 19:12:16 +00:00
Paul "LeoNerd" Evans	f173d40a32	Use FrozenEvent's reject_reason to decide whether to return it; don't include allow_rejected in the main getEvents cache key	2015-03-25 19:06:05 +00:00
Paul "LeoNerd" Evans	1b988b051b	Store the rejected reason in (Frozen)Event structs	2015-03-25 19:06:05 +00:00
Paul "LeoNerd" Evans	033a517feb	Indirect invalidations of _get_event_cache via a helper method to keep all uses of the cache lexically within one .py file	2015-03-25 19:06:05 +00:00
Paul "LeoNerd" Evans	9ba6487b3f	Allow a choice of LRU behaviour for Cache() by using LruCache() or OrderedDict()	2015-03-25 19:05:34 +00:00
Paul "LeoNerd" Evans	0f86312c4c	Pull out the cache logic from the @cached wrapper into its own class we can reuse	2015-03-20 18:25:42 +00:00
Paul "LeoNerd" Evans	b1022ed8b5	func(*EXPR) is valid Python syntax, really...	2015-03-20 17:47:45 +00:00
Erik Johnston	80cd08c190	PEP8	2015-03-20 16:03:25 +00:00
Erik Johnston	9517f4da4d	Merge branch 'develop' of github.com:matrix-org/synapse into store_rearrangement	2015-03-20 16:02:47 +00:00
Erik Johnston	dc0c989ef4	Give sensible names for '_simple_...' transactions	2015-03-20 15:59:18 +00:00
Erik Johnston	7e282a53a5	Tidy up _simple_... methods	2015-03-20 15:05:10 +00:00
Paul "LeoNerd" Evans	91cb46191d	Allow @cached-wrapped functions to have more or fewer than 1 argument; assert on the total count of them though	2015-03-20 14:59:45 +00:00
Erik Johnston	87db64b839	Rearrange storage modules	2015-03-20 14:11:38 +00:00
Paul "LeoNerd" Evans	1489521ee5	Be polite and ensure we use @functools.wraps() when creating a function decorator	2015-03-17 17:19:22 +00:00
Paul "LeoNerd" Evans	be170b1426	Add a metric for the scheduling latency of SQL queries	2015-03-16 17:21:59 +00:00
Paul "LeoNerd" Evans	e75fa8bbbf	Bugfix to sql_txn_timer increment - add only the per-TXN duration, not the total time ever spent since boot	2015-03-12 16:24:51 +00:00
Paul "LeoNerd" Evans	63cb7ece62	Rename the timer metrics exported by synapse.storage to append _time, so the meaning of ':total' is clearer	2015-03-12 16:24:51 +00:00
Paul "LeoNerd" Evans	f1fbe3e09f	Rename TimerMetric to DistributionMetric; as it could count more than just time	2015-03-12 16:24:51 +00:00
Paul "LeoNerd" Evans	642f725fd7	Pretend the 'getEvent' cache is just another cache in the set of all the others for metric	2015-03-12 16:24:51 +00:00
Paul "LeoNerd" Evans	b0cf867319	Use _ instead of . as a metric namespacing separator, for Prometheus	2015-03-12 16:24:51 +00:00
Paul "LeoNerd" Evans	f9478e475b	Rename Metrics' "keys" to "labels"	2015-03-12 16:24:51 +00:00
Paul "LeoNerd" Evans	fa319a5786	Add TimerMetrics to shadow the PerformanceCounters in synapse.storage; with the view to eventually replacing them entirely	2015-03-12 16:24:51 +00:00
Paul "LeoNerd" Evans	25187ab674	Collect per-SQL-verb timer stats on query execution time	2015-03-12 16:24:50 +00:00
Paul "LeoNerd" Evans	e1a7e3564f	Delete a couple of TODO markers of monitoring stats now done	2015-03-12 16:24:50 +00:00
Paul "LeoNerd" Evans	8664599af7	Rename CacheCounterMetric to just CacheMetric; add a CallbackMetric component to give the size of the cache	2015-03-12 16:24:50 +00:00
Paul "LeoNerd" Evans	b0cdf097f4	Sprinkle some CacheCounterMetrics around the synapse.storage layer	2015-03-12 16:24:50 +00:00
Paul "LeoNerd" Evans	59a5f012cc	Also give _execute() a description	2015-03-11 17:19:17 +00:00
Paul "LeoNerd" Evans	099e4b88d8	Add a description to storage layer's _execute_and_decode()	2015-03-11 17:08:57 +00:00
Kegan Dougal	3d73383d18	Modify _simple_select_list to allow an empty WHERE clause. Use it for get_all_rooms and get_all_users.	2015-03-02 10:16:24 +00:00
Paul "LeoNerd" Evans	9640510de2	Use OrderedDict for @cached backing store, so we can evict the oldest key unbiased	2015-02-23 18:41:58 +00:00
Paul "LeoNerd" Evans	f53fcbce97	Use cache.pop() instead of a separate membership test + del []	2015-02-23 18:30:45 +00:00
Mark Haines	27080698e7	Fix code style warning	2015-02-23 18:19:13 +00:00
Paul "LeoNerd" Evans	a09e59a698	Pull the _get_event_cache.setdefault() call out of the try block, as it doesn't need to be there and is confusing	2015-02-23 16:55:57 +00:00
Paul "LeoNerd" Evans	e76d485e29	Allow @cached-wrapped functions to have a prefill method for setting entries	2015-02-23 15:41:54 +00:00
Paul "LeoNerd" Evans	55022d6ca5	Remove a TODO note	2015-02-19 18:38:09 +00:00
Paul "LeoNerd" Evans	ebc3db295b	Take named arguments to @cached() decorator, add a 'max_entries' limit	2015-02-19 18:36:02 +00:00
Paul "LeoNerd" Evans	077d200342	Move @cached decorator out into synapse.storage._base; add minimal docs	2015-02-19 17:29:39 +00:00
Erik Johnston	42bc56dad3	Merge branch 'develop' of github.com:matrix-org/synapse into use-simplejson	2015-02-11 17:01:38 +00:00
Mark Haines	aff892ce79	Fix formatting	2015-02-11 15:02:35 +00:00
Mark Haines	f5a70e0d2e	Add a cache for get_event	2015-02-11 15:01:15 +00:00
Erik Johnston	4ebbaf0d43	Blunty replace json with simplejson	2015-02-11 14:23:10 +00:00
Mark Haines	b085fac735	Code-style fixes	2015-02-10 16:30:48 +00:00
Mark Haines	fda4422bc9	Fix pyflakes	2015-02-10 14:54:07 +00:00
Mark Haines	d7c7efb691	Add performance counters for different stages of loading events	2015-02-10 14:50:53 +00:00
Mark Haines	0c4536da8f	Use the transaction 'desc' rather than 'name', increment the txn_ids in ... txn names	2015-02-09 18:06:31 +00:00
Mark Haines	347b497db0	Formatting	2015-02-09 17:57:09 +00:00
Mark Haines	3a5ad7dbd5	Performance counters for database transaction names	2015-02-09 17:55:56 +00:00