1682 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Barbara Miller	27cb104b45	more extract (less download)	2024-09-18 15:57:47 -07:00
Barbara Miller	44b5317b93	Merge branch 'metrics_plus_proxy_retries' into qa	2024-09-18 15:08:48 -07:00
Barbara Miller	62b12434d0	mostly ydl.py updates for new proxyrack testing	2024-09-18 14:51:11 -07:00
Barbara Miller	8b2c254485	brozzler_ydl_extract, not download	2024-09-18 14:17:10 -07:00
Barbara Miller	bb1c343724	updates for review of PR 287	2024-09-17 17:53:50 -07:00
Barbara Miller	cfafc560c5	Merge branch 'proxyrack' into metrics_plus_proxy_retries	2024-09-16 15:34:11 -07:00
Barbara Miller	4a60ff3367	post-deploy bug fixes	2024-09-13 17:01:35 -07:00
Gretchen Miller	8275f3ea16	another tiny ruff format pass	2024-09-13 16:04:58 -07:00
Barbara Miller	aaf85db638	Merge branch 'new_metrics' into qa	2024-09-13 14:24:34 -07:00
Gretchen Miller	66263f0371	WT-2950 video capture options enum	2024-09-13 14:21:59 -07:00
Barbara Miller	551d1868d1	better order	2024-09-13 14:16:49 -07:00
Barbara Miller	1a6aeb45db	track_inprogress (not _in_progress)	2024-09-13 14:12:46 -07:00
Barbara Miller	8c20d1dad3	add (back) env param	2024-09-13 14:09:06 -07:00
Gretchen Miller	77e6b9ed52	small ruff formatting pass	2024-09-13 13:38:21 -07:00
Gretchen Miller	c722549697	WT-2950 exclude video file types if site has disabled video capture	2024-09-13 13:33:57 -07:00
Barbara Miller	9d7b7c4167	add @metrics.brozzler_in_progress_pages.track_in_progress()	2024-09-13 13:15:57 -07:00
Barbara Miller	1bc2135462	better registry_url help	2024-09-13 13:12:02 -07:00
Barbara Miller	66096453d1	tidy params for register_prom_metrics	2024-09-13 09:43:54 -07:00
Barbara Miller	7b6c306d14	setup registry_url, metrics_port, env vars and CLI args	2024-09-12 18:07:10 -07:00
Gretchen Miller	c3a92b102f	WT-2950 invert conditionals to PEP8 preferred code style (E713)	2024-09-12 16:54:00 -07:00
Gretchen Miller	eb227b0d4e	WT-2950 replace skip_ytdlp with video_capture	2024-09-12 16:51:48 -07:00
Gretchen Miller	d9ed5c434a	WT-2950 remove skip_av_seeds	2024-09-12 16:45:52 -07:00
Barbara Miller	80ce6c0ea6	register_prom_metrics working in dev env	2024-09-12 16:12:18 -07:00
Barbara Miller	66827fbbcf	more metrics	2024-09-12 14:27:22 -07:00
Barbara Miller	c82858a9f6	make http_sd_registry optional	2024-09-12 13:11:41 -07:00
Barbara Miller	1d84e72ce7	update setup.py: skip prometheus-async; update ytdlp	2024-09-12 13:10:26 -07:00
Barbara Miller	1d63793788	add update_page_metrics	2024-09-12 11:32:06 -07:00
Barbara Miller	7de5b1cbd7	add some labels	2024-09-11 17:37:55 -07:00
Barbara Miller	2d7efba280	initial commit	2024-09-11 16:41:02 -07:00
Barbara Miller	c4e7c040b4	bump qa version	2024-09-11 09:54:48 -07:00
Barbara Miller	39c677007e	Merge branch 'proxyrack' into qa	2024-09-11 09:54:17 -07:00
Barbara Miller	edf2f9e51a	retries for proxyrack and push	2024-09-11 09:52:32 -07:00
Adam Miller	0dca9f3861	chore: formatting	2024-08-30 21:15:59 +00:00
Adam Miller	18a976f82c	feat: Detect connection failures forwarded from warcprox and retry them with backoff	2024-08-30 21:11:02 +00:00
Barbara Miller	138c93bcd0	Merge branch 'maricopa-civicplus' into qa	2024-08-20 11:47:42 -07:00
Barbara Miller	71c5691242	maricopa.gov civicplus behavior	2024-08-20 11:43:24 -07:00
Adam Miller	0d8721a4d3	Bump version	2024-08-19 22:42:30 +00:00
Adam Miller	68a6953077	Merge pull request #284 from internetarchive/adam/adds_get_page_header_exception_handling ... fix: handle exceptions when requesting page headers for content-type …	2024-08-19 15:31:13 -07:00
Adam Miller	4870269c64	Merge branch 'adam/adds_get_page_header_exception_handling' into qa	2024-08-12 23:54:05 +00:00
Adam Miller	2dfe841493	fix: match original indenting	2024-08-12 23:53:04 +00:00
Adam Miller	d9406485ae	Merge branch 'adam/adds_get_page_header_exception_handling' into qa	2024-08-12 23:42:31 +00:00
Adam Miller	f40bbd13d9	fix: handle exceptions when requesting page headers for content-type sampling.	2024-08-12 23:33:53 +00:00
Barbara Miller	43a37f02ce	bump version	2024-08-12 13:12:28 -07:00
Barbara Miller	fa24ee3685	Merge pull request #283 from galgeek/bmiller/WT-2862-yt-dlp-format-update ... prioritize video resolution — stop preferring single file download from yt-dlp	2024-08-12 12:42:09 -07:00
Barbara Miller	ef59f474bd	stop preferring single file download from ytdlp	2024-08-12 12:14:54 -07:00
Barbara Miller	d445d1883c	Merge branch 'bmiller/WT-2862-ytdlp-prioritize-resolution' into qa	2024-08-06 16:58:06 -07:00
Barbara Miller	477d1cc89d	bump qa version	2024-08-06 16:56:35 -07:00
Barbara Miller	1490ac0570	stop preferring single file download from ytdlp	2024-08-06 16:56:10 -07:00
Barbara Miller	16921d11be	bump version	2024-07-30 12:59:28 -07:00
Barbara Miller	c1f5aaf318	Merge pull request #282 from galgeek/2407-deps-update ... websocket-client update, plus yt-dlp update	2024-07-30 12:37:39 -07:00