1743 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Gretchen Miller	dca9630982	WT-2950 cleaning up video capture options handling; PDFs only handling on outlinks	2024-09-20 14:17:07 -07:00
Barbara Miller	bcbe331463	Merge branch 'metrics_plus_proxy_retries' into qa	2024-09-19 21:01:09 -07:00
Barbara Miller	c74d9ad90f	limit proxy logging	2024-09-19 21:00:13 -07:00
Barbara Miller	cb4da54e36	Merge branch 'metrics_plus_proxy_retries' into qa	2024-09-19 19:48:24 -07:00
Barbara Miller	229d53d4b1	add brozzler_ydl_download_successes metric	2024-09-19 19:47:06 -07:00
Barbara Miller	08c01f279c	fix qa merge error	2024-09-19 11:23:18 -07:00
Barbara Miller	3b4db5c74d	Merge branch 'metrics_plus_proxy_retries' into qa	2024-09-19 10:54:55 -07:00
Barbara Miller	7fbee54eaa	proxyrack only for youtube.com	2024-09-19 10:45:01 -07:00
Barbara Miller	f624e7ee8e	bump qa-ish version	2024-09-18 17:26:23 -07:00
Barbara Miller	04aaec0ac5	Merge branch 'metrics_plus_proxy_retries' into qa	2024-09-18 16:01:03 -07:00
Barbara Miller	2aa1788637	mostly black'd	2024-09-18 15:58:19 -07:00
Barbara Miller	27cb104b45	more extract (less download)	2024-09-18 15:57:47 -07:00
Barbara Miller	44b5317b93	Merge branch 'metrics_plus_proxy_retries' into qa	2024-09-18 15:08:48 -07:00
Barbara Miller	62b12434d0	mostly ydl.py updates for new proxyrack testing	2024-09-18 14:51:11 -07:00
Barbara Miller	8b2c254485	brozzler_ydl_extract, not download	2024-09-18 14:17:10 -07:00
Barbara Miller	bb1c343724	updates for review of PR 287	2024-09-17 17:53:50 -07:00
Barbara Miller	cfafc560c5	Merge branch 'proxyrack' into metrics_plus_proxy_retries	2024-09-16 15:34:11 -07:00
Barbara Miller	4a60ff3367	post-deploy bug fixes	2024-09-13 17:01:35 -07:00
Gretchen Miller	8275f3ea16	another tiny ruff format pass	2024-09-13 16:04:58 -07:00
Barbara Miller	aaf85db638	Merge branch 'new_metrics' into qa	2024-09-13 14:24:34 -07:00
Gretchen Miller	66263f0371	WT-2950 video capture options enum	2024-09-13 14:21:59 -07:00
Barbara Miller	551d1868d1	better order	2024-09-13 14:16:49 -07:00
Barbara Miller	1a6aeb45db	track_inprogress (not _in_progress)	2024-09-13 14:12:46 -07:00
Barbara Miller	8c20d1dad3	add (back) env param	2024-09-13 14:09:06 -07:00
Gretchen Miller	77e6b9ed52	small ruff formatting pass	2024-09-13 13:38:21 -07:00
Gretchen Miller	c722549697	WT-2950 exclude video file types if site has disabled video capture	2024-09-13 13:33:57 -07:00
Barbara Miller	9d7b7c4167	add @metrics.brozzler_in_progress_pages.track_in_progress()	2024-09-13 13:15:57 -07:00
Barbara Miller	1bc2135462	better registry_url help	2024-09-13 13:12:02 -07:00
Barbara Miller	66096453d1	tidy params for register_prom_metrics	2024-09-13 09:43:54 -07:00
Barbara Miller	7b6c306d14	setup registry_url, metrics_port, env vars and CLI args	2024-09-12 18:07:10 -07:00
Gretchen Miller	c3a92b102f	WT-2950 invert conditionals to PEP8 preferred code style (E713)	2024-09-12 16:54:00 -07:00
Gretchen Miller	eb227b0d4e	WT-2950 replace skip_ytdlp with video_capture	2024-09-12 16:51:48 -07:00
Gretchen Miller	d9ed5c434a	WT-2950 remove skip_av_seeds	2024-09-12 16:45:52 -07:00
Barbara Miller	80ce6c0ea6	register_prom_metrics working in dev env	2024-09-12 16:12:18 -07:00
Barbara Miller	66827fbbcf	more metrics	2024-09-12 14:27:22 -07:00
Barbara Miller	c82858a9f6	make http_sd_registry optional	2024-09-12 13:11:41 -07:00
Barbara Miller	1d84e72ce7	update setup.py: skip prometheus-async; update ytdlp	2024-09-12 13:10:26 -07:00
Barbara Miller	1d63793788	add update_page_metrics	2024-09-12 11:32:06 -07:00
Barbara Miller	7de5b1cbd7	add some labels	2024-09-11 17:37:55 -07:00
Barbara Miller	2d7efba280	initial commit	2024-09-11 16:41:02 -07:00
Barbara Miller	c4e7c040b4	bump qa version	2024-09-11 09:54:48 -07:00
Barbara Miller	39c677007e	Merge branch 'proxyrack' into qa	2024-09-11 09:54:17 -07:00
Barbara Miller	edf2f9e51a	retries for proxyrack and push	2024-09-11 09:52:32 -07:00
Adam Miller	0dca9f3861	chore: formatting	2024-08-30 21:15:59 +00:00
Adam Miller	18a976f82c	feat: Detect connection failures forwarded from warcprox and retry them with backoff	2024-08-30 21:11:02 +00:00
Barbara Miller	138c93bcd0	Merge branch 'maricopa-civicplus' into qa	2024-08-20 11:47:42 -07:00
Barbara Miller	71c5691242	maricopa.gov civicplus behavior	2024-08-20 11:43:24 -07:00
Adam Miller	0d8721a4d3	Bump version	2024-08-19 22:42:30 +00:00
Adam Miller	68a6953077	Merge pull request #284 from internetarchive/adam/adds_get_page_header_exception_handling ... fix: handle exceptions when requesting page headers for content-type …	2024-08-19 15:31:13 -07:00
Adam Miller	4870269c64	Merge branch 'adam/adds_get_page_header_exception_handling' into qa	2024-08-12 23:54:05 +00:00