1493 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Barbara Miller	0f3d2b7172	fix merge error	2024-05-29 21:38:24 -07:00
Barbara Miller	f9ad480fae	Merge branch 'rotary_skip_ytdlp' into qa	2024-05-29 17:30:07 -07:00
Barbara Miller	6fc409f554	update for default = False	2024-05-29 17:20:05 -07:00
Barbara Miller	a1a04aa0c5	cli.py updates from code review	2024-05-29 17:05:04 -07:00
Barbara Miller	4eb79ca936	add skip_ytdlp to class Site	2024-05-29 16:47:55 -07:00
Barbara Miller	a73059d25f	black'd	2024-05-29 16:23:18 -07:00
Barbara Miller	2e560d3c18	skip_av_seeds	2024-05-29 16:11:18 -07:00
Barbara Miller	c66fec4c6d	Merge remote-tracking branch 'upstream/master' into rotary_skip_ytdlp	2024-05-13 18:34:50 -07:00
Barbara Miller	d51d09c640	bump version	2024-04-29 14:46:43 -07:00
Barbara Miller	78120589fb	Merge pull request #278 from galgeek/nsw-pub ... behavior to capture opengov.nsw.gov document pages	2024-04-29 14:44:38 -07:00
Barbara Miller	f22b000d0b	opengov.nsw.gov behavior	2024-04-29 14:18:49 -07:00
Barbara Miller	616916c096	Merge branch 'rotary_skip_ytdlp' into qa	2024-04-25 14:19:31 -07:00
Barbara Miller	33681b59cb	Merge branch 'nsw-pub' into qa	2024-04-25 14:19:11 -07:00
Barbara Miller	5432844994	nsw.gov pubs behavior	2024-04-25 14:18:00 -07:00
Barbara Miller	ff02480a13	skip ytdlp for Rotary seeds	2024-04-24 17:25:49 -07:00
Barbara Miller	a7c2d469ca	bump version	2024-04-24 10:42:59 -07:00
Barbara Miller	68c132a2d3	Merge pull request #276 from galgeek/ytdlp_last ... run yt-dlp after brozzling a page, not before	2024-04-24 10:41:37 -07:00
Barbara Miller	b09b3b5438	Merge branch 'ytdlp_last' into qa	2024-04-23 16:18:30 -07:00
Barbara Miller	2d183c7d0c	if not self._needs_browsing; _get_page_headers comment	2024-04-23 16:01:35 -07:00
Barbara Miller	7764c3f6d7	add comment	2024-04-23 16:00:18 -07:00
Barbara Miller	064b1a87ee	bump qa version	2024-04-23 12:49:31 -07:00
Barbara Miller	e7a90e83fc	Merge branch 'ytdlp_last' into qa	2024-04-23 12:46:04 -07:00
Barbara Miller	487a7009f0	rm remaining spy/fetch	2024-04-23 12:41:38 -07:00
Barbara Miller	d25dd9f36f	Merge branch 'rotary2024' into qa	2024-04-22 17:49:32 -07:00
Barbara Miller	e45520826f	increase timeout	2024-04-22 17:48:56 -07:00
Barbara Miller	8f6bdd31d3	Merge branch 'ytdlp_last' into qa	2024-04-22 17:45:09 -07:00
Barbara Miller	f9b77fc2bc	rm remaining spy/fetch stuff	2024-04-22 17:43:17 -07:00
Barbara Miller	0485d9c83a	Merge branch 'rotary2024' into qa	2024-04-19 14:02:26 -07:00
Barbara Miller	97143e2b0e	error handling and logging for push_video	2024-04-19 14:00:17 -07:00
Barbara Miller	b3ef8d87c2	Merge branch 'ytdlp_last' into qa	2024-04-19 13:24:01 -07:00
Barbara Miller	5cc056cc7b	use requests' CaseInsensitiveDict	2024-04-19 12:44:45 -07:00
Barbara Miller	55ce73ebcd	fix merge error	2024-04-18 17:26:57 -07:00
Barbara Miller	55517fb432	Merge branch 'ytdlp_last' into qa	2024-04-18 16:24:10 -07:00
Barbara Miller	12e49bf29e	add / check status code for yt-dlp	2024-04-18 16:19:13 -07:00
Barbara Miller	423f05b841	black'd	2024-04-18 15:44:35 -07:00
Barbara Miller	700c80ba90	use page headers to browse or fetch	2024-04-18 15:41:00 -07:00
Barbara Miller	f2c89d1c18	skip more exts, plus chrome-error	2024-04-17 17:23:36 -07:00
Barbara Miller	737770e3ba	locally black'd, to avoid github formatting error?	2024-04-17 10:48:03 -07:00
Barbara Miller	a50f9380ad	Merge branch 'better-headless' into qa	2024-04-16 18:22:15 -07:00
Vangelis Banos	7d580420ba	Replace double quote with single quote ... Fix black warnings	2024-04-15 19:23:44 +00:00
Vangelis Banos	1c0c385ff1	Use --headless=new or --headless=chrome if supported ... Ref: https://developer.chrome.com/docs/chromium/new-headless	2024-04-15 18:48:54 +00:00
Barbara Miller	4a5283944d	Merge branch 'ytdlp_last' into qa	2024-04-10 13:42:27 -07:00
Barbara Miller	5fa25a747f	mv append ytdlp_outlinks	2024-04-10 13:42:10 -07:00
Barbara Miller	0b26509637	more ytdlp_url	2024-04-10 13:41:03 -07:00
Barbara Miller	81e526b204	Merge branch 'video_predup' into qa	2024-04-10 13:24:41 -07:00
Barbara Miller	5751e2e336	urlcanon.aggressive for should_ytdlp, for now	2024-04-10 13:23:42 -07:00
Barbara Miller	04301da1b1	bump qa version	2024-04-05 17:11:59 -07:00
Barbara Miller	707ee8bd8e	Merge branch 'video_predup' into qa	2024-04-05 17:11:14 -07:00
Barbara Miller	02d26b0b9c	pylint (partial) and other tidying	2024-04-05 17:09:22 -07:00
Barbara Miller	d9b11b32b3	Merge branch 'video_predup' into qa	2024-04-05 14:47:50 -07:00