1579 Commits

Author SHA1 Message Date
Barbara Miller
ff02480a13 skip ytdlp for Rotary seeds 2024-04-24 17:25:49 -07:00
Barbara Miller
a7c2d469ca
bump version 2024-04-24 10:42:59 -07:00
Barbara Miller
68c132a2d3
Merge pull request #276 from galgeek/ytdlp_last
run yt-dlp after brozzling a page, not before
2024-04-24 10:41:37 -07:00
Barbara Miller
b09b3b5438 Merge branch 'ytdlp_last' into qa 2024-04-23 16:18:30 -07:00
Barbara Miller
2d183c7d0c if not self._needs_browsing; _get_page_headers comment 2024-04-23 16:01:35 -07:00
Barbara Miller
7764c3f6d7 add comment 2024-04-23 16:00:18 -07:00
Barbara Miller
064b1a87ee bump qa version 2024-04-23 12:49:31 -07:00
Barbara Miller
e7a90e83fc Merge branch 'ytdlp_last' into qa 2024-04-23 12:46:04 -07:00
Barbara Miller
487a7009f0 rm remaining spy/fetch 2024-04-23 12:41:38 -07:00
Barbara Miller
d25dd9f36f Merge branch 'rotary2024' into qa 2024-04-22 17:49:32 -07:00
Barbara Miller
e45520826f increase timeout 2024-04-22 17:48:56 -07:00
Barbara Miller
8f6bdd31d3 Merge branch 'ytdlp_last' into qa 2024-04-22 17:45:09 -07:00
Barbara Miller
f9b77fc2bc rm remaining spy/fetch stuff 2024-04-22 17:43:17 -07:00
Barbara Miller
0485d9c83a Merge branch 'rotary2024' into qa 2024-04-19 14:02:26 -07:00
Barbara Miller
97143e2b0e error handling and logging for push_video 2024-04-19 14:00:17 -07:00
Barbara Miller
b3ef8d87c2 Merge branch 'ytdlp_last' into qa 2024-04-19 13:24:01 -07:00
Barbara Miller
5cc056cc7b use requests' CaseInsensitiveDict 2024-04-19 12:44:45 -07:00
Barbara Miller
55ce73ebcd fix merge error 2024-04-18 17:26:57 -07:00
Barbara Miller
55517fb432 Merge branch 'ytdlp_last' into qa 2024-04-18 16:24:10 -07:00
Barbara Miller
12e49bf29e add / check status code for yt-dlp 2024-04-18 16:19:13 -07:00
Barbara Miller
423f05b841 black'd 2024-04-18 15:44:35 -07:00
Barbara Miller
700c80ba90 use page headers to browse or fetch 2024-04-18 15:41:00 -07:00
Barbara Miller
f2c89d1c18 skip more exts, plus chrome-error 2024-04-17 17:23:36 -07:00
Barbara Miller
737770e3ba locally black'd, to avoid github formatting error? 2024-04-17 10:48:03 -07:00
Barbara Miller
a50f9380ad Merge branch 'better-headless' into qa 2024-04-16 18:22:15 -07:00
Vangelis Banos
7d580420ba Replace double quote with single quote
Fix black warnings
2024-04-15 19:23:44 +00:00
Vangelis Banos
1c0c385ff1 Use --headless=new or --headless=chrome if supported
Ref: https://developer.chrome.com/docs/chromium/new-headless
2024-04-15 18:48:54 +00:00
Barbara Miller
4a5283944d Merge branch 'ytdlp_last' into qa 2024-04-10 13:42:27 -07:00
Barbara Miller
5fa25a747f mv append ytdlp_outlinks 2024-04-10 13:42:10 -07:00
Barbara Miller
0b26509637 more ytdlp_url 2024-04-10 13:41:03 -07:00
Barbara Miller
81e526b204 Merge branch 'video_predup' into qa 2024-04-10 13:24:41 -07:00
Barbara Miller
5751e2e336 urlcanon.aggressive for should_ytdlp, for now 2024-04-10 13:23:42 -07:00
Barbara Miller
04301da1b1 bump qa version 2024-04-05 17:11:59 -07:00
Barbara Miller
707ee8bd8e Merge branch 'video_predup' into qa 2024-04-05 17:11:14 -07:00
Barbara Miller
02d26b0b9c pylint (partial) and other tidying 2024-04-05 17:09:22 -07:00
Barbara Miller
d9b11b32b3 Merge branch 'video_predup' into qa 2024-04-05 14:47:50 -07:00
Barbara Miller
98fed34cdd ytdlp_seed = site["metadata"]["ait_seed_id"] (?!) 2024-04-05 14:47:36 -07:00
Barbara Miller
8c4f774504 ytdlp_seed = site["metadata"]["ait_seed_id"] (?!) 2024-04-05 14:46:19 -07:00
Barbara Miller
dfd4d7da84 Merge branch 'video_predup' into qa 2024-04-05 14:01:20 -07:00
Barbara Miller
7bf47ae1a2 add site.seed_id 2024-04-05 14:01:08 -07:00
Barbara Miller
fbc726ba35 fix_typo 2024-04-05 14:00:27 -07:00
Barbara Miller
c669d67539 Merge branch 'video_predup' into qa 2024-04-05 11:28:57 -07:00
Barbara Miller
57a7d29ba7 add cassandra-driver dependency 2024-04-05 11:26:09 -07:00
Barbara Miller
b6014c03e0 pass self... 2024-04-05 11:25:49 -07:00
Barbara Miller
cd071ed907 fix merge errors 2024-04-04 16:31:14 -07:00
Barbara Miller
5b3a1f668e Merge branch 'video_predup' into QA 2024-04-04 14:26:57 -07:00
Barbara Miller
2e79e31ae9 tidying 2024-04-04 14:22:22 -07:00
Barbara Miller
ff8823d3d4 Merge branch 'ytdlp_last' into qa 2024-04-04 12:27:32 -07:00
Barbara Miller
1bc9a544ef is_html_maybe 2024-04-04 12:24:45 -07:00
Barbara Miller
72cb2a6e4a predup youtube watch pages 2024-04-03 16:42:44 -07:00