brozzler

Git-Mirrors/brozzler

Fork 0

mirror of https://github.com/internetarchive/brozzler.git synced 2025-02-23 08:09:48 -05:00

Commit Graph

Select branches

Hide Pull Requests

AITFIVE-832

AITFIVE-841

AITFIVE-859

ARI-5259

ARI-5294

ARI-5407

ARI-5409

ARI-5460

ARI-5517

ARI-5671

ARI-5747

Thorium-support

adam/add_new_page_cli

adam/adds_get_page_header_exception_handling

adam/behavior_check_refactor

adam/chrome-flags-disable-optimization-model-downloads

adam/connection_failure_retry

adam/disable-chrome-model-downloads

adam/get-page-header-timeout

adam/log-behavior-status

adam/log_long_brozzle_sessions

adam/patch-yt-dlp-infinite-loop-bug

adam/update_brozzler_version

adds-hop-path-support

avdempsey/use-black

behavior-refactor

bigger-window

blocks-shrink

bmiller/proxy_select

brofurb

browserless

brozzler_ia

bump-version-to-1.5.23

chrome130fixes

copyright-2018

fix-travis

galgeek-patch-1

galgeek-patch-2

galgeek-patch-3

galgeek-websocket-url-timeout

gmiller/2950-skip-ytdlp

limit_recaptures

master

metrics_plus_proxy_retries

moma-behavior

noYoutubeDash

optimizes-rethinkdb-load-query

pageDown

proxyrack

pypi_1dot6dot2

qa

qa-20191008

refactor-browsing

simpledo

skipDashManifest

skip_youtube_dl

stealth-too

travis

travis-debugging

wt-376-yt-user-page-fix

x11-support

ydl-second

yt-dlp

yt-dlp-format-fix

yt-dlp-log

yt-dlp-mp4-again

yt-dlp-skip-live

yt-dlp-timeout

yt-dlp-too

#1

#10

#10

#100

#101

#102

#103

#107

#108

#109

#110

#111

#113

#114

#114

#115

#116

#117

#118

#119

#12

#120

#121

#122

#127

#129

#13

#130

#131

#132

#133

#134

#135

#136

#137

#138

#14

#14

#141

#142

#143

#144

#145

#146

#147

#148

#149

#15

#150

#151

#152

#153

#154

#155

#157

#158

#16

#160

#162

#163

#164

#164

#165

#166

#167

#168

#169

#17

#170

#171

#172

#173

#174

#175

#176

#177

#178

#179

#18

#180

#181

#182

#183

#184

#186

#187

#188

#189

#19

#190

#191

#192

#193

#194

#195

#196

#197

#199

#2

#20

#200

#202

#203

#204

#205

#206

#207

#208

#209

#21

#210

#210

#211

#212

#216

#218

#218

#219

#219

#22

#22

#220

#220

#222

#223

#225

#229

#229

#23

#232

#232

#233

#237

#238

#239

#24

#240

#241

#242

#243

#244

#245

#246

#247

#248

#249

#25

#252

#252

#253

#254

#255

#255

#257

#258

#259

#26

#260

#261

#262

#263

#264

#265

#266

#268

#269

#27

#270

#271

#273

#274

#276

#277

#278

#279

#279

#280

#281

#282

#283

#284

#285

#286

#287

#288

#288

#289

#29

#29

#290

#290

#291

#293

#294

#295

#296

#297

#298

#299

#3

#30

#300

#301

#302

#303

#305

#306

#307

#308

#310

#310

#311

#312

#313

#313

#314

#315

#316

#318

#319

#319

#320

#320

#321

#322

#323

#324

#325

#325

#34

#36

#38

#39

#4

#40

#41

#42

#44

#46

#47

#48

#49

#49

#5

#50

#51

#52

#53

#54

#55

#56

#56

#57

#58

#59

#6

#60

#61

#62

#63

#64

#65

#66

#67

#68

#69

#7

#70

#71

#72

#73

#74

#75

#77

#78

#81

#81

#82

#83

#84

#84

#85

#87

#88

#89

#9

#90

#92

#93

#93

#94

#95

#96

#97

#98

#98

#99

1.1b10

1.1b11

1.1b12

1.1b2

1.1b3

1.1b4

1.1b5

1.1b6

1.1b7

1.1b8

1.1b9

1.2

1.3

1.4

1.5.6

2dfe841493 fix: match original indenting adam/adds_get_page_header_exception_handling Adam Miller 2024-08-12 23:53:04 +00:00
d9406485ae Merge branch 'adam/adds_get_page_header_exception_handling' into qa Adam Miller 2024-08-12 23:42:31 +00:00
f40bbd13d9 fix: handle exceptions when requesting page headers for content-type sampling. Adam Miller 2024-08-12 23:33:53 +00:00
43a37f02ce

bump version Barbara Miller 2024-08-12 13:12:28 -07:00
fa24ee3685

Merge pull request #283 from galgeek/bmiller/WT-2862-yt-dlp-format-update Barbara Miller 2024-08-12 12:42:09 -07:00
ef59f474bd stop preferring single file download from ytdlp Barbara Miller 2024-08-06 16:56:10 -07:00
d445d1883c Merge branch 'bmiller/WT-2862-ytdlp-prioritize-resolution' into qa Barbara Miller 2024-08-06 16:58:06 -07:00
477d1cc89d bump qa version Barbara Miller 2024-08-06 16:56:35 -07:00
1490ac0570 stop preferring single file download from ytdlp Barbara Miller 2024-08-06 16:56:10 -07:00
16921d11be

bump version Barbara Miller 2024-07-30 12:59:28 -07:00
c1f5aaf318

Merge pull request #282 from galgeek/2407-deps-update Barbara Miller 2024-07-30 12:37:39 -07:00
431faa059f Merge branch '2407-deps-update' into qa Barbara Miller 2024-07-29 14:29:18 -07:00
124a390c11 Revert "fix doc typos" Barbara Miller 2024-07-29 14:28:53 -07:00
a7af28b0d6 Merge branch '2407-deps-update' into qa Barbara Miller 2024-07-29 14:22:12 -07:00
20841fb49d mv yt-dlp to extras & update Barbara Miller 2024-07-29 14:20:48 -07:00
81e640cd12 black'd Barbara Miller 2024-07-29 13:47:11 -07:00
0d4adac054 Upgrade websocket-client dependency Vangelis Banos 2024-07-28 11:00:36 +00:00
1ec4d0361a skip websockt.enableTrace for now Barbara Miller 2024-07-25 16:03:39 -07:00
c674092869 Merge branch '2407-deps-update' into qa Barbara Miller 2024-07-25 14:57:25 -07:00
704db5b957 update on_close for websocket-client update Barbara Miller 2024-07-25 14:57:00 -07:00
d8e2add554 Merge branch '2407-deps-update' into qa Barbara Miller 2024-07-23 17:59:33 -07:00
f06e0348ea fix doc typos Barbara Miller 2024-07-23 17:58:04 -07:00
b41393fac5 yt_dlp 2024.7.16, websocket-client==1.8.0 Barbara Miller 2024-07-23 17:57:14 -07:00
4f36684c7c

Merge pull request #280 from galgeek/ytdlp_last_refined_really Barbara Miller 2024-07-18 15:10:11 -07:00
f1227ba74e

Merge branch 'master' into ytdlp_last_refined_really Barbara Miller 2024-07-18 14:54:39 -07:00
1b1d3960af Merge branch 'ytdlp_last_refined_really' into qa Barbara Miller 2024-07-18 10:55:11 -07:00
34bd044c25

bump version Barbara Miller 2024-07-18 10:27:33 -07:00
008b71ed6a

Merge pull request #274 from vbanos/headless-new Barbara Miller 2024-07-18 10:26:30 -07:00
5a264f29d1 black'd Barbara Miller 2024-07-18 10:19:44 -07:00
3f0227cd44 omit timestamp4datetime for now Barbara Miller 2024-07-18 10:13:38 -07:00
a6d193171d bump dev version Barbara Miller 2024-07-17 17:13:30 -07:00
a0e1b1fe7e refine ytdlp_last update, skipping adding attributes to page object Barbara Miller 2024-07-17 17:12:52 -07:00
5bc446b189 Update Xvnc command line for tigervnc Aaron Brady 2024-06-17 11:52:15 -04:00
3515fbd974 Fixes for modern Python3 packaging and Ansible 2.14 Aaron Brady 2024-06-17 11:29:37 -04:00
8e84033568 Move from Ubuntu Xenial to Debian 12 Aaron Brady 2024-06-17 11:28:37 -04:00
8d7507f377

bump version Barbara Miller 2024-06-03 15:41:05 -07:00
42c5e6f559

Merge pull request #277 from galgeek/rotary_skip_ytdlp Barbara Miller 2024-06-03 15:19:31 -07:00
cd9e5caf05 Merge branch 'rotary_skip_ytdlp' into qa Barbara Miller 2024-06-03 13:44:23 -07:00
25f50c513e skip unserializable enum YTDLPStatus Barbara Miller 2024-06-03 13:43:15 -07:00
e4fa4ad6e5 black'd manually, again Barbara Miller 2024-05-30 17:53:19 -07:00
0029f44656 Merge branch 'rotary_skip_ytdlp' into qa Barbara Miller 2024-05-30 16:06:25 -07:00
90de4204b2 YTDLPStatus.SKIP not 'SKIP' Barbara Miller 2024-05-30 16:05:56 -07:00
a02763f18e Merge branch 'rotary_skip_ytdlp' into qa Barbara Miller 2024-05-30 15:19:05 -07:00
be330ba0c5 YTDLPStatus enum Barbara Miller 2024-05-30 14:52:53 -07:00
74808a2d10 Merge branch 'rotary_skip_ytdlp' into qa Barbara Miller 2024-05-30 14:57:39 -07:00
e562bc0ebe YTDLPStatus enum Barbara Miller 2024-05-30 14:52:53 -07:00
b13ae77333 bump qa version Barbara Miller 2024-05-30 11:19:22 -07:00
15c6dc1bec Merge branch 'rotary_skip_ytdlp' into qa Barbara Miller 2024-05-30 11:18:38 -07:00
9e64d2b7e8 fix typo Barbara Miller 2024-05-30 11:18:20 -07:00
75e3fe47df bump qa version Barbara Miller 2024-05-30 11:11:28 -07:00
16b9cad640 Merge branch 'rotary_skip_ytdlp' into qa Barbara Miller 2024-05-30 11:10:45 -07:00
081ef320b9 add self._skip_av_seeds mostly Barbara Miller 2024-05-30 11:09:58 -07:00
cf654bf07e Merge branch 'rotary_skip_ytdlp' into qa Barbara Miller 2024-05-30 10:15:37 -07:00
2e4a19e838 fixes for set, passed parameter Barbara Miller 2024-05-30 10:13:05 -07:00
0f3d2b7172 fix merge error Barbara Miller 2024-05-29 21:38:24 -07:00
f9ad480fae Merge branch 'rotary_skip_ytdlp' into qa Barbara Miller 2024-05-29 17:30:07 -07:00
6fc409f554 update for default = False Barbara Miller 2024-05-29 17:12:04 -07:00
a1a04aa0c5 cli.py updates from code review Barbara Miller 2024-05-29 17:05:04 -07:00
4eb79ca936 add skip_ytdlp to class Site Barbara Miller 2024-05-29 16:47:43 -07:00
a73059d25f black'd Barbara Miller 2024-05-29 16:23:18 -07:00
2e560d3c18 skip_av_seeds Barbara Miller 2024-05-29 15:40:06 -07:00
c66fec4c6d Merge remote-tracking branch 'upstream/master' into rotary_skip_ytdlp Barbara Miller 2024-05-13 18:34:50 -07:00
d51d09c640

bump version Barbara Miller 2024-04-29 14:46:43 -07:00
78120589fb

Merge pull request #278 from galgeek/nsw-pub Barbara Miller 2024-04-29 14:44:38 -07:00
f22b000d0b opengov.nsw.gov behavior Barbara Miller 2024-04-29 14:18:49 -07:00
616916c096 Merge branch 'rotary_skip_ytdlp' into qa Barbara Miller 2024-04-25 14:19:31 -07:00
33681b59cb Merge branch 'nsw-pub' into qa Barbara Miller 2024-04-25 14:19:11 -07:00
5432844994 nsw.gov pubs behavior Barbara Miller 2024-04-25 14:18:00 -07:00
ff02480a13 skip ytdlp for Rotary seeds Barbara Miller 2024-04-24 17:25:49 -07:00
a7c2d469ca

bump version Barbara Miller 2024-04-24 10:42:59 -07:00
68c132a2d3

Merge pull request #276 from galgeek/ytdlp_last Barbara Miller 2024-04-24 10:41:37 -07:00
b09b3b5438 Merge branch 'ytdlp_last' into qa Barbara Miller 2024-04-23 16:18:30 -07:00
2d183c7d0c if not self._needs_browsing; _get_page_headers comment Barbara Miller 2024-04-23 16:01:35 -07:00
7764c3f6d7 add comment Barbara Miller 2024-04-23 16:00:18 -07:00
064b1a87ee bump qa version Barbara Miller 2024-04-23 12:49:31 -07:00
e7a90e83fc Merge branch 'ytdlp_last' into qa Barbara Miller 2024-04-23 12:46:04 -07:00
487a7009f0 rm remaining spy/fetch Barbara Miller 2024-04-23 12:41:38 -07:00
d25dd9f36f Merge branch 'rotary2024' into qa Barbara Miller 2024-04-22 17:49:32 -07:00
e45520826f increase timeout Barbara Miller 2024-04-22 17:48:56 -07:00
8f6bdd31d3 Merge branch 'ytdlp_last' into qa Barbara Miller 2024-04-22 17:45:09 -07:00
f9b77fc2bc rm remaining spy/fetch stuff Barbara Miller 2024-04-22 17:43:17 -07:00
0485d9c83a Merge branch 'rotary2024' into qa Barbara Miller 2024-04-19 14:02:26 -07:00
97143e2b0e error handling and logging for push_video Barbara Miller 2024-04-19 14:00:17 -07:00
b3ef8d87c2 Merge branch 'ytdlp_last' into qa Barbara Miller 2024-04-19 13:24:01 -07:00
5cc056cc7b use requests' CaseInsensitiveDict Barbara Miller 2024-04-19 12:44:45 -07:00
55ce73ebcd fix merge error Barbara Miller 2024-04-18 17:26:57 -07:00
55517fb432 Merge branch 'ytdlp_last' into qa Barbara Miller 2024-04-18 16:24:10 -07:00
12e49bf29e add / check status code for yt-dlp Barbara Miller 2024-04-18 16:19:13 -07:00
423f05b841 black'd Barbara Miller 2024-04-18 15:44:35 -07:00
700c80ba90 use page headers to browse or fetch Barbara Miller 2024-04-18 15:41:00 -07:00
f2c89d1c18 skip more exts, plus chrome-error Barbara Miller 2024-04-17 17:23:36 -07:00
737770e3ba locally black'd, to avoid github formatting error? Barbara Miller 2024-04-17 10:48:03 -07:00
a50f9380ad Merge branch 'better-headless' into qa Barbara Miller 2024-04-16 18:22:15 -07:00
7d580420ba Replace double quote with single quote Vangelis Banos 2024-04-15 19:23:44 +00:00
1c0c385ff1 Use --headless=new or --headless=chrome if supported Vangelis Banos 2024-04-15 18:48:54 +00:00
4a5283944d Merge branch 'ytdlp_last' into qa Barbara Miller 2024-04-10 13:42:27 -07:00
5fa25a747f mv append ytdlp_outlinks Barbara Miller 2024-04-10 13:42:10 -07:00
0b26509637 more ytdlp_url Barbara Miller 2024-04-10 13:41:03 -07:00
81e526b204 Merge branch 'video_predup' into qa Barbara Miller 2024-04-10 13:24:41 -07:00
5751e2e336 urlcanon.aggressive for should_ytdlp, for now Barbara Miller 2024-04-10 13:23:42 -07:00