brozzler

Git-Mirrors/brozzler

Fork 0

mirror of https://github.com/internetarchive/brozzler.git synced 2025-04-20 23:56:34 -04:00

Commit Graph

Select branches

Hide Pull Requests

ARI-5259

ARI-5294

ARI-5407

ARI-5409

ARI-5460

ARI-5517

ARI-5671

ARI-5747

Thorium-support

adam/add_new_page_cli

adam/behavior_check_refactor

adam/disable-chrome-model-downloads

adam/log-behavior-status

adam/log_long_brozzle_sessions

adam/new_claim_sites_query

avdempsey/optional-doublethink-ytdlp

avdempsey/use-black

behavior-refactor

bigger-window

blocks-shrink

bmiller/proxy_select

brofurb

browserless

brozzler_ia

bump-version-to-1.5.23

chrome130fixes

copyright-2018

fix-travis

galgeek-patch-1

galgeek-patch-2

galgeek-patch-3

galgeek-websocket-url-timeout

gmiller/2950-skip-ytdlp

gretchen/readme-reqs-update

limit_recaptures

master

metrics_plus_proxy_retries

moma-behavior

noYoutubeDash

optimizes-rethinkdb-load-query

pageDown

proxyrack

pypi_1dot6dot2

qa

qa-20191008

qa-20250416

refactor-browsing

simpledo

skipDashManifest

skip_youtube_dl

stealth-too

travis

travis-debugging

wt-376-yt-user-page-fix

x11-support

ydl-second

yt-dlp

yt-dlp-format-fix

yt-dlp-log

yt-dlp-mp4-again

yt-dlp-skip-live

yt-dlp-timeout

yt-dlp-too

#1

#10

#10

#100

#101

#102

#103

#107

#108

#109

#110

#111

#113

#114

#114

#115

#116

#117

#118

#119

#12

#120

#121

#122

#127

#129

#13

#130

#131

#132

#133

#134

#135

#136

#137

#138

#14

#14

#141

#142

#143

#144

#145

#146

#147

#148

#149

#15

#150

#151

#152

#153

#154

#155

#157

#158

#16

#160

#162

#163

#164

#164

#165

#166

#167

#168

#169

#17

#170

#171

#172

#173

#174

#175

#176

#177

#178

#179

#18

#180

#181

#182

#183

#184

#186

#187

#188

#189

#19

#190

#191

#192

#193

#194

#195

#196

#197

#199

#2

#20

#200

#202

#203

#204

#205

#206

#207

#208

#209

#21

#210

#210

#211

#212

#216

#218

#218

#219

#219

#22

#22

#220

#220

#222

#223

#225

#229

#229

#23

#232

#232

#233

#237

#238

#239

#24

#240

#241

#242

#243

#244

#245

#246

#247

#248

#249

#25

#252

#252

#253

#254

#255

#255

#257

#258

#259

#26

#260

#261

#262

#263

#264

#265

#266

#268

#269

#27

#270

#271

#273

#274

#276

#277

#278

#279

#279

#280

#281

#282

#283

#284

#285

#286

#287

#288

#288

#289

#29

#29

#290

#290

#291

#293

#294

#295

#296

#297

#298

#299

#3

#30

#300

#301

#302

#303

#305

#306

#307

#308

#310

#310

#311

#312

#313

#313

#314

#315

#316

#318

#319

#319

#320

#321

#322

#323

#324

#325

#326

#327

#328

#329

#331

#332

#333

#334

#335

#336

#337

#338

#339

#34

#340

#341

#342

#343

#344

#345

#346

#347

#348

#348

#36

#38

#39

#4

#40

#41

#42

#44

#46

#47

#48

#49

#49

#5

#50

#51

#52

#53

#54

#55

#56

#56

#57

#58

#59

#6

#60

#61

#62

#63

#64

#65

#66

#67

#68

#69

#7

#70

#71

#72

#73

#74

#75

#77

#78

#81

#81

#82

#83

#84

#84

#85

#87

#88

#89

#9

#90

#92

#93

#93

#94

#95

#96

#97

#98

#98

#99

1.16.10

1.1b10

1.1b11

1.1b12

1.1b2

1.1b3

1.1b4

1.1b5

1.1b6

1.1b7

1.1b8

1.1b9

1.2

1.3

1.4

1.5.6

d4db8ba9bc is test_time_limit is failing because of timing? Noah Levitt 2018-06-25 10:35:24 -05:00
09dbb4ce1d Merge branch 'robots-errors' into qa Noah Levitt 2018-06-22 16:10:51 -05:00
c52c16c260 fix bug in test, add another one Noah Levitt 2018-06-22 16:10:23 -05:00
aff67c3b29 Merge branch 'robots-errors' into qa Noah Levitt 2018-06-22 16:01:21 -05:00
aeb7c3f825 treat any error fetching robots.txt as "allow all" Noah Levitt 2018-06-22 14:50:57 -05:00
f5f9a1a137

Merge pull request #109 from internetarchive/ARI-5747 Neil Minton 2018-06-22 09:24:14 -07:00
ad5f409078 Merge branch 'ARI-5744' into qa Barbara Miller 2018-06-19 14:17:08 -07:00
1f93f70bfe Revert "test behavior for event.crowdcompass.com" Barbara Miller 2018-06-19 14:07:02 -07:00
96014606ec Merge branch 'ARI-5747' into qa Barbara Miller 2018-06-18 10:37:09 -07:00
89e54fd2e6 update instagram behavior ARI-5747 Barbara Miller 2018-06-13 12:43:12 -07:00
0857fffeb6 Merge branch 'ARI-5747' into qa Barbara Miller 2018-06-13 12:43:35 -07:00
5893b1f982 update instagram behavior Barbara Miller 2018-06-13 12:43:12 -07:00
6b753623b7 Merge branch 'ARI-5744' into qa Barbara Miller 2018-06-11 18:34:50 -07:00
565a472fb0 test behavior for event.crowdcompass.com Barbara Miller 2018-06-11 18:30:40 -07:00
27bdfb65d2 monkey-patch youtube-dl to short-circuit Noah Levitt 2018-06-11 11:50:22 -07:00
109d05c59a Merge branch 'master' into qa Noah Levitt 2018-06-11 11:11:09 -07:00
a90a29968c monkey-patch youtube-dl to short-circuit Noah Levitt 2018-06-11 11:08:20 -07:00
5c34bd3119 Merge branch 'master' into qa Noah Levitt 2018-06-01 16:46:32 -07:00
b41ccd7e6b

Merge pull request #108 from nlevitt/docs Noah Levitt 2018-05-31 14:15:12 -07:00
62bb540a11 lowercase readme.rst Noah Levitt 2018-05-31 18:46:37 +00:00
a00b5a7fd5 explain brozzler use of warcprox_meta Noah Levitt 2018-05-30 18:06:39 -07:00
aef4c40993

Merge pull request #107 from internetarchive/copyright-2018 Noah Levitt 2018-05-17 11:30:46 -07:00
135a13b1c9

update README copyright date copyright-2018 Barbara Miller 2018-05-17 11:21:47 -07:00
8906037d82 bump dev version after PR #102 Noah Levitt 2018-05-16 17:33:52 -07:00
e90e7345a5

Merge pull request #102 from nlevitt/docs Noah Levitt 2018-05-16 17:31:27 -07:00
331d07fe88 these ssurts are strings too Noah Levitt 2018-05-16 17:11:08 -07:00
67558528cb fix bad copy/paste Noah Levitt 2018-05-16 16:43:38 -07:00
5bb392ec7c ssurts are strings now Noah Levitt 2018-05-16 16:43:10 -07:00
399c097c7c travis-ci install warcprox from github Noah Levitt 2018-05-16 15:48:29 -07:00
ac735639ff incorporate urlcanon fix Noah Levitt 2018-05-16 14:41:49 -07:00
338d2e48f9 update warcprox dependency to include recent fixes Noah Levitt 2018-05-16 14:26:32 -07:00
b9b8dcd062 backward compatibility for old scope["surt"] Noah Levitt 2018-05-16 14:19:23 -07:00
1572fd3ed6 missed a spot where is_permitted_by_robots needs monkeying Noah Levitt 2018-05-15 16:52:48 -07:00
a8de9b70d1 handle new chrome cookie db schema Noah Levitt 2018-05-15 11:41:02 -07:00
de1f240e25 describe scope rule conditions Noah Levitt 2018-05-15 11:01:09 -07:00
a327cb626f more explication of scoping Noah Levitt 2018-05-14 17:31:45 -07:00
2cf474aa1d update docs to match new seed ssurt behavior Noah Levitt 2018-05-14 16:59:55 -07:00
fc05cac338 ok seriously tests Noah Levitt 2018-03-23 11:43:14 -07:00
05f8ab3495 fix more tests for new approach sans scope['surt'] Noah Levitt 2018-03-23 10:43:08 -07:00
85a4757527 s/max_hops_off_surt/max_hops_off/ Noah Levitt 2018-03-22 17:18:36 -07:00
5ebd2fb709 new test of max_hops_off Noah Levitt 2018-03-22 17:09:32 -07:00
b83d3cb9df rename page.hops_off_surt to page.hops_off Noah Levitt 2018-03-22 17:07:52 -07:00
60f2b99cc0 doublethink had a bug fix Noah Levitt 2018-03-22 17:06:46 -07:00
526a4d718f tests for new approach without scope['surt'] Noah Levitt 2018-03-22 13:39:29 -07:00
245e27a21a tests for new approach without of scope['surt'] Noah Levitt 2018-03-22 13:33:34 -07:00
f26712ce93 WIP add an accept rule instead of modifying surt Noah Levitt 2018-03-20 17:32:01 -07:00
98ce67ef36 WIP some words on scoping Noah Levitt 2018-03-20 17:31:42 -07:00
88214236bb WIP starting to flesh out "scoping" section Noah Levitt 2018-03-19 17:23:49 -07:00
6df2c1cf22 WIP some explanation of automatic login Noah Levitt 2018-03-19 16:54:17 -07:00
914289b414 WIP documentation! Noah Levitt 2018-03-19 14:14:37 -07:00
841d7e967d Merge branch 'ARI-5379' into qa Barbara Miller 2018-04-23 17:46:43 -07:00
5d2591ca66 configurable behavior timeout Barbara Miller 2018-01-26 17:23:51 -08:00
8609271e8c Merge branch 'ARI-5643' into qa Barbara Miller 2018-03-30 18:05:03 -07:00
08e1cbbe68 add twitter video button Barbara Miller 2018-03-30 18:04:44 -07:00
9fe58aa425 switch to group discussion tab Barbara Miller 2018-03-30 17:36:04 -07:00
a1af18230c

Merge pull request #103 from internetarchive/ARI-5671 Noah Levitt 2018-03-23 14:18:04 -07:00
426ca48554 less is more ARI-5671 Barbara Miller 2018-03-23 14:17:22 -07:00
9e0747f10d Merge branch 'ARI-5391' into qa Barbara Miller 2018-03-23 12:20:43 -07:00
75fc19ef5f rm wixisite nav behavior; capture embeds Barbara Miller 2018-03-23 12:20:12 -07:00
2a770ffbc4

Merge def07c1c006c22d7a94f80090875e9adeb91e918 into 6aa8af9d80346f93fcdf57a8acc7b8024e7c0611 Vangelis Banos 2018-03-22 11:15:27 +00:00
0100582def Merge branch 'ARI-5671' into qa Barbara Miller 2018-03-20 10:39:38 -07:00
51977908ec uncomment; now tested Barbara Miller 2018-03-20 10:39:14 -07:00
2fb1fcc624 Merge branch 'ARI-5671' into qa Barbara Miller 2018-03-20 10:23:36 -07:00
9e871a9f81 instagram umbraBehavior & vanishing elem fix Barbara Miller 2018-03-20 10:22:55 -07:00
b5823e5746 Merge branch 'ARI-5379' into qa Barbara Miller 2018-03-19 21:46:37 -07:00
b258b5fdde Revert "log chrome_msg URLs" Barbara Miller 2018-03-19 21:40:34 -07:00
e79f8154d6 Merge branch 'ARI-5617' into qa Barbara Miller 2018-03-19 16:58:51 -07:00
6aa8af9d80

Merge pull request #101 from galgeek/ARI-5617 Noah Levitt 2018-03-19 16:36:52 -07:00
1e2e7213c8 better booleans for umbraBehavior Barbara Miller 2018-03-19 16:31:23 -07:00
bc5a36e8a3 better booleans Barbara Miller 2018-03-19 16:28:47 -07:00
745e6cc942 log behavior params better Barbara Miller 2018-03-19 16:28:14 -07:00
ca7af5a8a7 Merge branch 'ARI-5617' into qa Barbara Miller 2018-03-19 16:07:48 -07:00
ae6f72769a better config names Barbara Miller 2018-03-19 16:02:07 -07:00
74fc7cd102 update behaviors.yaml Barbara Miller 2018-03-14 13:05:49 -07:00
cc207763d5 add onceOnly config; other tweaks Barbara Miller 2018-03-14 13:05:10 -07:00
8f861389ba amerciaspresidents.si.edu/gallery behavior Barbara Miller 2018-03-13 18:47:32 -07:00
5dfb081bb4 skipIDcheck, default false / no / 0 Barbara Miller 2018-03-13 17:52:06 -07:00
8f12f0b0c0 better idCheck and configurable interval timing Barbara Miller 2018-03-13 17:36:38 -07:00
c31f13e47f add idCheck feature, default: true Barbara Miller 2018-03-13 16:29:42 -07:00
6d89a3ee53 Merge branch 'ARI-5379' into qa Barbara Miller 2018-03-16 15:06:45 -07:00
34af396f6b rebase fix Barbara Miller 2018-03-16 15:05:45 -07:00
510bfa36f7 log chrome_msg URLs Barbara Miller 2018-03-16 15:00:34 -07:00
81983d1695 use custom timeout always Barbara Miller 2018-01-31 13:27:25 -08:00
d7b695613e check for None Barbara Miller 2018-01-31 13:21:59 -08:00
3d615aed16 behavior_timeout_custom (not timeout_from_behavior) Barbara Miller 2018-01-29 15:26:23 -08:00
2cc0eac5a6 configurable behavior timeout Barbara Miller 2018-01-26 17:23:51 -08:00
9995754b60 Merge branch 'master' into qa Noah Levitt 2018-03-15 15:07:08 -07:00
8e273b2e6b

Merge pull request #100 from nlevitt/max-claimed-sites Noah Levitt 2018-03-15 15:05:46 -07:00
dc00f5de32 reimplement max_claimed_sites Noah Levitt 2018-03-15 12:57:49 -07:00
7713f0eb69 Merge branch 'ARI-5617' into qa Barbara Miller 2018-03-14 13:13:26 -07:00
3cd06910da update behaviors.yaml Barbara Miller 2018-03-14 13:05:49 -07:00
0f2f16e09f add onceOnly config; other tweaks Barbara Miller 2018-03-14 13:05:10 -07:00
f7a655985b Merge branch 'ARI-5617' into qa Barbara Miller 2018-03-13 18:49:00 -07:00
da057e93e0 amerciaspresidents.si.edu/gallery behavior Barbara Miller 2018-03-13 18:47:32 -07:00
e778789370 skipIDcheck Barbara Miller 2018-03-13 18:46:16 -07:00
409017c47f noIDcheck instead Barbara Miller 2018-03-13 17:52:06 -07:00
cd3fa154d9 better idCheck and configurable interval timing Barbara Miller 2018-03-13 17:36:38 -07:00
d371db8166 Merge branch 'ARI-5617' into qa Barbara Miller 2018-03-13 16:34:21 -07:00
9353d2ed60 fix merge error Barbara Miller 2018-03-13 16:33:01 -07:00
037e4193ab add idCheck feature, default: true Barbara Miller 2018-03-13 16:29:42 -07:00