brozzler

Git-Mirrors/brozzler

Fork 0

mirror of https://github.com/internetarchive/brozzler.git synced 2025-04-20 23:56:34 -04:00

Commit Graph

Select branches

Hide Pull Requests

ARI-5259

ARI-5294

ARI-5407

ARI-5409

ARI-5460

ARI-5517

ARI-5671

ARI-5747

Thorium-support

adam/add_new_page_cli

adam/behavior_check_refactor

adam/disable-chrome-model-downloads

adam/log-behavior-status

adam/log_long_brozzle_sessions

adam/new_claim_sites_query

avdempsey/optional-doublethink-ytdlp

avdempsey/use-black

behavior-refactor

bigger-window

blocks-shrink

bmiller/proxy_select

brofurb

browserless

brozzler_ia

bump-version-to-1.5.23

chrome130fixes

copyright-2018

fix-travis

galgeek-patch-1

galgeek-patch-2

galgeek-patch-3

galgeek-websocket-url-timeout

gmiller/2950-skip-ytdlp

gretchen/readme-reqs-update

limit_recaptures

master

metrics_plus_proxy_retries

moma-behavior

noYoutubeDash

optimizes-rethinkdb-load-query

pageDown

proxyrack

pypi_1dot6dot2

qa

qa-20191008

qa-20250416

refactor-browsing

simpledo

skipDashManifest

skip_youtube_dl

stealth-too

travis

travis-debugging

wt-376-yt-user-page-fix

x11-support

ydl-second

yt-dlp

yt-dlp-format-fix

yt-dlp-log

yt-dlp-mp4-again

yt-dlp-skip-live

yt-dlp-timeout

yt-dlp-too

#1

#10

#10

#100

#101

#102

#103

#107

#108

#109

#110

#111

#113

#114

#114

#115

#116

#117

#118

#119

#12

#120

#121

#122

#127

#129

#13

#130

#131

#132

#133

#134

#135

#136

#137

#138

#14

#14

#141

#142

#143

#144

#145

#146

#147

#148

#149

#15

#150

#151

#152

#153

#154

#155

#157

#158

#16

#160

#162

#163

#164

#164

#165

#166

#167

#168

#169

#17

#170

#171

#172

#173

#174

#175

#176

#177

#178

#179

#18

#180

#181

#182

#183

#184

#186

#187

#188

#189

#19

#190

#191

#192

#193

#194

#195

#196

#197

#199

#2

#20

#200

#202

#203

#204

#205

#206

#207

#208

#209

#21

#210

#210

#211

#212

#216

#218

#218

#219

#219

#22

#22

#220

#220

#222

#223

#225

#229

#229

#23

#232

#232

#233

#237

#238

#239

#24

#240

#241

#242

#243

#244

#245

#246

#247

#248

#249

#25

#252

#252

#253

#254

#255

#255

#257

#258

#259

#26

#260

#261

#262

#263

#264

#265

#266

#268

#269

#27

#270

#271

#273

#274

#276

#277

#278

#279

#279

#280

#281

#282

#283

#284

#285

#286

#287

#288

#288

#289

#29

#29

#290

#290

#291

#293

#294

#295

#296

#297

#298

#299

#3

#30

#300

#301

#302

#303

#305

#306

#307

#308

#310

#310

#311

#312

#313

#313

#314

#315

#316

#318

#319

#319

#320

#321

#322

#323

#324

#325

#326

#327

#328

#329

#331

#332

#333

#334

#335

#336

#337

#338

#339

#34

#340

#341

#342

#343

#344

#345

#346

#347

#348

#348

#36

#38

#39

#4

#40

#41

#42

#44

#46

#47

#48

#49

#49

#5

#50

#51

#52

#53

#54

#55

#56

#56

#57

#58

#59

#6

#60

#61

#62

#63

#64

#65

#66

#67

#68

#69

#7

#70

#71

#72

#73

#74

#75

#77

#78

#81

#81

#82

#83

#84

#84

#85

#87

#88

#89

#9

#90

#92

#93

#93

#94

#95

#96

#97

#98

#98

#99

1.16.10

1.1b10

1.1b11

1.1b12

1.1b2

1.1b3

1.1b4

1.1b5

1.1b6

1.1b7

1.1b8

1.1b9

1.2

1.3

1.4

1.5.6

70ce642bee integer job ids are permitted as well as string Noah Levitt 2016-10-21 21:25:16 +00:00
872030d716 Add a mouseovers behavior based on simpleclicks Alex Osborne 2016-10-21 06:46:43 +11:00
f46ea1c1bf Merge branch 'noguchi' into qa Barbara Miller 2016-10-19 15:25:43 -07:00
278994f5b0 increase interval, rm old login Barbara Miller 2016-10-19 15:21:22 -07:00
e4b0be68d5 Merge branch 'noguchi' into qa Barbara Miller 2016-10-18 22:17:06 -07:00
48d2951a99 mimic login page onclick 100% Barbara Miller 2016-10-18 22:12:55 -07:00
57d8dc7839 alternate login code, better crawl? Barbara Miller 2016-10-18 21:34:39 -07:00
cd299f8d8d better interval Barbara Miller 2016-10-13 18:26:28 -07:00
7d00b522b6 still better targetting Barbara Miller 2016-10-13 18:08:58 -07:00
868b582df5 better targeting Barbara Miller 2016-10-13 17:49:37 -07:00
dd37a63452 correct jslint errors Barbara Miller 2016-10-13 17:29:49 -07:00
3d153cb390 correct re Barbara Miller 2016-10-13 17:09:10 -07:00
b4d1d75cee more better yaml, target check Barbara Miller 2016-10-13 16:40:43 -07:00
f16ea050e3 better seed selection Barbara Miller 2016-10-12 18:16:12 -07:00
46d4c89431 custom behavior for catalogue.noguchi.org Barbara Miller 2016-10-12 17:42:00 -07:00
25a31bf354 rm old WIP item Barbara Miller 2016-10-12 14:10:28 -07:00
49e7d81239 just test gzip,deflate after all Barbara Miller 2016-09-30 14:08:00 -07:00
49e38f608a test extra headers Barbara Miller 2016-09-30 12:34:05 -07:00
6a23ab9f7a correct local_state Barbara Miller 2016-09-30 11:20:54 -07:00
108503cd2a try saving only Brotli conifg Barbara Miller 2016-09-30 10:55:13 -07:00
f2bb1f44cd disable SDCH? Barbara Miller 2016-09-30 11:17:30 -07:00
91a1b03508 make data_dir Barbara Miller 2016-09-30 09:30:39 -07:00
7a104d317a simplify to troubleshoot Barbara Miller 2016-09-30 00:18:41 -07:00
7291f4684c better variable name Barbara Miller 2016-09-29 23:58:51 -07:00
e461627300 read/write chromium local state Barbara Miller 2016-09-29 23:13:15 -07:00
4dfda90df2 clean up Browser dirs and add flags_location Barbara Miller 2016-09-29 20:58:10 -07:00
dd4fce8763 read/write chromium local state Barbara Miller 2016-09-29 23:13:15 -07:00
5b30d644b9 clean up Browser dirs and add flags_location Barbara Miller 2016-09-29 20:58:10 -07:00
a78c6ad4b6 better still facebook login logging Barbara Miller 2016-09-16 13:39:00 -07:00
de6d11e411 better facebook login logging Barbara Miller 2016-09-15 15:13:51 -07:00
6825f688be facebook login troubleshooting Barbara Miller 2016-09-14 20:24:01 -07:00
5ecc58beae disable downloads & kccfed behavior Barbara Miller 2016-06-25 15:05:37 -07:00
0ee8f7f538 clickGetPDFs for kansascityfed Barbara Miller 2016-05-08 19:55:50 -07:00
fe4236f0c6 kcfed test Barbara Miller 2016-05-27 22:20:36 -07:00
bf53152f34 clickGetPDFs.template Barbara Miller 2016-05-21 19:27:05 -07:00
13f891d07c huffpo slideshow custom behavior Barbara Miller 2016-05-17 17:40:41 -07:00
e2345c7eef multiclicks behavior Barbara Miller 2016-05-09 22:50:40 -07:00
0a8d30a2b2 Merge branch 'noguchi' into qa Barbara Miller 2016-10-18 21:36:47 -07:00
a6d6af207d alternate login code, better crawl? Barbara Miller 2016-10-18 21:34:39 -07:00
21891476c4 avoid use of __double_underscore member variables because they're special https://shahriar.svbtle.com/underscores-in-python Noah Levitt 2016-10-18 18:57:11 -07:00
149f934aa4 after_failure section for debugging travis-ci failures travis Noah Levitt 2016-10-18 18:47:59 -07:00
becd832ea3 bump version after merging accept-encoding pull request Noah Levitt 2016-10-18 17:54:17 -07:00
a146ba52ae Merge pull request #20 from internetarchive/rethinkInDoc Noah Levitt 2016-10-18 17:54:48 -07:00
613f0e5186 Merge 7317140491a1b34f72d96fea6ec9cc9ef6871a1e into eedd2071bb59c2e2f0f502671fb7d5a3951c9aa6 Barbara Miller 2016-10-19 00:54:27 +00:00
eedd2071bb Merge pull request #21 from galgeek/encodingFixIdentity Noah Levitt 2016-10-18 17:53:50 -07:00
aae34452f5 bump version number after merging travis-ci pull request Noah Levitt 2016-10-18 17:48:45 -07:00
1490a40c28 Merge pull request #23 from internetarchive/travis Noah Levitt 2016-10-18 17:48:04 -07:00
68a32fcbe2 bump version number after mouse's pull request Noah Levitt 2016-10-18 17:45:33 -07:00
37950e6dfd Merge pull request #24 from mouse-reeve/select-proxy Noah Levitt 2016-10-18 17:41:56 -07:00
2215aaab21 Use warcprox if enable_warcprox_features is true Mouse Reeve 2016-10-18 17:39:33 -07:00
62781117b8 tests passed on travis-ci, remove travis debugging lines Noah Levitt 2016-10-18 17:31:47 -07:00
7a655da563 try to fix error from pip install with extras (pip install file:///...brozzler[webconsole]) by including #egg=brozzler as suggested at https://github.com/pypa/pip/issues/1236#issuecomment-32957253 , travis-ci error can be seen at https://travis-ci.org/internetarchive/brozzler/builds/168727451 Noah Levitt 2016-10-18 14:36:55 -07:00
0317409811 do ansible install as user travis to avoid permissions issues like this https://travis-ci.org/internetarchive/brozzler/builds/168720738 Noah Levitt 2016-10-18 12:44:18 -07:00
53624fd901 I don't know why travis/ansible/pip is failing, try using a file:// url https://travis-ci.org/internetarchive/brozzler/builds/168712667 Noah Levitt 2016-10-18 12:20:37 -07:00
166e87a00e trying to figure out this error from travis-ci Noah Levitt 2016-10-18 11:50:55 -07:00
91c36f3d21 specify --cache-dir=/tmp/pip-cache to avoid trying to write to (nonexistent) service user home directory Noah Levitt 2016-10-17 18:24:44 -07:00
0caf365516 travis-ci first try Noah Levitt 2016-10-17 17:56:09 -07:00
9b5ba071aa Merge 0ecd240f0c563f6bafc264bec390c1d14cdb49f5 into a370e7b987d3c844e28fa9f24f6a20909abd4525 Noah Levitt 2016-10-18 00:56:15 +00:00
0ecd240f0c travis-ci first try Noah Levitt 2016-10-17 17:56:09 -07:00
d30cd52c47 Merge branch 'encodingFixIdentity' (and lots new from master) into qa Barbara Miller 2016-10-17 13:02:57 -07:00
0a6d8ed3da Accept-Encoding fix II Barbara Miller 2016-10-17 12:50:31 -07:00
7317140491 Merge branch 'encodingFix' of github.com:galgeek/brozzler into encodingFix Barbara Miller 2016-10-17 12:28:36 -07:00
fdee175cfa Accept-Encoding identity Barbara Miller 2016-10-17 12:21:14 -07:00
c2c9063c7a Noah's ExtraHTTPHeaders encoding fix Barbara Miller 2016-09-30 17:18:53 -07:00
dab4058fde Merge branch 'encodingFix' of github.com:galgeek/brozzler into encodingFix Barbara Miller 2016-10-17 12:26:43 -07:00
105deb3bd4 Accept-Encoding identity Barbara Miller 2016-10-17 12:21:14 -07:00
b9668e4205 Noah's ExtraHTTPHeaders encoding fix Barbara Miller 2016-09-30 17:18:53 -07:00
5ca4843a2e rethinkdb installer works for me Barbara Miller 2016-10-16 11:01:12 -07:00
a370e7b987 tiny fix, and now the test passes for me Noah Levitt 2016-10-14 19:21:26 -07:00
4044fcb647 fix pywb/brozzler replay of revisit records Noah Levitt 2016-10-14 19:15:23 -07:00
27452990ee toward getting initial tests to pass Noah Levitt 2016-10-14 18:26:48 -07:00
5a373466a3 some vagrant/ansible fixes Noah Levitt 2016-10-14 13:47:54 -07:00
2c2ae45c3b better interval Barbara Miller 2016-10-13 18:26:28 -07:00
2df1177752 better interval Barbara Miller 2016-10-13 18:26:28 -07:00
b3baba18b5 still better targetting Barbara Miller 2016-10-13 18:08:58 -07:00
6196e32f42 still better targetting Barbara Miller 2016-10-13 18:08:58 -07:00
359e61a836 better targeting Barbara Miller 2016-10-13 17:49:37 -07:00
4e4159717b better targeting Barbara Miller 2016-10-13 17:49:37 -07:00
ab5535f70d correct jslint errors Barbara Miller 2016-10-13 17:29:49 -07:00
21383e0964 correct jslint errors Barbara Miller 2016-10-13 17:29:49 -07:00
3627209be1 move ansible directory to top level; generalize formerly vagrant-specific ansible configuration; let upstart manage logging with "console log" Noah Levitt 2016-10-13 17:21:55 -07:00
56e651baeb working on basic integration tests Noah Levitt 2016-10-13 17:12:35 -07:00
5c6cda2480 correct re Barbara Miller 2016-10-13 17:09:10 -07:00
eafd14f380 correct re Barbara Miller 2016-10-13 17:09:10 -07:00
82c2da72f1 more better yaml, target check Barbara Miller 2016-10-13 16:40:43 -07:00
f55c12ffe2 more better yaml, target check Barbara Miller 2016-10-13 16:40:43 -07:00
ed8b937277 back to dev version Noah Levitt 2016-10-13 15:11:57 -07:00
456c082875 this is 1.1b6 1.1b6 Noah Levitt 2016-10-13 15:10:24 -07:00
23b59f8f4e Merge branch 'master' of github.com:internetarchive/brozzler Noah Levitt 2016-10-13 15:00:13 -07:00
269512f499 make setup.py work with python2, not because the whole project works with python2, but just so it can be installed as a dependency of projects that support both python2 and python3 Noah Levitt 2016-10-13 14:59:31 -07:00
e3f565bb70 better seed selection Barbara Miller 2016-10-12 18:20:10 -07:00
9062bee99d better seed selection Barbara Miller 2016-10-12 18:16:12 -07:00
aa1c79c346 noguchi.org custom behavior Barbara Miller 2016-10-12 17:55:00 -07:00
393f40d5ff custom behavior for catalogue.noguchi.org Barbara Miller 2016-10-12 17:42:00 -07:00
e884bee6c9 rm old WIP item Barbara Miller 2016-10-12 14:10:28 -07:00
8d0b5d4bfa fixing mis-copy Barbara Miller 2016-09-30 14:53:25 -07:00
0253945161 just test gzip,deflate after all Barbara Miller 2016-09-30 14:08:00 -07:00
fd76c819ab test identity encoding Barbara Miller 2016-09-30 12:36:10 -07:00
d2b5122477 test extra headers Barbara Miller 2016-09-30 12:34:05 -07:00
5d0f11be09 correct local_state Barbara Miller 2016-09-30 11:20:54 -07:00