Git-Mirrors/brozzler
1
0
Fork 0
mirror of https://github.com/internetarchive/brozzler.git synced 2025-04-22 08:29:07 -04:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
1,724 Commits 63 Branches 16 Tags
Commit Graph

1724 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Barbara Miller
cf82d266bd disable SDCH? 2016-10-12 17:46:42 -07:00
Barbara Miller
84947c1148 make data_dir 2016-10-12 17:46:42 -07:00
Barbara Miller
abc7c0bfca simplify to troubleshoot 2016-10-12 17:46:42 -07:00
Barbara Miller
8b63555f73 better variable name 2016-10-12 17:46:42 -07:00
Barbara Miller
022a4a60ca read/write chromium local state 2016-10-12 17:46:42 -07:00
Barbara Miller
b5f2077491 clean up Browser dirs and add flags_location 2016-10-12 17:46:42 -07:00
Barbara Miller
0b9518bc5c read/write chromium local state 2016-10-12 17:45:32 -07:00
Barbara Miller
016367bc46 clean up Browser dirs and add flags_location 2016-10-12 17:45:31 -07:00
Barbara Miller
a8430baf1b better still facebook login logging 2016-10-12 17:45:31 -07:00
Barbara Miller
76d8516898 better facebook login logging 2016-10-12 17:44:46 -07:00
Barbara Miller
c9a0e1ed24 facebook login troubleshooting 2016-10-12 17:43:47 -07:00
Barbara Miller
d398d2d006 disable downloads & kccfed behavior 2016-10-12 17:42:54 -07:00
Barbara Miller
73454d2ac7 clickGetPDFs for kansascityfed 2016-10-12 17:42:54 -07:00
Barbara Miller
d7bd19a7f6 kcfed test 2016-10-12 17:42:54 -07:00
Barbara Miller
3c5c6a714a clickGetPDFs.template 2016-10-12 17:42:54 -07:00
Barbara Miller
3d0c6b7e72 huffpo slideshow custom behavior 2016-10-12 17:42:54 -07:00
Barbara Miller
a147ed1940 multiclicks behavior 2016-10-12 17:42:54 -07:00
Barbara Miller
0d5274ac64 rm old WIP item 2016-10-12 14:10:28 -07:00
Noah Levitt
d82b40be68 fix typo 2016-10-06 18:20:41 -07:00
Noah Levitt
c736f2e703 Merge pull request #19 from ato/schema-file-fix 
Ensure job_schema.yaml is installed by pip
 2016-10-05 09:02:18 -07:00
Alex Osborne
0fe2ef9387 Ensure job_schema.yaml is installed by pip 
Use .yaml file extension for consistency with behaviors.yaml.
 2016-10-05 15:45:11 +11:00
Noah Levitt
59a15d7f5c bump dev version after merging pull requests 2016-10-04 14:43:43 -07:00
Noah Levitt
f5e138c7eb Merge pull request #18 from ato/user-agent 
Add user_agent option
 2016-10-04 14:39:50 -07:00
Noah Levitt
692c1c48e1 Merge pull request #17 from ato/validate-conf 
Validate job conf against a simple schema
 2016-10-04 14:13:47 -07:00
Alex Osborne
eafc65938b Enforce at least one seed 2016-10-05 04:31:22 +11:00
Alex Osborne
743b5a4347 Add user_agent option 
Currently doesn't apply to requests made by youtube-dl as I
couldn't see a thread-safe way of doing that.
 2016-10-05 04:25:09 +11:00
Alex Osborne
5ac67fe513 Validate job conf against a Cerberus schema 2016-10-04 21:19:25 +11:00
Noah Levitt
15633be612 finish vagrant-brozzler-new-job.py 2016-10-03 18:17:35 -07:00
Noah Levitt
5bdf916a78 Merge pull request #16 from galgeek/logCaptchaHref 
log captcha, href
 2016-10-03 18:12:07 -07:00
Barbara Miller
c857647198 log location.href always 2016-10-03 17:37:45 -07:00
Barbara Miller
2f6ac120e3 log facebook captcha 2016-10-03 17:37:01 -07:00
Noah Levitt
de5c520ad7 pin psutil version, too 2016-10-03 17:12:00 -07:00
Noah Levitt
f220707aa4 pin pillow to version 3.3.0, primarily because we have a wheel in devpi for that version 2016-10-03 17:06:58 -07:00
Noah Levitt
df676223aa Merge branch 'master' of github.com:internetarchive/brozzler 
* 'master' of github.com:internetarchive/brozzler:
  Document how to use Flash with Headless Chromium
 2016-10-03 15:03:22 -07:00
Noah Levitt
0e096dd4e4 don't try to read the browser's cookie database if the browser hasn't been started (which can happen if the page is simply fetched rather than browsed because it's not html) 2016-10-03 15:03:08 -07:00
Noah Levitt
6de75717a4 Merge pull request #15 from ato/headless-flash 
Document how to use Flash with Headless Chromium
 2016-10-02 13:12:29 -07:00
Alex Osborne
a31ee2bcef Document how to use Flash with Headless Chromium 2016-10-02 23:40:41 +11:00
Noah Levitt
87a4d93a1c Merge pull request #13 from ato/headless 
Add notes on Headless Chromium to README
 2016-09-30 16:09:59 -07:00
Barbara Miller
4af9225256 Merge branch 'extraHeaders' into qa 2016-09-30 14:54:18 -07:00
Barbara Miller
ec85687a70 fixing mis-copy 2016-09-30 14:54:03 -07:00
Barbara Miller
46c48ef070 fixing mis-copy 2016-09-30 14:53:25 -07:00
Barbara Miller
0b84abc4ec just test gzip,deflate after all 2016-09-30 14:08:00 -07:00
Barbara Miller
8accfcb8d9 test identity encoding 2016-09-30 12:36:10 -07:00
Barbara Miller
707f0a133f test extra headers 2016-09-30 12:34:05 -07:00
Barbara Miller
043aebd9f0 correct local_state 2016-09-30 11:20:54 -07:00
Barbara Miller
1e2884db17 try saving only Brotli conifg 2016-09-30 11:18:28 -07:00
Barbara Miller
6cda2814ea disable SDCH? 2016-09-30 11:17:30 -07:00
Barbara Miller
f0035f610e Merge branch 'disableBrotli' into qa 2016-09-30 09:35:23 -07:00
Barbara Miller
a7937193b3 make data_dir 2016-09-30 09:30:39 -07:00
Noah Levitt
80883c9784 Merge branch 'master' into qa 
* master:
  document a bunch of job settings
  starting on documenting job configuration
  replace vagrant-brozzler-new-site with python script that fills in default options and passes through others
  add missing rethinkdb config file to ansible config
  new script runs brozzler-new-site queues a new site to brozzle on the vagrant brozzler deployment
  better logs for facebook logins
  working on including pywb in vagrant environment (not finished)
  starting to create a framework for testing
  header comment tweak
  new prog "brozzler-wayback" runs monkey-patched pywb
 2016-09-30 08:51:17 -07:00