Commit Graph

  • 181e7ab85d page.interstitial exception test Barbara Miller 2018-10-17 17:23:50 -07:00
  • 20996fa501 bump version after merge Noah Levitt 2018-10-12 12:46:09 -07:00
  • 8fc800d1ef
    Merge pull request #127 from nlevitt/ydl-improvements jkafader 2018-10-12 11:55:47 -07:00
  • 65fad5e8bf remove stray bad logging line Noah Levitt 2018-10-12 11:35:47 -07:00
  • 7497b7e5ac tests expect outlinks to be a set Noah Levitt 2018-10-12 11:03:54 -07:00
  • 054ba6d7a0 tidy up some comments and docs Noah Levitt 2018-10-12 00:48:38 -07:00
  • 8f9077fbf3 watch pages as outlinks from youtube-dl playlists Noah Levitt 2018-10-12 00:41:16 -07:00
  • 9211fb45ec silence youtube-dl's logging, use only our own Noah Levitt 2018-10-12 00:39:37 -07:00
  • e5536182dc use a thread-local callback in monkey-patched Noah Levitt 2018-10-11 23:28:34 -07:00
  • 82cf5c6dbb skip downloading videos from youtube playlists Noah Levitt 2018-10-11 15:46:30 -07:00
  • e406e42312 trace-level logging for all the chrome output Noah Levitt 2018-10-11 15:43:05 -07:00
  • 16c56fed5a Merge branch 'master' into qa Noah Levitt 2018-10-11 13:43:06 -07:00
  • 1e95441ce7 hopefully fixes lingering ydl concurrency issue Noah Levitt 2018-10-11 13:40:57 -07:00
  • ff64e32bd3 Merge branch 'master' into qa Noah Levitt 2018-10-11 13:31:47 -07:00
  • e519616f8e brozzler-worker log version number at startup Noah Levitt 2018-10-11 13:31:37 -07:00
  • a75632bd95 Merge branch 'master' into qa Noah Levitt 2018-09-28 15:27:51 -07:00
  • 362a2347b9 bump version after merge Noah Levitt 2018-09-28 15:27:40 -07:00
  • d2b1843a6d
    Merge pull request #122 from nlevitt/new-job-bulk-inserts jkafader 2018-09-28 15:26:33 -07:00
  • 8de3e21103 fix another oversight Noah Levitt 2018-09-28 14:45:45 -07:00
  • 1ee36c38b9 ugh. oops Noah Levitt 2018-09-28 13:44:54 -07:00
  • 7137918005 Revert "add a github PR template for this repo" Noah Levitt 2018-09-28 13:16:46 -07:00
  • 7980b40ee3 improve performance of brozzler-new-job Noah Levitt 2018-09-28 13:13:22 -07:00
  • 87ec0f2f90 Merge branch 'master' into qa Noah Levitt 2018-09-28 11:12:35 -07:00
  • 24fcca4919 Merge branch 'pageInterstitialShown' into qa Barbara Miller 2018-09-27 16:31:28 -07:00
  • 1054d2d644 return outlinks = [] Barbara Miller 2018-09-27 16:22:12 -07:00
  • 0ed131ce72 simplest exception ok Barbara Miller 2018-09-27 16:19:08 -07:00
  • 2386e85a37 bump doublethink dependency Noah Levitt 2018-09-27 14:25:49 -07:00
  • f8ce9858fb
    Merge pull request #121 from nlevitt/purge jkafader 2018-09-25 16:45:24 -07:00
  • f4fad934a7 verbiage tweaks Noah Levitt 2018-09-25 15:19:33 -07:00
  • 560981c1ad safety check and --force for brozzler-purge Noah Levitt 2018-09-25 15:17:45 -07:00
  • 174178e02e new command brozzler-purge Noah Levitt 2018-09-25 14:56:26 -07:00
  • 60cfd684b2 Merge branch 'pageInterstitialShown' into qa Barbara Miller 2018-09-25 10:30:02 -07:00
  • d9f7997a40 except log and return [] Barbara Miller 2018-09-24 17:33:38 -07:00
  • 156ec0caa1 tidier, better exception handling? Barbara Miller 2018-09-21 17:46:19 -07:00
  • 51d011c285 expect exception PageInterstitialShown Barbara Miller 2018-09-20 17:23:49 -07:00
  • 86193a525b raise exception PageInterstitialShown Barbara Miller 2018-09-20 17:22:52 -07:00
  • 66936c67cc add exception PageIntersitialShown Barbara Miller 2018-09-20 17:21:49 -07:00
  • 0e867102a9 Browsing Exception for Page.interstitialShown Barbara Miller 2018-09-20 15:30:12 -07:00
  • 48bf185746 bump version after merge Noah Levitt 2018-09-18 11:08:44 -07:00
  • dceee8bdbd
    Merge pull request #119 from nlevitt/ydl-stitch-fix Noah Levitt 2018-09-18 11:08:21 -07:00
  • 60cd69e2bd send warcprox-meta when pushing stitched up video Noah Levitt 2018-09-18 01:07:52 -07:00
  • 1ef717fa75 test exposing bug that we don't send warcprox-meta Noah Levitt 2018-09-18 01:05:18 -07:00
  • 3c7fdeae2c Merge branch 'ari-5777' into qa Neil Minton 2018-09-12 12:07:45 -04:00
  • b5c213cef9 Extract srcset values for use in crawling. Neil Minton 2018-09-12 12:04:47 -04:00
  • efb0696833 bump version number after merge Noah Levitt 2018-09-06 16:17:59 -07:00
  • 8368cd2bcb
    Merge pull request #115 from nlevitt/ydl-stitched jkafader 2018-09-06 16:15:52 -07:00
  • c4fdbe578d Merge branch 'master' into qa Noah Levitt 2018-09-04 10:54:26 -07:00
  • a4eacb5b8f oops, back to dev version number Noah Levitt 2018-09-04 10:52:34 -07:00
  • e38b867ff5
    Merge pull request #118 from nlevitt/relax-claiming jkafader 2018-09-04 10:45:11 -07:00
  • 2d5c6681cf wait 20 seconds to claim sites if none were avail- Noah Levitt 2018-08-31 15:23:59 -07:00
  • d0f5cd7168 tweak logging Noah Levitt 2018-08-31 15:23:48 -07:00
  • 88d3d3b310
    why did those tests fail??? (#117) 1.4 Noah Levitt 2018-08-22 14:35:39 -07:00
  • 02e98f101d
    Merge pull request #116 from kblumenthal/master Noah Levitt 2018-08-22 14:34:52 -07:00
  • e2fc2a0c48 try to fix urllib dep version req conflict Noah Levitt 2018-08-22 12:54:13 -07:00
  • d45de4a28c why did those tests fail??? Noah Levitt 2018-08-22 11:18:04 -07:00
  • b6942a7bb0 1.4 for pypi Noah Levitt 2018-08-21 15:15:38 -07:00
  • ff1645ef7d
    Add screenshots Karl-Rainer Blumenthal 2018-08-22 13:02:08 -04:00
  • 7c8b597ad3
    Add screenshots Karl-Rainer Blumenthal 2018-08-22 12:55:10 -04:00
  • 2a2952e810 back to dev version Noah Levitt 2018-08-21 15:18:18 -07:00
  • b63661ea70 1.4 for pypi Noah Levitt 2018-08-21 15:15:38 -07:00
  • eaf7ef74be explain --warcprox-auto briefly Noah Levitt 2018-08-17 12:06:04 -07:00
  • 2081e6388a
    Merge pull request #2 from internetarchive/master Karl-Rainer Blumenthal 2018-08-17 14:26:46 -04:00
  • 8cdc3dee21 Merge branch 'master' into ydl-stitched Noah Levitt 2018-08-17 10:34:00 -07:00
  • d19e139101 vagrant readme fixes (thanks funkyfuture) Noah Levitt 2018-08-17 10:31:01 -07:00
  • ffa8021968 update cryptography dep version Noah Levitt 2018-08-16 14:32:03 -07:00
  • ecb2d70369 youtube-dl: skip youtube dash manifests Noah Levitt 2018-08-16 14:25:37 -07:00
  • cbeba3a6b9 Merge branch 'ydl-stitched' into qa Noah Levitt 2018-08-16 12:10:44 -07:00
  • 418a3ef20c Merge branch 'master' into qa Noah Levitt 2018-08-16 12:08:48 -07:00
  • e7d2273856 fix failing tests Noah Levitt 2018-08-16 11:40:54 -07:00
  • 3c27132aaa test for youtube-dl stitch-up Noah Levitt 2018-08-15 17:42:53 -07:00
  • c2ad8427e1 add missing imports and fix mimetype issue Noah Levitt 2018-08-15 17:41:35 -07:00
  • 33520da8f9 move youtube-dl code into separate file Noah Levitt 2018-08-14 15:10:48 -07:00
  • 4b34a913e7
    Merge 6ad0ad310c18bce6317ce1836c5a401f7109324c into 4e398e1da2f0969e9fa80af9dc0caa984b2aa1b5 Frank Sachsenheim 2018-08-14 15:40:32 +00:00
  • 6ad0ad310c
    Some fixes to vagrant/README.rst Frank Sachsenheim 2018-08-14 17:38:01 +02:00
  • 39155ebcc5 push youtube-dl's stitched up videos to warcprox Noah Levitt 2018-08-13 15:40:48 -07:00
  • 4e398e1da2 expose more brozzle-page args Noah Levitt 2018-08-13 15:38:24 -07:00
  • b44a444dc2 update pillow dependency to get rid of github vul- Noah Levitt 2018-07-24 16:37:25 -05:00
  • 771d6aa626 more readme edits Noah Levitt 2018-07-23 19:05:49 -05:00
  • 073fc713f4
    Merge pull request #113 from nlevitt/karl-readme Noah Levitt 2018-07-23 18:36:00 -05:00
  • f7407a87c1 reformat readme to 80 columns Noah Levitt 2018-07-23 23:32:56 +00:00
  • a7fb7bcc37 Merge branch 'master' into karl Noah Levitt 2018-07-23 23:28:42 +00:00
  • bd78e07232
    Copy edits to job-conf readme Karl-Rainer Blumenthal 2018-07-06 15:24:12 -04:00
  • 9d18dc6aeb bump up heartbeat interval (see comment) Noah Levitt 2018-07-03 18:35:08 -05:00
  • 98c21d9d1f Merge branch 'ARI-5689' into qa Barbara Miller 2018-07-03 14:50:51 -07:00
  • 687d51de20 Revert "skip login for fb groups" Barbara Miller 2018-07-03 14:49:58 -07:00
  • eebbc1d279
    Copy edits Karl-Rainer Blumenthal 2018-06-28 12:59:22 -04:00
  • c3a19d3186 Revert "switch to group discussion tab" Barbara Miller 2018-06-27 16:56:34 -07:00
  • 9a8fc15ff2 Merge branch 'ARI-5689' into qa Barbara Miller 2018-06-27 16:54:41 -07:00
  • 423e91a69f Revert "switch to group discussion tab" Barbara Miller 2018-06-27 16:51:55 -07:00
  • 5e1c86421e skip login for fb groups Barbara Miller 2018-06-27 16:47:32 -07:00
  • 01bb731f54 switch to group discussion tab Barbara Miller 2018-03-30 17:36:04 -07:00
  • 1fffaa9eee Merge branch 'ARI-5689' into qa Barbara Miller 2018-06-27 16:47:46 -07:00
  • 76ec00c930 skip login for fb groups Barbara Miller 2018-06-27 16:47:32 -07:00
  • 783fd0ea87 back to dev version Noah Levitt 2018-06-25 19:32:27 +00:00
  • bd63908fb9 version 1.3 (messed up 1.2) 1.3 Noah Levitt 2018-06-25 19:30:39 +00:00
  • 2780c92569 setuptools wants README not readme Noah Levitt 2018-06-25 19:06:12 +00:00
  • 032c7d2898 back to dev version number Noah Levitt 2018-06-25 12:33:34 -05:00
  • 442d02b26a version 1.2 1.2 Noah Levitt 2018-06-25 12:20:52 -05:00
  • 196cd555ea bump dev version after merge Noah Levitt 2018-06-25 11:44:45 -05:00
  • 05ec6a68b0
    Merge pull request #110 from nlevitt/robots-errors Noah Levitt 2018-06-25 11:44:18 -05:00