Commit Graph

  • b07f939c37
    bump version Barbara Miller 2024-10-30 15:22:45 -07:00
  • 4890952c42
    Merge pull request #296 from galgeek/publish_builds Barbara Miller 2024-10-30 15:15:51 -07:00
  • 741a30feee draft workflow to publish build artifacts Barbara Miller 2024-10-30 12:02:17 -07:00
  • d488cdbb3b fixes for chrome v.130 Barbara Miller 2024-10-18 16:40:24 -07:00
  • 3a8b9d2d05
    bump version Barbara Miller 2024-10-17 09:49:46 -07:00
  • 636e719bc8
    Merge pull request #295 from galgeek/doublethink_extra Barbara Miller 2024-10-17 09:48:54 -07:00
  • 7c5b5da722
    Merge pull request #294 from vbanos/chrome130 Barbara Miller 2024-10-17 09:47:36 -07:00
  • 18c7cf5a3f Merge branch 'enable_chrome_update' into qa Barbara Miller 2024-10-17 09:46:21 -07:00
  • 5ac681cb37 black'd Barbara Miller 2024-10-17 09:24:21 -07:00
  • 631a7f40c2 move doublethink to extras_require Barbara Miller 2024-10-17 09:22:30 -07:00
  • f39cc632ed Add support for Chrome > 110 vbanos 2024-10-17 17:44:17 +02:00
  • 3c0a11c7d4 bump qa version Barbara Miller 2024-10-08 17:19:03 -07:00
  • c3c54dab7a Merge branch 'prom_headers_update' into qa Barbara Miller 2024-10-08 17:18:23 -07:00
  • 90dbdbd19d tidier get_page_headers Barbara Miller 2024-10-08 16:35:34 -07:00
  • 8007d61a0f
    bump version Barbara Miller 2024-10-07 16:21:04 -07:00
  • ed906b4aa2
    Merge pull request #293 from galgeek/prom-ii Barbara Miller 2024-10-07 16:20:22 -07:00
  • 93d256a7b5 black'd Barbara Miller 2024-10-07 16:17:49 -07:00
  • cd3ddb3f23 Merge branch 'prom-ii' into qa Barbara Miller 2024-10-07 15:50:54 -07:00
  • de7a325377 histograms track_inprogress ... Barbara Miller 2024-10-07 15:50:32 -07:00
  • 90845b317d Merge branch 'prom-ii' into qa Barbara Miller 2024-10-07 15:28:14 -07:00
  • d7c6c57908 fix plural typo Barbara Miller 2024-10-07 15:26:18 -07:00
  • 380be7dabd bump qa version Barbara Miller 2024-10-07 15:12:29 -07:00
  • de5ce6049e Merge branch 'prom-ii' into qa Barbara Miller 2024-10-07 15:11:09 -07:00
  • f72fa2b102 updated prometheus metrics Barbara Miller 2024-10-07 15:01:53 -07:00
  • 151777298a
    bump version Barbara Miller 2024-10-03 15:50:20 -07:00
  • f47a7cca28
    Merge pull request #291 from galgeek/websocket-client-utf8fix Barbara Miller 2024-10-03 15:46:32 -07:00
  • 28b8149963 add comment re fix Barbara Miller 2024-10-02 17:38:30 -07:00
  • c40eb17935 black'd Barbara Miller 2024-10-02 17:34:30 -07:00
  • 8290548e08 Merge branch 'websocket-client-utf8fix' into qa Barbara Miller 2024-10-02 16:58:32 -07:00
  • 9185024050 add skip_utf8_validation Barbara Miller 2024-10-02 16:55:25 -07:00
  • 30c5eb89b1 Merge branch 'gmiller/2950-skip-ytdlp' into qa Gretchen Miller 2024-10-02 11:40:47 -07:00
  • 9c77961423 WT-2950 update job schema pt. 2 Gretchen Miller 2024-10-02 11:40:08 -07:00
  • e6d523870d Merge branch 'gmiller/2950-skip-ytdlp' into qa Gretchen Miller 2024-10-02 11:04:03 -07:00
  • 720601a5d9 WT-2950 update job schema Gretchen Miller 2024-10-02 11:02:20 -07:00
  • 04c00d21c5 Merge branch 'gmiller/2950-skip-ytdlp' into qa Gretchen Miller 2024-09-30 17:01:04 -07:00
  • 36b17d2a66 WT2590 addressing PR feedback Gretchen Miller 2024-09-30 16:55:20 -07:00
  • f1ef6fe752
    Merge 5138fe95846b0982c8d100a8afbd0a0a18916b1f into d987ba2e4b1d9a61070a3edf5f796d652e9f5e87 Adam Miller 2024-09-29 11:25:40 +08:00
  • d987ba2e4b
    Merge pull request #289 from galgeek/metrics_plus_proxy_retries Barbara Miller 2024-09-25 15:12:02 -07:00
  • 5138fe9584 chore: formatting adam/add_new_page_cli Adam Miller 2024-09-24 16:25:46 -07:00
  • 0eb3957335 chore: adjust brozzler_new_page comment Adam Miller 2024-09-24 15:26:17 -07:00
  • 16d2b17772 feat: Add new cli option to insert url into existing crawl. Adam Miller 2024-09-24 15:21:36 -07:00
  • eb06474bed Merge branch 'metrics_plus_proxy_retries' into qa Barbara Miller 2024-09-24 09:13:10 -07:00
  • 9983f43c75 black'd Barbara Miller 2024-09-23 19:53:03 -07:00
  • 6a0b0b058d updates post-walkthru metrics_plus_proxy_retries Barbara Miller 2024-09-23 18:37:14 -07:00
  • 12db06ae8c WT-2950 fix typos Gretchen Miller 2024-09-23 16:38:35 -07:00
  • fb43d3f2a4 bump version Barbara Miller 2024-09-23 15:20:29 -07:00
  • 3e9030a376 rm oddly merged try except block Barbara Miller 2024-09-23 15:16:07 -07:00
  • 6fdc2b9a57 WT-2950 fix RST formatting Gretchen Miller 2024-09-20 17:16:07 -07:00
  • 41aab1a0b0 WT-2950 documentation + better conf handling + linting Gretchen Miller 2024-09-20 15:21:21 -07:00
  • 7de6483453 skip brozzler_resources metrics Barbara Miller 2024-09-20 14:43:05 -07:00
  • dca9630982 WT-2950 cleaning up video capture options handling; PDFs only handling on outlinks Gretchen Miller 2024-09-20 14:17:07 -07:00
  • bcbe331463 Merge branch 'metrics_plus_proxy_retries' into qa Barbara Miller 2024-09-19 21:01:09 -07:00
  • c74d9ad90f limit proxy logging Barbara Miller 2024-09-19 20:53:03 -07:00
  • cb4da54e36 Merge branch 'metrics_plus_proxy_retries' into qa Barbara Miller 2024-09-19 19:48:24 -07:00
  • 229d53d4b1 add brozzler_ydl_download_successes metric Barbara Miller 2024-09-19 16:45:22 -07:00
  • 08c01f279c fix qa merge error Barbara Miller 2024-09-19 11:23:18 -07:00
  • 3b4db5c74d Merge branch 'metrics_plus_proxy_retries' into qa Barbara Miller 2024-09-19 10:54:55 -07:00
  • 7fbee54eaa proxyrack only for youtube.com Barbara Miller 2024-09-19 10:45:01 -07:00
  • f624e7ee8e bump qa-ish version Barbara Miller 2024-09-18 17:26:23 -07:00
  • 04aaec0ac5 Merge branch 'metrics_plus_proxy_retries' into qa Barbara Miller 2024-09-18 16:01:03 -07:00
  • 2aa1788637 mostly black'd Barbara Miller 2024-09-18 15:58:19 -07:00
  • 27cb104b45 more extract (less download) Barbara Miller 2024-09-18 15:57:47 -07:00
  • 44b5317b93 Merge branch 'metrics_plus_proxy_retries' into qa Barbara Miller 2024-09-18 15:08:48 -07:00
  • 62b12434d0 mostly ydl.py updates for new proxyrack testing Barbara Miller 2024-09-18 14:51:11 -07:00
  • 8b2c254485 brozzler_ydl_extract, not download Barbara Miller 2024-09-18 14:17:10 -07:00
  • bb1c343724 updates for review of PR 287 Barbara Miller 2024-09-17 17:53:50 -07:00
  • cfafc560c5 Merge branch 'proxyrack' into metrics_plus_proxy_retries Barbara Miller 2024-09-16 15:34:11 -07:00
  • 4a60ff3367 post-deploy bug fixes Barbara Miller 2024-09-13 17:01:35 -07:00
  • 8275f3ea16 another tiny ruff format pass Gretchen Miller 2024-09-13 16:04:58 -07:00
  • aaf85db638 Merge branch 'new_metrics' into qa Barbara Miller 2024-09-13 14:24:34 -07:00
  • 66263f0371 WT-2950 video capture options enum Gretchen Miller 2024-09-13 14:21:59 -07:00
  • 551d1868d1 better order Barbara Miller 2024-09-13 14:16:49 -07:00
  • 1a6aeb45db track_inprogress (not _in_progress) Barbara Miller 2024-09-13 14:12:46 -07:00
  • 8c20d1dad3 add (back) env param Barbara Miller 2024-09-13 14:09:06 -07:00
  • 77e6b9ed52 small ruff formatting pass Gretchen Miller 2024-09-13 13:38:21 -07:00
  • c722549697 WT-2950 exclude video file types if site has disabled video capture Gretchen Miller 2024-09-13 13:33:57 -07:00
  • 9d7b7c4167 add @metrics.brozzler_in_progress_pages.track_in_progress() Barbara Miller 2024-09-13 13:15:57 -07:00
  • 1bc2135462 better registry_url help Barbara Miller 2024-09-13 13:12:02 -07:00
  • 66096453d1 tidy params for register_prom_metrics Barbara Miller 2024-09-13 09:13:50 -07:00
  • 7b6c306d14 setup registry_url, metrics_port, env vars and CLI args Barbara Miller 2024-09-12 17:54:37 -07:00
  • c3a92b102f WT-2950 invert conditionals to PEP8 preferred code style (E713) Gretchen Miller 2024-09-12 16:54:00 -07:00
  • eb227b0d4e WT-2950 replace skip_ytdlp with video_capture Gretchen Miller 2024-09-12 16:51:48 -07:00
  • d9ed5c434a WT-2950 remove skip_av_seeds Gretchen Miller 2024-09-12 16:45:52 -07:00
  • 80ce6c0ea6 register_prom_metrics working in dev env Barbara Miller 2024-09-12 16:12:18 -07:00
  • 66827fbbcf more metrics Barbara Miller 2024-09-12 14:27:22 -07:00
  • c82858a9f6 make http_sd_registry optional Barbara Miller 2024-09-12 13:11:41 -07:00
  • 1d84e72ce7 update setup.py: skip prometheus-async; update ytdlp Barbara Miller 2024-09-12 13:10:26 -07:00
  • 1d63793788 add update_page_metrics Barbara Miller 2024-09-12 11:32:06 -07:00
  • 7de5b1cbd7 add some labels Barbara Miller 2024-09-11 17:37:55 -07:00
  • 2d7efba280 initial commit Barbara Miller 2024-09-11 16:36:08 -07:00
  • c4e7c040b4 bump qa version Barbara Miller 2024-09-11 09:54:48 -07:00
  • 39c677007e Merge branch 'proxyrack' into qa Barbara Miller 2024-09-11 09:54:17 -07:00
  • edf2f9e51a retries for proxyrack and push proxyrack Barbara Miller 2024-09-10 21:58:47 -07:00
  • 0dca9f3861 chore: formatting Adam Miller 2024-08-30 21:15:59 +00:00
  • 18a976f82c feat: Detect connection failures forwarded from warcprox and retry them with backoff Adam Miller 2024-08-30 21:11:02 +00:00
  • 138c93bcd0 Merge branch 'maricopa-civicplus' into qa Barbara Miller 2024-08-20 11:47:42 -07:00
  • 71c5691242 maricopa.gov civicplus behavior Barbara Miller 2024-08-20 11:43:24 -07:00
  • 0d8721a4d3 Bump version Adam Miller 2024-08-19 22:42:30 +00:00
  • 68a6953077
    Merge pull request #284 from internetarchive/adam/adds_get_page_header_exception_handling Adam Miller 2024-08-19 15:31:13 -07:00
  • 4870269c64 Merge branch 'adam/adds_get_page_header_exception_handling' into qa Adam Miller 2024-08-12 23:54:05 +00:00