Adam Miller
7ef4a04e50
feat: add log for long brozzler sessions
2024-12-11 16:47:13 -08:00
Adam Miller
73a9c9f823
Merge pull request #306 from internetarchive/adam/update_brozzler_version
...
chore: Bump version to 1.6.4
2024-12-05 09:22:06 -08:00
Adam Miller
42e2452363
chore: Bump version to 1.6.4
2024-12-05 09:14:11 -08:00
Adam Miller
18d3c8a697
Merge pull request #285 from internetarchive/adam/connection_failure_retry
...
feat: Detect connection failures forwarded from warcprox and retry th…
2024-12-04 15:38:28 -08:00
Adam Miller
210491c867
Merge pull request #305 from galgeek/chrome130fixes
...
small fixes for chrome v.130
2024-12-04 15:37:06 -08:00
Barbara Miller
c781f53e3f
black'd
2024-12-02 15:19:50 -08:00
Adam Miller
1ffa6cbe0b
fix: Ensure page is None when we're done retrying, so site gets disclaimed
2024-11-26 13:47:14 -08:00
Adam Miller
cb355d9159
Merge branch 'master' into adam/connection_failure_retry
2024-11-26 10:42:27 -08:00
Adam Miller
4b20d81b19
chore: Comment retry delay backoff calculation.
2024-11-26 10:26:47 -08:00
Barbara Miller
d9d09996b0
bump version to 1.6.3
2024-11-12 16:22:53 -08:00
Barbara Miller
f0c158b283
Merge pull request #303 from vbanos/http-https
...
Disable automatic http to https transformation
My QA crawl looks good.
2024-11-12 16:21:49 -08:00
Adam Miller
05ddc28ea8
Comment frontier query change
2024-11-12 15:05:49 -08:00
Adam Miller
f332e569be
Merge branch 'master' into adam/connection_failure_retry
2024-11-12 14:59:49 -08:00
Adam Miller
ab488968c5
Adjust backoff timing to 60, 90, 135 depending on number of attempts
2024-11-12 13:07:07 -08:00
Adam Miller
0f100e6a71
revert browser.py and pull status from browser.websock_thread.page_status instead.
2024-11-12 13:06:09 -08:00
Vangelis Banos
a52765d2ca
Disable automatic http to https transformation
...
Chrome 130 automatically converts http to https even if the target URL
is http. We disable this behavior because some target sites simply don't
have https.
2024-11-12 21:59:49 +02:00
Barbara Miller
d079409a5b
Merge pull request #302 from internetarchive/pypi_1dot6dot2
...
minor updates for v.1.6.2, on pypi at https://pypi.org/project/brozzler/1.6.2/
2024-11-05 17:37:32 -08:00
Barbara Miller
c4e5dc63fc
minor updates for v.1.6.2 (for pypi)
2024-11-05 17:26:59 -08:00
Barbara Miller
07a6b9845a
bump version
2024-11-02 10:20:13 -07:00
Barbara Miller
b5177865c1
Merge pull request #300 from galgeek/extra_think
...
updates for pypi & library use
2024-11-02 10:16:43 -07:00
Barbara Miller
413fc13120
for pypi
2024-11-02 09:36:12 -07:00
Barbara Miller
2b4f40a3e6
facilitate library use
2024-11-02 09:35:03 -07:00
Barbara Miller
09ec0b1078
update copyright notice
2024-11-02 09:33:28 -07:00
Barbara Miller
0db478f704
Merge pull request #299 from galgeek/doublethink_up
...
update doublethink dependency
2024-10-31 11:21:41 -07:00
Barbara Miller
d1e6e0f632
update doublethink dependency
2024-10-31 11:04:40 -07:00
Barbara Miller
f4e6f6c1c3
Merge pull request #298 from internetarchive/galgeek-patch-3
...
Update workflow publish-artifacts.yml
2024-10-30 15:59:29 -07:00
Barbara Miller
781d7efc62
Merge pull request #297 from galgeek/master
...
update README, yt-dlp, not youtube-dl
2024-10-30 15:58:31 -07:00
Barbara Miller
39a3c7cc8b
Update workflow publish-artifacts.yml
2024-10-30 15:56:02 -07:00
Barbara Miller
4ce5f7a61f
update README, yt-dlp, not youtube-dl
2024-10-30 15:44:27 -07:00
Barbara Miller
b07f939c37
bump version
...
bump version, to 1.6, for setting up publishing build artifacts...
2024-10-30 15:22:45 -07:00
Barbara Miller
4890952c42
Merge pull request #296 from galgeek/publish_builds
...
workflow to publish build artifacts to dist/
2024-10-30 15:15:51 -07:00
Barbara Miller
741a30feee
draft workflow to publish build artifacts
2024-10-30 12:06:41 -07:00
Barbara Miller
d488cdbb3b
fixes for chrome v.130
2024-10-18 16:40:24 -07:00
Barbara Miller
3a8b9d2d05
bump version
2024-10-17 09:49:46 -07:00
Barbara Miller
636e719bc8
Merge pull request #295 from galgeek/doublethink_extra
...
move doublethink to extras_require
2024-10-17 09:48:54 -07:00
Barbara Miller
7c5b5da722
Merge pull request #294 from vbanos/chrome130
...
Add support for Chrome > 110
2024-10-17 09:47:36 -07:00
Barbara Miller
5ac681cb37
black'd
2024-10-17 09:24:21 -07:00
Barbara Miller
631a7f40c2
move doublethink to extras_require
2024-10-17 09:22:30 -07:00
vbanos
f39cc632ed
Add support for Chrome > 110
2024-10-17 17:44:17 +02:00
Barbara Miller
8007d61a0f
bump version
2024-10-07 16:21:04 -07:00
Barbara Miller
ed906b4aa2
Merge pull request #293 from galgeek/prom-ii
...
update prometheus metrics, approved separately by @avdempsey
2024-10-07 16:20:22 -07:00
Barbara Miller
93d256a7b5
black'd
2024-10-07 16:17:49 -07:00
Barbara Miller
de7a325377
histograms track_inprogress ...
2024-10-07 15:50:32 -07:00
Barbara Miller
d7c6c57908
fix plural typo
2024-10-07 15:26:18 -07:00
Barbara Miller
f72fa2b102
updated prometheus metrics
2024-10-07 15:01:53 -07:00
Barbara Miller
151777298a
bump version
2024-10-03 15:50:20 -07:00
Barbara Miller
f47a7cca28
Merge pull request #291 from galgeek/websocket-client-utf8fix
...
add skip_utf8_validation parameter for websocket-client
2024-10-03 15:46:32 -07:00
Barbara Miller
28b8149963
add comment re fix
2024-10-02 17:38:30 -07:00
Barbara Miller
c40eb17935
black'd
2024-10-02 17:34:30 -07:00
Barbara Miller
9185024050
add skip_utf8_validation
2024-10-02 16:55:25 -07:00
