1813 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Adam Miller	1ffa6cbe0b	fix: Ensure page is None when we're done retrying, so site gets disclaimed	2024-11-26 13:47:14 -08:00
Adam Miller	f9f68caaba	resolve merge conflicts	2024-11-26 10:52:06 -08:00
Adam Miller	cb355d9159	Merge branch 'master' into adam/connection_failure_retry	2024-11-26 10:42:27 -08:00
Adam Miller	4b20d81b19	chore: Comment retry delay backoff calculation.	2024-11-26 10:26:47 -08:00
Barbara Miller	d9d09996b0	bump version to 1.6.3	2024-11-12 16:22:53 -08:00
Barbara Miller	f0c158b283	Merge pull request #303 from vbanos/http-https ... Disable automatic http to https transformation My QA crawl looks good.	2024-11-12 16:21:49 -08:00
Adam Miller	05ddc28ea8	Comment frontier query change	2024-11-12 15:05:49 -08:00
Adam Miller	f332e569be	Merge branch 'master' into adam/connection_failure_retry	2024-11-12 14:59:49 -08:00
Adam Miller	ab488968c5	Adjust backoff timing to 60, 90, 135 depending on number of attempts	2024-11-12 13:07:07 -08:00
Adam Miller	0f100e6a71	revert browser.py and pull status from browser.websock_thread.page_status instead.	2024-11-12 13:06:09 -08:00
Vangelis Banos	a52765d2ca	Disable automatic http to https transformation ... Chrome 130 automatically converts http to https even if the target URL is http. We disable this behavior because some target sites simply don't have https.	2024-11-12 21:59:49 +02:00
Barbara Miller	d079409a5b	Merge pull request #302 from internetarchive/pypi_1dot6dot2 ... minor updates for v.1.6.2, on pypi at https://pypi.org/project/brozzler/1.6.2/	2024-11-05 17:37:32 -08:00
Barbara Miller	c4e5dc63fc	minor updates for v.1.6.2 (for pypi)	2024-11-05 17:26:59 -08:00
Barbara Miller	07a6b9845a	bump version	2024-11-02 10:20:13 -07:00
Barbara Miller	b5177865c1	Merge pull request #300 from galgeek/extra_think ... updates for pypi & library use	2024-11-02 10:16:43 -07:00
Barbara Miller	413fc13120	for pypi	2024-11-02 09:36:12 -07:00
Barbara Miller	2b4f40a3e6	facilitate library use	2024-11-02 09:35:03 -07:00
Barbara Miller	09ec0b1078	update copyright notice	2024-11-02 09:33:28 -07:00
Barbara Miller	0db478f704	Merge pull request #299 from galgeek/doublethink_up ... update doublethink dependency	2024-10-31 11:21:41 -07:00
Barbara Miller	d1e6e0f632	update doublethink dependency	2024-10-31 11:04:40 -07:00
Barbara Miller	f4e6f6c1c3	Merge pull request #298 from internetarchive/galgeek-patch-3 ... Update workflow publish-artifacts.yml	2024-10-30 15:59:29 -07:00
Barbara Miller	781d7efc62	Merge pull request #297 from galgeek/master ... update README, yt-dlp, not youtube-dl	2024-10-30 15:58:31 -07:00
Barbara Miller	39a3c7cc8b	Update workflow publish-artifacts.yml	2024-10-30 15:56:02 -07:00
Barbara Miller	4ce5f7a61f	update README, yt-dlp, not youtube-dl	2024-10-30 15:44:27 -07:00
Barbara Miller	b07f939c37	bump version ... bump version, to 1.6, for setting up publishing build artifacts...	2024-10-30 15:22:45 -07:00
Barbara Miller	4890952c42	Merge pull request #296 from galgeek/publish_builds ... workflow to publish build artifacts to dist/	2024-10-30 15:15:51 -07:00
Barbara Miller	741a30feee	draft workflow to publish build artifacts	2024-10-30 12:06:41 -07:00
Barbara Miller	d488cdbb3b	fixes for chrome v.130	2024-10-18 16:40:24 -07:00
Barbara Miller	3a8b9d2d05	bump version	2024-10-17 09:49:46 -07:00
Barbara Miller	636e719bc8	Merge pull request #295 from galgeek/doublethink_extra ... move doublethink to extras_require	2024-10-17 09:48:54 -07:00
Barbara Miller	7c5b5da722	Merge pull request #294 from vbanos/chrome130 ... Add support for Chrome > 110	2024-10-17 09:47:36 -07:00
Barbara Miller	18c7cf5a3f	Merge branch 'enable_chrome_update' into qa	2024-10-17 09:46:21 -07:00
Barbara Miller	5ac681cb37	black'd	2024-10-17 09:24:21 -07:00
Barbara Miller	631a7f40c2	move doublethink to extras_require	2024-10-17 09:22:30 -07:00
vbanos	f39cc632ed	Add support for Chrome > 110	2024-10-17 17:44:17 +02:00
Barbara Miller	3c0a11c7d4	bump qa version	2024-10-08 17:19:03 -07:00
Barbara Miller	c3c54dab7a	Merge branch 'prom_headers_update' into qa	2024-10-08 17:18:23 -07:00
Barbara Miller	90dbdbd19d	tidier get_page_headers	2024-10-08 16:35:34 -07:00
Barbara Miller	8007d61a0f	bump version	2024-10-07 16:21:04 -07:00
Barbara Miller	ed906b4aa2	Merge pull request #293 from galgeek/prom-ii ... update prometheus metrics, approved separately by @avdempsey	2024-10-07 16:20:22 -07:00
Barbara Miller	93d256a7b5	black'd	2024-10-07 16:17:49 -07:00
Barbara Miller	cd3ddb3f23	Merge branch 'prom-ii' into qa	2024-10-07 15:50:54 -07:00
Barbara Miller	de7a325377	histograms track_inprogress ...	2024-10-07 15:50:32 -07:00
Barbara Miller	90845b317d	Merge branch 'prom-ii' into qa	2024-10-07 15:28:14 -07:00
Barbara Miller	d7c6c57908	fix plural typo	2024-10-07 15:26:18 -07:00
Barbara Miller	380be7dabd	bump qa version	2024-10-07 15:12:29 -07:00
Barbara Miller	de5ce6049e	Merge branch 'prom-ii' into qa	2024-10-07 15:11:09 -07:00
Barbara Miller	f72fa2b102	updated prometheus metrics	2024-10-07 15:01:53 -07:00
Barbara Miller	151777298a	bump version	2024-10-03 15:50:20 -07:00
Barbara Miller	f47a7cca28	Merge pull request #291 from galgeek/websocket-client-utf8fix ... add skip_utf8_validation parameter for websocket-client	2024-10-03 15:46:32 -07:00