791 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Barbara Miller	82c2da72f1	more better yaml, target check	2016-10-13 16:41:16 -07:00
Barbara Miller	f55c12ffe2	more better yaml, target check	2016-10-13 16:40:43 -07:00
Noah Levitt	ed8b937277	back to dev version	2016-10-13 15:11:57 -07:00
Noah Levitt	456c082875	this is 1.1b6	2016-10-13 15:10:24 -07:00
Noah Levitt	23b59f8f4e	Merge branch 'master' of github.com:internetarchive/brozzler ... * 'master' of github.com:internetarchive/brozzler: Ensure job_schema.yaml is installed by pip	2016-10-13 15:00:13 -07:00
Noah Levitt	269512f499	make setup.py work with python2, not because the whole project works with python2, but just so it can be installed as a dependency of projects that support both python2 and python3	2016-10-13 14:59:31 -07:00
Barbara Miller	e3f565bb70	better seed selection	2016-10-12 18:20:32 -07:00
Barbara Miller	9062bee99d	better seed selection	2016-10-12 18:16:12 -07:00
Barbara Miller	aa1c79c346	noguchi.org custom behavior	2016-10-12 17:55:00 -07:00
Barbara Miller	393f40d5ff	custom behavior for catalogue.noguchi.org	2016-10-12 17:48:38 -07:00
Barbara Miller	e884bee6c9	rm old WIP item	2016-10-12 17:48:38 -07:00
Barbara Miller	8d0b5d4bfa	fixing mis-copy	2016-10-12 17:46:42 -07:00
Barbara Miller	0253945161	just test gzip,deflate after all	2016-10-12 17:46:42 -07:00
Barbara Miller	fd76c819ab	test identity encoding	2016-10-12 17:46:42 -07:00
Barbara Miller	d2b5122477	test extra headers	2016-10-12 17:46:42 -07:00
Barbara Miller	5d0f11be09	correct local_state	2016-10-12 17:46:42 -07:00
Barbara Miller	15db75e825	try saving only Brotli conifg	2016-10-12 17:46:42 -07:00
Barbara Miller	cf82d266bd	disable SDCH?	2016-10-12 17:46:42 -07:00
Barbara Miller	84947c1148	make data_dir	2016-10-12 17:46:42 -07:00
Barbara Miller	abc7c0bfca	simplify to troubleshoot	2016-10-12 17:46:42 -07:00
Barbara Miller	8b63555f73	better variable name	2016-10-12 17:46:42 -07:00
Barbara Miller	022a4a60ca	read/write chromium local state	2016-10-12 17:46:42 -07:00
Barbara Miller	b5f2077491	clean up Browser dirs and add flags_location	2016-10-12 17:46:42 -07:00
Barbara Miller	0b9518bc5c	read/write chromium local state	2016-10-12 17:45:32 -07:00
Barbara Miller	016367bc46	clean up Browser dirs and add flags_location	2016-10-12 17:45:31 -07:00
Barbara Miller	a8430baf1b	better still facebook login logging	2016-10-12 17:45:31 -07:00
Barbara Miller	76d8516898	better facebook login logging	2016-10-12 17:44:46 -07:00
Barbara Miller	c9a0e1ed24	facebook login troubleshooting	2016-10-12 17:43:47 -07:00
Barbara Miller	d398d2d006	disable downloads & kccfed behavior	2016-10-12 17:42:54 -07:00
Barbara Miller	73454d2ac7	clickGetPDFs for kansascityfed	2016-10-12 17:42:54 -07:00
Barbara Miller	d7bd19a7f6	kcfed test	2016-10-12 17:42:54 -07:00
Barbara Miller	3c5c6a714a	clickGetPDFs.template	2016-10-12 17:42:54 -07:00
Barbara Miller	3d0c6b7e72	huffpo slideshow custom behavior	2016-10-12 17:42:54 -07:00
Barbara Miller	a147ed1940	multiclicks behavior	2016-10-12 17:42:54 -07:00
Barbara Miller	0d5274ac64	rm old WIP item	2016-10-12 14:10:28 -07:00
Noah Levitt	d82b40be68	fix typo	2016-10-06 18:20:41 -07:00
Noah Levitt	c736f2e703	Merge pull request #19 from ato/schema-file-fix ... Ensure job_schema.yaml is installed by pip	2016-10-05 09:02:18 -07:00
Alex Osborne	0fe2ef9387	Ensure job_schema.yaml is installed by pip ... Use .yaml file extension for consistency with behaviors.yaml.	2016-10-05 15:45:11 +11:00
Noah Levitt	59a15d7f5c	bump dev version after merging pull requests	2016-10-04 14:43:43 -07:00
Noah Levitt	f5e138c7eb	Merge pull request #18 from ato/user-agent ... Add user_agent option	2016-10-04 14:39:50 -07:00
Noah Levitt	692c1c48e1	Merge pull request #17 from ato/validate-conf ... Validate job conf against a simple schema	2016-10-04 14:13:47 -07:00
Alex Osborne	eafc65938b	Enforce at least one seed	2016-10-05 04:31:22 +11:00
Alex Osborne	743b5a4347	Add user_agent option ... Currently doesn't apply to requests made by youtube-dl as I couldn't see a thread-safe way of doing that.	2016-10-05 04:25:09 +11:00
Alex Osborne	5ac67fe513	Validate job conf against a Cerberus schema	2016-10-04 21:19:25 +11:00
Noah Levitt	15633be612	finish vagrant-brozzler-new-job.py	2016-10-03 18:17:35 -07:00
Noah Levitt	5bdf916a78	Merge pull request #16 from galgeek/logCaptchaHref ... log captcha, href	2016-10-03 18:12:07 -07:00
Barbara Miller	c857647198	log location.href always	2016-10-03 17:37:45 -07:00
Barbara Miller	2f6ac120e3	log facebook captcha	2016-10-03 17:37:01 -07:00
Noah Levitt	de5c520ad7	pin psutil version, too	2016-10-03 17:12:00 -07:00
Noah Levitt	f220707aa4	pin pillow to version 3.3.0, primarily because we have a wheel in devpi for that version	2016-10-03 17:06:58 -07:00