5 Commits

Author	SHA1	Message	Date
Noah Levitt	934190084c	Refactor the way the proxy is configured. Job/site settings "proxy" and "enable_warcprox_features" are gone. Brozzler-worker now has mutually exclusive options --proxy and --warcprox-auto. --warcprox-auto means find an instance of warcprox in the service registry, and enable warcprox features. --proxy is provided, determines if proxy is warcprox by consulting http://{proxy_address}/status (see https://github.com/internetarchive/warcprox/commit/8caae0d7d3), and enables warcprox features if so.	2017-03-24 13:55:23 -07:00
Noah Levitt	5a0301ac12	let rethinkdb generate job.id if not supplied in configuration	2017-02-03 14:53:50 -08:00
Alex Osborne	743b5a4347	Add user_agent option ... Currently doesn't apply to requests made by youtube-dl as I couldn't see a thread-safe way of doing that.	2016-10-05 04:25:09 +11:00
Noah Levitt	bfd4c1f8c6	document a bunch of job settings	2016-09-29 16:15:44 -07:00
Noah Levitt	8c9a9c5666	starting on documenting job configuration	2016-09-29 12:03:16 -07:00