9 Commits

Author	SHA1	Message	Date
Noah Levitt	fd0c3322ee	update readme, s/umbra/brozzler/ in most places, delete non-brozzler stuff	2015-07-13 17:09:39 -07:00
Noah Levitt	3eff099b16	determine if youtube-dl can do something with a url	2015-07-13 16:40:56 -07:00
Noah Levitt	6470a8ef26	sigquit dumps thread traces	2015-07-13 15:57:14 -07:00
Noah Levitt	eb74967fed	brozzler-worker round-robins sites needing crawling	2015-07-13 12:13:41 -07:00
Noah Levitt	ddd764cac5	brozzle-worker options --proxy-server=host:port and --ignore-certificate-errors (for use with warcprox)	2015-07-11 23:07:47 -07:00
Noah Levitt	610f9c8cf4	add missing file hq.py, improve some logging, fix little race condition bug	2015-07-11 13:09:45 -07:00
Noah Levitt	1fb336cb2e	crawling outlinks not totally working	2015-07-11 02:29:19 -07:00
Noah Levitt	56a7bb7306	submit outlinks to hq	2015-07-10 21:31:41 -07:00
Noah Levitt	fd99764baa	brozzler-worker partially working	2015-07-10 21:07:47 -07:00