Noah Levitt ba519d7288 improve messaging when brozzler-stop-crawl is passed nonexistent seed/job id

2017-04-20 18:04:17 -07:00

..

htdocs

extract area/@href links, and add test for outlink extraction

2017-04-05 12:09:48 -07:00

test_brozzling.py

fix robots.txt proxy down test by setting site.id (cached robots is stored by site.id, and other tests that ran earlier with no site.id were interfering); and test another kind of connection error, for whatever that's worth

2017-04-18 12:00:23 -07:00

test_cli.py

improve messaging when brozzler-stop-crawl is passed nonexistent seed/job id

2017-04-20 18:04:17 -07:00

test_cluster.py

implement resilience to warcprox outage, i.e. deal with brozzler.ProxyError in brozzler-worker

2017-04-18 17:54:12 -07:00

test_frontier.py

new command line utility brozzler-stop-crawl, with tests

2017-04-14 18:06:15 -07:00

test_units.py

have _warcprox_write_record also raise ProxyError when appropriate, and test this

2017-04-18 16:58:51 -07:00