* master:
fix bug handling page with zero outlinks
avoid infinite loop in case youtube-dl encounters redirect loop (which can be ok if cookies have been set or something)
brozzler logo svg with small default size
travis-ci slack integration
fix _find_available_port and its unit test
little fixes
avoid broken version of websocket-client to fix https://github.com/internetarchive/brozzler/issues/28
wrong branch of warcprox in ansible install
move cookie db management code into chrome.py
move _find_available_ports to chrome.py, changing the way it works so that browser:9200 doesn't get stuck at 9201 forever, which pushes 9201 to 9202 etc, and add a unit test
split Chrome class into its own module
new utility brozzler-list-captures for looking up entries in the "captures" table
* master:
in warcprox 2.0b2, captures table field has been renamed to "record_length"
remove flickr behavior, flickr is better off with the default behavior for now
Update README.rst
add travis-ci badge
* master:
don't check robots.txt when scheduling a new site to be crawled, but mark the seed Page as needs_robots_check, and delegate the robots check to brozzler-worker; new test of robots.txt adherence
robots.txt for testing
monkey-patch reppy to support substring user-agent matching
give vagrant vm enough memory so that tests pass consistently
need warcprox to listen on public address because that's what it puts in the service registry
looks like the problem may have been a bug in ansible 2.2.0.0, so pin to 2.1.3.0
* master:
use \n to delimit outlinks because urls can contain spaces (and anything else except [\n\t\0]) in the fragment part even after browser canonicalization
* master:
pass behavior_parameters from job configuration into Site objects
add --behavior-parameters argument to brozzler-new-site
fix bug in final_bounces (not sure what I was thinking)
restore accidentally removed functionality handling page redirects and friends
cat logs on travis-ci failure
reppy 0.4.1 has a significantly different api apparently, so for now let's go back to 0.3.4
still trying to get installation of pip to work on travis-ci
update for reppy api change and pin to current version of reppy
tweaks to ansible config to try to get the deployment to run on travis-ci
