brozzler/requirements.txt

kombu
argparse
PyYAML
git+https://github.com/ikreymer/surt.git@py3
# youtube_dl
git+https://github.com/nlevitt/youtube-dl.git@brozzler
git+https://github.com/seomoz/reppy.git
requests
# websocket-client
git+https://github.com/nlevitt/websocket-client.git@tweaks
basic of site/seed crawling with scoping 2015-07-09 18:36:07 -07:00			`kombu`
			`argparse`
			`PyYAML`
			`git+https://github.com/ikreymer/surt.git@py3`
use new fork of youtube-dl with support for extra http headers on every request 2015-07-21 19:23:01 +00:00			`# youtube_dl`
use nlevitt brozzler branch of youtube-dl 2015-07-28 01:10:39 +00:00			`git+https://github.com/nlevitt/youtube-dl.git@brozzler`
honor site proxy setting; remove brozzler-worker options that are now configured at the site level (and in the case of ignore_cert_errors, always on, no longer an option); use "reppy" library for robots.txt handling; fix some bugs 2015-07-16 17:19:12 -07:00			`git+https://github.com/seomoz/reppy.git`
make requests library dependency explicity 2015-08-01 01:25:07 +00:00			`requests`
require my "tweaks" branch of websocket-client 2015-07-20 16:06:47 -07:00			`# websocket-client`
			`git+https://github.com/nlevitt/websocket-client.git@tweaks`