skip downloading videos from youtube playlists

because we expect to capture videos from individual watch pages, and
often processing thousands of videos with youtube-dl before the page is
ever opened in the browser is not desired behavior and is a crawling
problem
This commit is contained in:
Noah Levitt 2018-10-11 15:46:30 -07:00
parent e406e42312
commit 82cf5c6dbb
2 changed files with 20 additions and 1 deletions

View file

@ -32,7 +32,7 @@ def find_package_data(package):
setuptools.setup(
name='brozzler',
version='1.5.dev308',
version='1.5.dev309',
description='Distributed web crawling with browsers',
url='https://github.com/internetarchive/brozzler',
author='Noah Levitt',