Git-Mirrors/brozzler
1
0
Fork 0
mirror of https://github.com/internetarchive/brozzler.git synced 2025-05-02 06:36:20 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

option to save list of outlinks (categorized as "accepted", "blocked" (by robots), or "rejected") per page in rethinkdb (to be used by archive-it for out-of-scope reporting)

Browse source
This commit is contained in:
Noah Levitt 2016-07-01 15:23:46 -05:00
parent 01e38ea8c7
commit 3e128d2b27
5 changed files with 21 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

2
setup.py
View file

@ -21,7 +21,7 @@ import setuptools
setuptools.setup(
name='brozzler',
version='1.1.dev43',
version='1.1.dev44',
description='Distributed web crawling with browsers',
url='https://github.com/internetarchive/brozzler',
author='Noah Levitt',