Git-Mirrors/brozzler
1
0
Fork 0
mirror of https://github.com/internetarchive/brozzler.git synced 2025-05-02 06:36:20 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

to avoid infinite loops in some cases, ignore the "claimed" field in the rethinkdb table "pages", because if a page is left "claimed", it must have been because of some error... site.claimed is the real claiming mechanism

Browse source
This commit is contained in:
Noah Levitt 2016-06-29 00:02:25 +00:00
parent 7a805a43d1
commit d04c5a31cc
2 changed files with 18 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

2
setup.py
View file

@ -21,7 +21,7 @@ import setuptools
setuptools.setup(
name='brozzler',
version='1.1.dev30',
version='1.1.dev31',
description='Distributed web crawling with browsers',
url='https://github.com/internetarchive/brozzler',
author='Noah Levitt',