Git-Mirrors/brozzler
1
0
Fork 0
mirror of https://github.com/internetarchive/brozzler.git synced 2025-05-22 08:11:31 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

fix another oversight

Browse source
This commit is contained in:
Noah Levitt 2018-09-28 14:45:45 -07:00
parent 1ee36c38b9
commit 8de3e21103
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
brozzler/model.py
View file

@ -121,6 +121,7 @@ def new_seed_page(frontier, site):
def new_site(frontier, site):
logging.info("new site %s", site)
site.id = site.id or str(uuid.uuid4())
# insert the Page into the database before the Site, to avoid situation
# where a brozzler worker immediately claims the site, finds no pages
# to crawl, and decides the site is finished