Git-Mirrors/brozzler
1
0
Fork 0
mirror of https://github.com/internetarchive/brozzler.git synced 2025-08-03 03:56:24 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix another oversight

Browse source
This commit is contained in:
Noah Levitt 2018-09-28 14:45:45 -07:00
parent 1ee36c38b9
commit 8de3e21103
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
brozzler/model.py
View file

@ -121,6 +121,7 @@ def new_seed_page(frontier, site):
def new_site(frontier, site): def new_site(frontier, site):
logging.info("new site %s", site) logging.info("new site %s", site)
site.id = site.id or str(uuid.uuid4())
# insert the Page into the database before the Site, to avoid situation # insert the Page into the database before the Site, to avoid situation
# where a brozzler worker immediately claims the site, finds no pages # where a brozzler worker immediately claims the site, finds no pages
# to crawl, and decides the site is finished # to crawl, and decides the site is finished