Git-Mirrors/brozzler
1
0
Fork 0
mirror of https://github.com/internetarchive/brozzler.git synced 2025-04-20 15:55:49 -04:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

refactor: short circuit claimable sites loop when we have enough sites

Browse Source
This commit is contained in:
Adam Miller 2025-04-15 14:03:15 -07:00
parent f0d527cda7
commit 0f57188a2c
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
brozzler/frontier.py
View File

@ -65,6 +65,9 @@ def filter_claimable_site_ids(
if is_claimable:
claimable_sites.append(site)
if len(claimable_sites) >= max_sites_to_claim:
break
site_ids_to_claim = []
# gather sites that are under the max without going over
for site in claimable_sites: