Git-Mirrors/brozzler
1
0
Fork 0
mirror of https://github.com/internetarchive/brozzler.git synced 2025-02-24 16:49:56 -05:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge branch 'nsw-pub' into qa

Browse Source
This commit is contained in:
Barbara Miller 2024-04-25 14:19:11 -07:00
commit 33681b59cb
2 changed files with 9 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
brozzler/behaviors.yaml
View File

@ -49,6 +49,14 @@
- selector: a.coreSpriteRightPaginationArrow - selector: a.coreSpriteRightPaginationArrow
repeatSameElement: true repeatSameElement: true
rmSelector: '.RnEpo' rmSelector: '.RnEpo'
-
url_regex: '^https?://www.opengov\.nsw\.gov\.au/publications.*$'
behavior_js_template: umbraBehavior.js.j2
default_parameters:
interval: 1000
actions:
- selector: span.DV-trigger.DV-next
repeatSameElement: true
- -
url_regex: '^https?://americaspresidents\.si\.edu/gallery.*$' url_regex: '^https?://americaspresidents\.si\.edu/gallery.*$'
behavior_js_template: umbraBehavior.js.j2 behavior_js_template: umbraBehavior.js.j2

2
setup.py
View File

@ -34,7 +34,7 @@ def find_package_data(package):
setuptools.setup( setuptools.setup(
name="brozzler", name="brozzler",
version="1.5.47a4", version="1.5.48a0",
description="Distributed web crawling with browsers", description="Distributed web crawling with browsers",
url="https://github.com/internetarchive/brozzler", url="https://github.com/internetarchive/brozzler",
author="Noah Levitt", author="Noah Levitt",