Barbara Miller
6952bf76fb
improve/expand url_regex
2017-08-11 17:16:02 -07:00
Barbara Miller
fdf07d006d
Merge branch 'ARI-5465' into qa
2017-08-11 10:41:57 -07:00
Barbara Miller
05c0cd7914
skip a.uiMorePagerPrimary after all
2017-08-11 10:41:15 -07:00
Noah Levitt
f785adb944
Merge pull request #57 from internetarchive/ARI-5409
...
simpleclicks for tuebingen.de
2017-08-10 10:59:38 -07:00
Barbara Miller
44e2b8579a
Merge branch 'ARI-5460' into qa
2017-08-09 16:24:13 -07:00
Barbara Miller
61bbb9774f
sign up button and updated selectors
2017-08-09 16:23:35 -07:00
Barbara Miller
abd024f091
Merge branch 'ARI-5453' into qa
2017-08-08 11:37:50 -07:00
Barbara Miller
ec710f34be
simpleclicks for wixsite.com
2017-08-08 11:37:24 -07:00
Noah Levitt
55856d2180
Merge pull request #54 from vbanos/worker_on_request
...
Pass missing on_request callback to BrozzlerWorker methods
2017-08-03 14:17:02 -07:00
Barbara Miller
101257effe
simpleclicks for tuebingen.de
2017-08-03 13:21:46 -07:00
Neil Minton
3e8e699661
Merge branch 'aitfive-1295' into qa
2017-08-02 10:59:00 -07:00
Noah Levitt
5be7dd4407
Merge branch 'master' into qa
...
* master:
bump dev version number after some PR merges
bugfix for BrozzlerWorker._needs_browsing
Remove redundant method parameter.
bugfix
Make youtube-dl optional in BrozzlerWorker.brozzle_page
2017-08-01 12:05:07 -07:00
Noah Levitt
bf250194b4
bump dev version number after some PR merges
2017-08-01 12:04:56 -07:00
Noah Levitt
50881ab38b
Merge pull request #55 from galgeek/ARI-5242
...
ARI-5242
2017-08-01 12:04:18 -07:00
Noah Levitt
f7fe06874d
Merge pull request #53 from vbanos/bugfix-needs-browsing
...
bugfix for BrozzlerWorker._needs_browsing
2017-08-01 10:14:56 -07:00
Vangelis Banos
78b9d61654
Pass missing on_request callback to BrozzlerWorker methods
...
``Browser.browser_page`` has the ``on_request`` parameter but it is on
used by ``BrozzlerWorker._browse_page`` where we invoke it.
I add this to ``BrozzlerWorker.brozzle_page`` and pass it also to
``BrozzlerWorker._browser_page``. Now, it is possible to use this
callback from other applications when calling
``BrozzlerWorker.brozzle_page``.
2017-08-01 13:58:42 +00:00
Vangelis Banos
ae73edb244
bugfix for BrozzlerWorker._needs_browsing
...
I'm sorry but with my previous commit I introduced a bug in
``BrozzlerWorker._needs_browsing`` method.
More specifically, if the ``brozzler_spy`` param is False (this happens
when ``youtube_dl`` is disabled), ``_needs_browsing`` method returns
always ``False`` and this messes with ``brozzle_page`` workflow. The
browser is nevenr visiting the page.
I'm fixing this here.
2017-08-01 11:43:42 +00:00
Neil Minton
58b95fa7bf
Log oulinks for all users of Browser.
2017-07-31 15:43:53 -07:00
Noah Levitt
895bfbf913
Merge pull request #51 from vbanos/youtube-dl-option
...
Make youtube-dl optional in BrozzlerWorker.brozzle_page
2017-07-31 11:32:51 -07:00
Noah Levitt
7d62eb6525
Merge pull request #52 from vbanos/remove-redundant-param
...
Remove redundant method parameter.
2017-07-31 11:23:28 -07:00
Vangelis Banos
0343969807
Remove redundant method parameter.
...
``ignore_cert_errors`` is passed to ``Chrome`` via ``Browser`` via
``BrowserPool` here:
https://github.com/internetarchive/brozzler/blob/master/brozzler/worker.py#L120
it is not doing anything in ``Browser.browser_page``.
2017-07-31 12:36:17 +00:00
Vangelis Banos
6259d03be1
bugfix
2017-07-31 10:36:35 +00:00
Vangelis Banos
9c81a7bbda
Make youtube-dl optional in BrozzlerWorker.brozzle_page
...
Enabled by default (of course).
Speed is significantly improved when disabled.
2017-07-31 08:57:47 +00:00
Barbara Miller
d743dcd53e
Merge branch 'behavior-refactor' into qa
2017-07-26 15:43:08 -07:00
Barbara Miller
2e300166f2
reset didSomething for each action
2017-07-26 15:42:25 -07:00
Barbara Miller
ef1bd179c5
Merge branch 'behavior-refactor' into qa
2017-07-21 16:40:02 -07:00
Barbara Miller
5c6184201f
Merge branch 'master' into behavior-refactor
2017-07-21 16:24:36 -07:00
Barbara Miller
a563e9eb0c
Merge pull request #50 from internetarchive/ARI-5407
...
Add click selector for facebook’s new See More link
2017-07-21 14:43:38 -07:00
Barbara Miller
6c7d5124a7
correct merge error
2017-07-20 15:55:41 -07:00
Barbara Miller
9b69d554f1
Merge branch 'ARI-5379' into qa
2017-07-20 15:53:33 -07:00
Barbara Miller
7620ee6fae
only div.teaser, for *pm.gc.ca*
2017-07-20 15:52:53 -07:00
Barbara Miller
d08e5df10b
Merge branch 'ARI-5379' into qa
2017-07-19 15:52:00 -07:00
Barbara Miller
795b9ab809
improve/expand url_regex
2017-07-19 15:50:49 -07:00
Barbara Miller
ddb1ee283a
Merge branch 'ARI-5407' into qa
2017-07-19 14:47:30 -07:00
Barbara Miller
5c4961fbce
add selector for See More link
2017-07-19 14:44:27 -07:00
Barbara Miller
b33e2c194f
Merge branch 'ARI-5334' into qa
2017-07-18 15:19:22 -07:00
Barbara Miller
ab1083ad0c
better paging through google search results?
2017-07-18 15:18:59 -07:00
Barbara Miller
be2b663ad4
Merge branch 'ARI-5242' into qa
2017-07-18 14:30:26 -07:00
Barbara Miller
59571dadfa
div.compactTrackListItem for soundcloud.com
2017-07-18 14:27:10 -07:00
Barbara Miller
8a27b64a1d
Merge branch 'ARI-5242' into qa
2017-07-18 14:11:12 -07:00
Barbara Miller
3c9eb30212
div.soundItem selector for multi-item list
2017-07-18 14:08:20 -07:00
Barbara Miller
8524992840
var limit
2017-07-15 14:26:35 -07:00
Barbara Miller
ac70617a05
add limits
2017-07-14 18:06:59 -07:00
Noah Levitt
0955d56926
Merge pull request #46 from internetarchive/ARI-5379
...
ARI-5379: custom behavior for pm.gc.ca
2017-07-13 11:42:34 -07:00
Barbara Miller
0a2895364d
resolve conflict
2017-07-13 11:32:25 -07:00
Neil Minton
512931b6c8
Merge branch 'ari-5210' into qa
2017-07-12 17:30:06 -07:00
Neil Minton
218c7c6372
New pagination behavior for http://www.ssab.gov/Our-Work
2017-07-12 17:28:41 -07:00
Neil Minton
78d73a9adc
Merge branch 'ari-5210' into qa
2017-07-12 16:39:03 -07:00
Neil Minton
ddd61e4642
New pagination behavior for http://www.ssab.gov/Our-Work
2017-07-12 16:38:11 -07:00
Barbara Miller
1ee8a7e002
Merge branch 'ARI-5409' into qa
2017-07-12 14:19:51 -07:00
