Commit graph

1587 commits

Author SHA1 Message Date
Barbara Miller
88d184930b update pitchfork yaml 2017-10-04 20:08:23 -07:00
Barbara Miller
dd18d07ccd add closeSelector feature 2017-10-04 20:08:23 -07:00
Barbara Miller
5126e37139 checking state: first support only 'simple' behaviors 2017-10-04 20:08:23 -07:00
Barbara Miller
e5f49a8b62 first support 'simple' behaviors 2017-10-04 20:08:23 -07:00
Barbara Miller
28130262ea add limits 2017-10-04 20:08:23 -07:00
Barbara Miller
b1431ac2bb umbraBehavior refactor initial commit 2017-10-04 20:08:23 -07:00
Barbara Miller
6dc6e71ddc Merge branch 'master' of github.com:internetarchive/brozzler 2017-10-04 20:07:08 -07:00
Noah Levitt
554dbe821b Merge pull request #67 from internetarchive/skip_youtube_dl
skip_youtube_dl
2017-09-29 15:10:10 -07:00
Barbara Miller
a86bde734f skip unnecessary assignment too 2017-09-29 15:06:36 -07:00
Barbara Miller
e6bb6791af skip unnecessary assignment 2017-09-29 14:53:24 -07:00
Barbara Miller
5e7b3b73dd skip_youtube_dl 2017-09-29 14:33:23 -07:00
Barbara Miller
5080be2d4b Merge branch 'master' of github.com:internetarchive/brozzler 2017-09-29 14:02:23 -07:00
Noah Levitt
9422fb6a26 Merge branch 'master' into qa
* master:
  fix problem where each hashtag visited causes a page load if page url redirects
  new test exposing problem where each hashtag visited causes a page load, if page redirects
2017-09-27 14:11:30 -07:00
Noah Levitt
ec847e48bc fix problem where each hashtag visited causes a page load if page url redirects 2017-09-27 14:11:20 -07:00
Noah Levitt
384c877e9a new test exposing problem where each hashtag visited causes a page load, if page redirects 2017-09-27 14:08:28 -07:00
Barbara Miller
bb54174454 skip_youtube_dl 2017-09-14 16:15:09 -07:00
Barbara Miller
407735efc4 Merge branch 'ARI-5391' into qa 2017-09-13 15:58:38 -07:00
Barbara Miller
9bb51839ad click to capture wixsite youtube 2017-09-13 15:57:58 -07:00
Barbara Miller
06c4499ec2 simpleclicks for radio-canada.ca 2017-09-11 16:19:59 -07:00
Noah Levitt
519ce4c733 Merge pull request #66 from internetarchive/ARI-5259
ARI-5259 blog.sina.com.cn pagination
2017-09-07 13:07:50 -07:00
Barbara Miller
8b074ed8d8 correct merge error 2017-09-07 10:52:39 -07:00
Barbara Miller
bd83f079a7 Merge branch 'behavior-refactor' into qa 2017-09-07 10:50:50 -07:00
Barbara Miller
03e14e3db8 checking state: first support only 'simple' behaviors 2017-09-05 16:13:58 -07:00
Barbara Miller
0a52f7fe84 first support 'simple' behaviors 2017-09-05 16:13:36 -07:00
Barbara Miller
5f0bb7b583 add limits 2017-09-05 16:13:36 -07:00
Barbara Miller
97904a0bdf umbraBehavior refactor initial commit 2017-09-05 16:12:45 -07:00
Barbara Miller
eb1f79271f blog.sin.com.cn pagination 2017-09-05 14:20:36 -07:00
Barbara Miller
71d54faae0 Merge pull request #65 from vbanos/behavior_timeout
Make behavior_timeout configurable
2017-08-31 14:39:39 -07:00
Barbara Miller
17d410f000 Merge branch 'behavior_timeout' into qa 2017-08-31 10:31:55 -07:00
Vangelis Banos
bb93b04c23 Make behavior_timeout configurable
``behavior_timeout`` is hardcoded to 900s. With this MR we make it
configurable with a default value of 900. We add a new variable to
``BrozzlerWorker`` and ``Browser``.
2017-08-31 08:06:26 +00:00
Barbara Miller
18a52f0b15 Merge pull request #64 from galgeek/typo
fix typo
2017-08-26 16:58:58 -07:00
Barbara Miller
e786013b1b fix typo 2017-08-26 16:58:00 -07:00
Barbara Miller
00b57ed87a Merge pull request #61 from internetarchive/x11-support
screenshots don't work with Xvfb
2017-08-26 16:45:50 -07:00
Neil Minton
337945004c Merge branch 'aitfive-1295' into qa 2017-08-25 10:34:51 -07:00
Neil Minton
5ad7c9c7cc Revert "Log oulinks for all users of Browser."
This reverts commit 58b95fa7bf.

It was decided that this change didn't make sense for Brozzler.
2017-08-25 10:30:42 -07:00
Barbara Miller
f810603cdf Merge pull request #63 from vbanos/configurable-page-timeout
Thank you, @vbanos!
2017-08-23 13:31:29 -07:00
Barbara Miller
96ba4f1a78 Merge branch 'configurable-page-timeout' into qa 2017-08-23 11:11:32 -07:00
Vangelis Banos
00513af877 Configurable page timeout
The page loading timeout was hard-coded to 300s. With this change,
we make it configurable with a default value of 300.
2017-08-23 08:05:14 +00:00
Neil Minton
60d7d59442 Merge branch 'ari-5426' into qa 2017-08-18 14:18:58 -07:00
Neil Minton
4733b0ac7d Update SoundCloud.com behavior selectors. 2017-08-18 14:16:51 -07:00
Neil Minton
a8a624fbbf Add Archive.org playlists to default behavior. 2017-08-18 14:16:51 -07:00
Neil Minton
b0fd1df1ef Generalize default behavior. 2017-08-18 14:16:51 -07:00
Neil Minton
12e02ae401 Merge pull request #62 from internetarchive/ARI-5460
update Instagram selectors
2017-08-17 16:08:44 -07:00
Barbara Miller
c181f4bcc3 screenshots don't work w/Xvfb 2017-08-16 15:20:43 -07:00
Barbara Miller
6391e7b40f Merge pull request #60 from galgeek/ARI-5453
simpleclicks for wixsite.com
2017-08-14 17:14:09 -07:00
Barbara Miller
901995c6cf Merge pull request #58 from internetarchive/ARI-5379
ARI 5379 URL regex update
2017-08-14 16:54:17 -07:00
Barbara Miller
36b7e4f3d6 Merge pull request #59 from galgeek/ARI-5465
skip a.uiMorePagerPrimary after all
2017-08-14 16:50:39 -07:00
Barbara Miller
b5121c26a8 simpleclicks for wixsite.com 2017-08-14 16:47:49 -07:00
Barbara Miller
12cca540bf Merge branch 'ARI-5379' of github.com:internetarchive/brozzler into ARI-5379 2017-08-11 17:17:07 -07:00
Barbara Miller
4d99ebc1b4 only div.teaser, for *pm.gc.ca* 2017-08-11 17:16:02 -07:00