Barbara Miller
bc6a2f4b95
handle http auth ( #138 )
...
abort brozzling on insterstial (auth dialog)
because we have no other recourse at this point. waiting on Network.requestIntercepted auth challenge support. (didn't work in our latest testing)
https://chromedevtools.github.io/devtools-protocol/tot/Network#type-AuthChallengeResponse
2018-11-16 22:30:49 -08:00
Noah Levitt
27ba877932
Merge branch 'master' into qa
...
* master:
handle exceptions extracting links
fix reported chromium crash by removing argument
bump version after merge
remove stray bad logging line
tests expect outlinks to be a set
tidy up some comments and docs
watch pages as outlinks from youtube-dl playlists
silence youtube-dl's logging, use only our own
use a thread-local callback in monkey-patched
skip downloading videos from youtube playlists
trace-level logging for all the chrome output
2018-10-29 17:45:09 -07:00
Barbara Miller
181e7ab85d
page.interstitial exception test
2018-10-17 17:23:50 -07:00
Noah Levitt
7497b7e5ac
tests expect outlinks to be a set
2018-10-12 11:03:54 -07:00
Noah Levitt
d7512fbeb6
move time limit enforcement
...
now it's next to stop request enforcement which makes more sense and
supports more timely action
2018-03-01 11:28:30 -08:00
Noah Levitt
b81cc4eb0a
remove stray pdb line
2017-11-08 17:03:54 -08:00
Noah Levitt
133726e942
test a real-ish mpd
2017-11-08 17:01:27 -08:00
Barbara Miller
e8fdf84db8
add test--not a Video
2017-11-07 17:23:51 -08:00
Noah Levitt
ac972d399f
fix robots.txt proxy down test by setting site.id (cached robots is stored by site.id, and other tests that ran earlier with no site.id were interfering); and test another kind of connection error, for whatever that's worth
2017-04-18 12:00:23 -07:00
Noah Levitt
349b41ab32
raise new exception brozzler.ProxyError in case of proxy error browsing a page
2017-04-17 18:14:02 -07:00
Noah Levitt
5bcd10c228
extract area/@href links, and add test for outlink extraction
2017-04-05 12:09:48 -07:00
Noah Levitt
e9c7606318
oops remove pdb call
2017-03-20 12:14:11 -07:00
Noah Levitt
13130bd9d9
save info about embedded videos in page document in rethinkdb
2017-03-20 11:49:11 -07:00
Noah Levitt
5375b819dd
missed a spot
2017-01-20 23:59:31 -08:00
Noah Levitt
011d814ee2
tests for dismissal of javascript dialogs (alert, prompt, confirm)
2017-01-13 11:46:42 -08:00
Noah Levitt
70b67942a5
restore handling of 420 Reached limit, with a rudimentary test
2016-12-22 13:44:09 -08:00
Noah Levitt
e5fb6cb4b9
add import missing from test
2016-12-21 19:19:34 -08:00
Noah Levitt
eabb0fb114
restore support for on_response and on_request, with an automated test for on_response
2016-12-21 18:35:55 -08:00
Noah Levitt
f7427219cf
restore handling of "aw snap" or "he's dead jim"
2016-12-21 14:21:20 -08:00