Git-Mirrors/brozzler
1
0
Fork 0
mirror of https://github.com/internetarchive/brozzler.git synced 2025-02-23 08:09:48 -05:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,611 Commits 69 Branches 15 Tags
Commit Graph

1611 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Noah Levitt
a30b5d8dd2 only reset idle timer on Network.requestWillBeSent instead of all events (otherwise long-running videos keep the browser open unnecessarily) 2014-03-06 18:35:04 -08:00
Noah Levitt
9d9014c864 start the hard stop timer 2014-03-06 18:32:30 -08:00
Noah Levitt
52db581a3c restore logging 2014-03-06 18:25:46 -08:00
Noah Levitt
12d66982d1 only load behaviors files named like *.js (avoids vim .swp files and stuff); tweak logging 2014-03-06 18:25:35 -08:00
Noah Levitt
9cb9172a4d behavior for vimeo - click on <video> elements 2014-03-06 18:24:12 -08:00
Noah Levitt
9848c41d5f make regexes the same that crawlman puts in crawler-beans.cxml 2014-03-06 18:23:31 -08:00
vonrosen
5b1992a8c0 Merge pull request #11 from eldondev/master 
Convert behaviors to independent, runnable javascript files, hard timeout on pages
 2014-03-06 11:08:45 -08:00
Eldon
393df3f16e Update behaviors for facebook theater 2014-03-05 23:44:52 -05:00
Eldon
f2f78d2ced Convert from one big json file, to js files with a regex as a comment at the top. 2014-03-05 23:19:09 -05:00
Eldon
4c22891093 Merge pull request #10 from nlevitt/master 
remove unused function
 2014-02-25 17:35:26 -05:00
Noah Levitt
b763d6550f remove unused function 2014-02-25 14:26:10 -08:00
Eldon
b4675a7cd2 Merge pull request #9 from nlevitt/master 
add behaviors, handle multiple browsers
 2014-02-25 16:23:27 -05:00
Noah Levitt
11da122ec2 remove old commented out line of code 2014-02-18 13:20:18 -08:00
Noah Levitt
b96d8856d4 create temp dir for user profile rather than rely on --temp-profile 2014-02-14 19:45:16 -08:00
Noah Levitt
b4846e1063 scrolldown seems to get everything for flickr and facebook at the moment 2014-02-14 17:57:04 -08:00
Noah Levitt
28282641f2 add a little logging 2014-02-14 15:18:10 -08:00
Noah Levitt
2368688fbe Merge remote-tracking branch 'eldondev/master' into nlevitt-master (add behaviors) 
Conflicts:
	umbra/umbra.py
 2014-02-14 15:10:23 -08:00
Noah Levitt
3389c5a66d remove some extraneous debug logging 2014-02-13 18:36:08 -08:00
Eldon
fe15932c26 Click on photos in gallery behavior 2014-02-13 13:37:08 -05:00
Eldon
af01fcbcfe Add more flickr behavior 2014-02-13 13:32:34 -05:00
Eldon
445288d5e7 First few behaviors 2014-02-13 13:10:19 -05:00
Noah Levitt
f69edd5a87 handle multiple clients, browsers 2014-02-13 01:59:09 -08:00
Noah Levitt
4dbe111aee Merge branch 'master' into nlevitt-master 2014-02-12 18:15:05 -08:00
Noah Levitt
fe1c68af90 Merge pull request #7 from eldondev/master 
Refactor to pull Chrome execution inside of umbra, simplify some things
 2014-02-12 18:13:52 -08:00
Eldon
bdf00cc515 Refactor to pull Chrome execution inside of umbra, simplify some things 2014-02-12 19:31:03 -05:00
Eldon
dd871f3a6a Merge pull request #6 from nlevitt/master 
progress and formatting changes
 2014-02-12 16:09:04 -05:00
Noah Levitt
4935d55b6e specify classifier 'Programming Language :: Python :: 3.3' since websocket-client-py3 requires python 3.3, doesn't work with 3.2 2014-02-12 12:17:41 -08:00
Noah Levitt
f9d56d3071 formatting change only - indent with 4 spaces 2014-02-10 20:45:18 -08:00
Noah Levitt
02fbe725cb cache parent url metadata and send back via amqp with child urls 2014-02-10 20:40:06 -08:00
Noah Levitt
f8c5a08c1b Merge pull request #5 from eldondev/master 
A couple of updates and intelligent defaults.
 2014-01-28 14:57:20 -08:00
Eldon
5588eedbe2 Update readme 2014-01-28 00:12:33 -05:00
Eldon
8afe7d90a2 Replace js evaluation with direct page navigation, add default for dump_queue 2014-01-28 00:10:31 -05:00
Eldon
7d89d1bed1 Merge pull request #4 from nlevitt/master 
get rid of multiple window handling, add more logging, etc
 2014-01-27 20:32:59 -08:00
Noah Levitt
8eb92b28e6 make load_url handle arguments similarly to umbra 2014-01-27 19:34:54 -08:00
Noah Levitt
e9f6408881 improved browser ownership locking 2014-01-27 19:24:28 -08:00
Noah Levitt
ae2c3668a9 get rid of multiple window handling, add more logging, clean shutdown on ctrl+c, other tweaks 2014-01-27 19:15:31 -08:00
Noah Levitt
0c6a206f3f Merge pull request #1 from eldondev/master 
Pull request for initial commits around umbra
 2014-01-23 17:53:11 -08:00
Eldon
bd0183058d Inccognito messes with currently running chromium instances, disable it 2014-01-23 18:26:20 -05:00
Eldon
0c25bbb4c3 Raise exception if we are never able to connect to the browser 2014-01-23 16:28:52 -05:00
Eldon
ca3d6d5999 Raise an exception if no browser starts 2014-01-23 16:24:53 -05:00
Eldon
4852fbf29f Update setup.py, get rid of unused dependency 2014-01-23 16:18:13 -05:00
Eldon
05b6e7c827 Merged 2014-01-23 15:21:38 -05:00
Eldon
ed31c93c21 Make room for the real readme 2014-01-23 15:20:11 -05:00
Eldon
fa8f4f5c08 Create README.md 2014-01-23 15:14:53 -05:00
Eldon
fdfaf496a9 Incognito mode prevents local caching 2014-01-23 19:25:55 +00:00
Eldon
09b0060137 Add additional checks for weird chrome behavior, serialize requests 2014-01-23 18:39:17 +00:00
Eldon
6dc20e660f Remove debugging output, improve support scripts 2014-01-22 18:41:00 +00:00
Eldon
4e38a142d4 Some refactor/testing and utility scripts 2014-01-22 18:03:02 +00:00
Eldon
e0a2917b81 Add amqp connectivity 2014-01-22 07:38:03 +00:00
Eldon
5a6749777b It appears to be possible for the debug port to open without any tabs, so we should handle that. 2014-01-22 02:38:51 +00:00