Noah Levitt
|
a62a07e6b7
|
change magic first line of behavior js files to a commented-out json blob, which should include the fields 'url_regex' and 'request_idle_timeout_sec'; behavior.is_finished() incorporates the custom idle timeout into its check; also rename variables in behavior scripts with umbra/UMBRA_ prefix to sort of namespace them; and add "finished" logic to facebook and vimeo behaviors (flickr needs work to support it)
|
2014-05-05 11:58:55 -07:00 |
|
Noah Levitt
|
2a9633ad77
|
Bunch of improvements, most importantly a default fallback behavior script which scrolls to the bottom of the page, and rearchitecting some stuff so that the behavior script can have some say on when it's finished with the page. Also some doc comments.
|
2014-05-04 21:33:13 -07:00 |
|
Noah Levitt
|
9848c41d5f
|
make regexes the same that crawlman puts in crawler-beans.cxml
|
2014-03-06 18:23:31 -08:00 |
|
Eldon
|
f2f78d2ced
|
Convert from one big json file, to js files with a regex as a comment at the top.
|
2014-03-05 23:19:09 -05:00 |
|