Noah Levitt
|
02bf23059e
|
pass behavior_parameters from job configuration into Site objects
|
2016-11-09 13:43:10 -08:00 |
|
Noah Levitt
|
8e115b44fa
|
add --behavior-parameters argument to brozzler-new-site
|
2016-11-09 13:12:36 -08:00 |
|
Noah Levitt
|
953e50d9a6
|
fix bug in final_bounces (not sure what I was thinking)
|
2016-11-09 13:12:14 -08:00 |
|
Noah Levitt
|
054cb255ac
|
cat logs on travis-ci failure
|
2016-11-08 14:26:12 -08:00 |
|
Noah Levitt
|
125a31165a
|
reppy 0.4.1 has a significantly different api apparently, so for now let's go back to 0.3.4
|
2016-11-08 14:11:46 -08:00 |
|
Noah Levitt
|
fe18d915f5
|
still trying to get installation of pip to work on travis-ci
|
2016-11-08 13:50:12 -08:00 |
|
Noah Levitt
|
f10b4c71e6
|
update for reppy api change and pin to current version of reppy
|
2016-11-08 13:39:32 -08:00 |
|
Noah Levitt
|
cba5fa4a0b
|
tweaks to ansible config to try to get the deployment to run on travis-ci
|
2016-11-08 13:31:52 -08:00 |
|
Noah Levitt
|
9d66f294ec
|
move behavior_parameters into top level of site configuration
|
2016-11-07 18:16:04 -08:00 |
|
Noah Levitt
|
abca90a128
|
install the virtualenv package with pip because the apt version is old and conflicts with the recent version of pip we're using
|
2016-11-07 17:51:43 -08:00 |
|
Noah Levitt
|
99feeab581
|
logging tweak
|
2016-11-04 17:53:02 -07:00 |
|
Noah Levitt
|
5ac8994a24
|
rename webconsole to dashboard
|
2016-11-04 17:46:23 -07:00 |
|
Noah Levitt
|
5bd4908e1d
|
punycode host part of url to avoid errors doing WARCPROX_WRITE_RECORD
|
2016-10-26 13:50:23 -07:00 |
|
Noah Levitt
|
f30c143c66
|
avoid exception in case of url without host part
|
2016-10-26 12:45:24 -07:00 |
|
Noah Levitt
|
332912acd7
|
apparently response.status doesn't work sometimes; response.getcode() is documented so hopefully it keeps working
|
2016-10-25 17:50:49 -07:00 |
|
Noah Levitt
|
70ce642bee
|
integer job ids are permitted as well as string
|
2016-10-21 21:25:16 +00:00 |
|
Noah Levitt
|
21891476c4
|
avoid use of __double_underscore member variables because they're special https://shahriar.svbtle.com/underscores-in-python
|
2016-10-18 18:57:11 -07:00 |
|
Noah Levitt
|
becd832ea3
|
bump version after merging accept-encoding pull request
|
2016-10-18 17:55:00 -07:00 |
|
Noah Levitt
|
aae34452f5
|
bump version number after merging travis-ci pull request
|
2016-10-18 17:48:45 -07:00 |
|
Noah Levitt
|
68a32fcbe2
|
bump version number after mouse's pull request
|
2016-10-18 17:45:55 -07:00 |
|
Noah Levitt
|
a370e7b987
|
tiny fix, and now the test passes for me
|
2016-10-14 19:21:26 -07:00 |
|
Noah Levitt
|
4044fcb647
|
fix pywb/brozzler replay of revisit records
|
2016-10-14 19:15:23 -07:00 |
|
Noah Levitt
|
27452990ee
|
toward getting initial tests to pass
|
2016-10-14 18:26:48 -07:00 |
|
Noah Levitt
|
5a373466a3
|
some vagrant/ansible fixes
|
2016-10-14 13:47:54 -07:00 |
|
Noah Levitt
|
3627209be1
|
move ansible directory to top level; generalize formerly vagrant-specific ansible configuration; let upstart manage logging with "console log"
|
2016-10-13 17:21:55 -07:00 |
|
Noah Levitt
|
56e651baeb
|
working on basic integration tests
|
2016-10-13 17:12:35 -07:00 |
|
Noah Levitt
|
ed8b937277
|
back to dev version
|
2016-10-13 15:11:57 -07:00 |
|
Noah Levitt
|
456c082875
|
this is 1.1b6
|
2016-10-13 15:10:24 -07:00 |
|
Noah Levitt
|
23b59f8f4e
|
Merge branch 'master' of github.com:internetarchive/brozzler
* 'master' of github.com:internetarchive/brozzler:
Ensure job_schema.yaml is installed by pip
|
2016-10-13 15:00:13 -07:00 |
|
Noah Levitt
|
269512f499
|
make setup.py work with python2, not because the whole project works with python2, but just so it can be installed as a dependency of projects that support both python2 and python3
|
2016-10-13 14:59:31 -07:00 |
|
Noah Levitt
|
d82b40be68
|
fix typo
|
2016-10-06 18:20:41 -07:00 |
|
Alex Osborne
|
0fe2ef9387
|
Ensure job_schema.yaml is installed by pip
Use .yaml file extension for consistency with behaviors.yaml.
|
2016-10-05 15:45:11 +11:00 |
|
Noah Levitt
|
59a15d7f5c
|
bump dev version after merging pull requests
|
2016-10-04 14:43:43 -07:00 |
|
Alex Osborne
|
5ac67fe513
|
Validate job conf against a Cerberus schema
|
2016-10-04 21:19:25 +11:00 |
|
Noah Levitt
|
15633be612
|
finish vagrant-brozzler-new-job.py
|
2016-10-03 18:17:35 -07:00 |
|
Noah Levitt
|
de5c520ad7
|
pin psutil version, too
|
2016-10-03 17:12:00 -07:00 |
|
Noah Levitt
|
f220707aa4
|
pin pillow to version 3.3.0, primarily because we have a wheel in devpi for that version
|
2016-10-03 17:06:58 -07:00 |
|
Noah Levitt
|
0e096dd4e4
|
don't try to read the browser's cookie database if the browser hasn't been started (which can happen if the page is simply fetched rather than browsed because it's not html)
|
2016-10-03 15:03:08 -07:00 |
|
Noah Levitt
|
bfd4c1f8c6
|
document a bunch of job settings
|
2016-09-29 16:15:44 -07:00 |
|
Noah Levitt
|
8c9a9c5666
|
starting on documenting job configuration
|
2016-09-29 12:03:16 -07:00 |
|
Noah Levitt
|
2462efc4ed
|
replace vagrant-brozzler-new-site with python script that fills in default options and passes through others
|
2016-09-22 01:47:23 +01:00 |
|
Noah Levitt
|
cc9517cb45
|
add missing rethinkdb config file to ansible config
|
2016-09-22 01:45:28 +01:00 |
|
Noah Levitt
|
253122d061
|
new script runs brozzler-new-site queues a new site to brozzle on the vagrant brozzler deployment
|
2016-09-16 16:35:44 -07:00 |
|
Noah Levitt
|
38af0f347b
|
working on including pywb in vagrant environment (not finished)
|
2016-09-14 17:08:00 -07:00 |
|
Noah Levitt
|
c864499a64
|
starting to create a framework for testing
|
2016-09-14 17:06:49 -07:00 |
|
Noah Levitt
|
be27b4e16e
|
header comment tweak
|
2016-09-14 17:04:32 -07:00 |
|
Noah Levitt
|
85073ab82b
|
new prog "brozzler-wayback" runs monkey-patched pywb
|
2016-09-14 17:04:01 -07:00 |
|
Noah Levitt
|
1c5c9417d2
|
avoid "Uncaught TypeError: Cannot read property 'querySelectorAll' of undefined" from outlinks script
|
2016-08-25 13:10:30 -07:00 |
|
Noah Levitt
|
ed7e01210d
|
little readme fix
|
2016-08-12 17:02:41 -07:00 |
|
Noah Levitt
|
c9bc9fb67d
|
for vagrant, static ansible inventory file, add brozzler-webconsole
|
2016-08-10 18:41:23 -07:00 |
|