Misty De Méo
a23dd6a923
chore: use ruff for formatting
...
There are a few minor changes here compared to black; it flagged
unnecessary string concatenations, and has slightly different
opinions on line length.
2025-03-05 11:12:46 -08:00
Misty De Méo
ab8970ff3e
test: add CI ( #329 )
...
This adds two CI runs: a quick one that happens for every pull
request and merge to master, and a longer one that happens daily.
This also adds a new installation group to setup.py because the
`easy` group isn't currently installable, and some of the dependencies
specified there need to be present for the tests to run.
2025-03-04 09:34:53 -08:00
Barbara Miller
968cac0e10
Merge branch 'barbara/rm_workflow_maybe' into qa
2025-03-03 14:46:47 -08:00
Barbara Miller
e6332c7f94
unused
2025-03-03 14:41:30 -08:00
Adam Miller
39b695dc70
Merge pull request #320 from internetarchive/adam/chrome-flags-disable-optimization-model-downloads
...
feat: add chrome flag to disable download of autocomplete optimizatio…
2025-03-03 14:09:29 -08:00
Barbara Miller
f4b4b4d6bb
fix merge error
2025-03-03 14:07:30 -08:00
Barbara Miller
7580a32783
Merge remote-tracking branch 'upstream/adam/chrome-flags-disable-optimization-model-downloads' into qa
2025-03-03 14:04:47 -08:00
Adam Miller
ccfadc87c8
combine disable-features flags
2025-03-03 13:58:48 -08:00
Misty De Méo
3ddb1beb17
deps: remove easy group ( #331 )
...
This group isn't actually installable right now because of the jinja
dependency conflict.
2025-03-03 09:25:17 -08:00
Misty De Méo
e37c0ad78c
deps: remove easy group ( #331 )
...
This group isn't actually installable right now because of the jinja
dependency conflict.
2025-03-03 09:24:52 -08:00
Gretchen Leigh Miller
6ca1a62489
update minimum Python version in README ( #327 )
Publish Artifacts / Build distribution 📦 (push) Has been cancelled
Python Formatting Check / formatting (push) Has been cancelled
2025-02-25 12:08:35 -08:00
Misty De Méo
c0a4412d80
Merge branch 'logging' into qa
2025-02-24 16:31:26 -08:00
Misty De Méo
23cee477dc
feat: set up structlog logging ( #325 )
...
Publish Artifacts / Build distribution 📦 (push) Waiting to run
Python Formatting Check / formatting (push) Waiting to run
This ports the logging from `logging` to `structlog`. This updates
all of the logger instantiations along with all of the places
`logging` was called. Data that was being inlined into log statements
has been broken out so that it's now structured arguments to the
log statements instead.
2025-02-24 16:31:09 -08:00
Misty De Méo
c6001d8799
cli: move logger name comment to docstring
2025-02-24 16:28:53 -08:00
Misty De Méo
72e4c29982
setup.py: bump qa version
2025-02-24 11:42:24 -08:00
Misty De Méo
3cdb62ab81
Merge branch 'logging' into qa
2025-02-24 11:42:05 -08:00
Misty De Méo
e141543667
logging: exception is a magic keyword
2025-02-24 11:41:51 -08:00
Misty De Méo
464aa201e4
Stop newline-joining log params
2025-02-21 16:18:06 -08:00
Misty De Méo
25256db003
Merge branch 'logging' into qa
2025-02-21 10:15:12 -08:00
Misty De Méo
baefea7b8e
logging: use UTC
2025-02-21 10:14:38 -08:00
Misty De Méo
4b93e20737
chrome: clarify units
2025-02-21 10:08:12 -08:00
Misty De Méo
6f8ad56618
remove unnecessary json encode
2025-02-21 10:08:01 -08:00
Misty De Méo
e1fccb261b
pass logger_name in remaining places
2025-02-21 10:07:43 -08:00
Misty De Méo
a35ad276aa
bump qa version
2025-02-21 09:28:02 -08:00
Misty De Méo
5f1e92c23f
Merge branch 'logging' into qa
2025-02-21 09:27:44 -08:00
Misty De Méo
b79054d27e
logging: decorate location with callsite
2025-02-21 09:22:54 -08:00
Misty De Méo
f21245384e
cli: add comment to logging.basicConfig
2025-02-21 09:17:05 -08:00
Misty De Méo
45f352dc86
add logger name to event dict
2025-02-21 09:17:05 -08:00
Misty De Méo
564307c7f8
worker: add thread to the binding
2025-02-21 09:17:05 -08:00
Misty De Méo
5bf831605a
tests: remove unneeded logging setup
...
This was added in 7706bab8b8
2025-02-21 09:17:05 -08:00
Misty De Méo
626a9530c9
remove trace monkeypatch
2025-02-21 09:17:05 -08:00
Misty De Méo
39c889db47
cluster tests: structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
32b90f7029
black formatting
2025-02-21 09:17:05 -08:00
Misty De Méo
3cdefc0779
cli: set up structlog config
2025-02-21 09:17:05 -08:00
Misty De Méo
b723ab6db5
cli: initial conversion
2025-02-21 09:17:05 -08:00
Misty De Méo
715b16dbc4
dashboard: everything except gunicorn
2025-02-21 09:17:05 -08:00
Misty De Méo
ec268af922
worker: catch some missing statements
2025-02-21 09:17:05 -08:00
Misty De Méo
b33b2fed8c
robots: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
ba0db01d32
pywb: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
7634eb1b57
model: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
d4b493f1ae
frontier: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
cf6b423019
easy: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
19dd7c97f0
chrome: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
97f225d54c
browser: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
a7e915b35f
__init__: port logging statements
2025-02-21 09:17:05 -08:00
Misty De Méo
712ecb9690
worker: port trace/notice
2025-02-21 09:17:05 -08:00
Misty De Méo
9bf9cf1382
convert ydl module logger
2025-02-21 09:17:05 -08:00
Misty De Méo
715a1471c0
initial stab at worker
2025-02-19 14:48:34 -08:00
Misty De Méo
69d682beb9
Merge pull request #324 from mistydemeo/mdfind
...
Publish Artifacts / Build distribution 📦 (push) Has been cancelled
Python Formatting Check / formatting (push) Has been cancelled
CLI: improve Chrome finding on Mac
2025-02-19 14:48:21 -08:00
Misty De Méo
53cac65540
CLI: improve Chrome finding on Mac
...
On macOS, we can find Chrome even if it's installed in a non-default
path by querying `mdfind`. This is the CLI entrypoint to Spotlight,
and we can use it to look up applications using their unique bundle
identifiers.
If `mdfind` fails to find anything, this falls back to the hardcoded
paths. This should ensure this still works if Spotlight indexing is
off, but Chrome is in the default path.
2025-02-19 13:55:18 -08:00
