Misty De Méo
e1fccb261b
pass logger_name in remaining places
2025-02-21 10:07:43 -08:00
Misty De Méo
b79054d27e
logging: decorate location with callsite
2025-02-21 09:22:54 -08:00
Misty De Méo
f21245384e
cli: add comment to logging.basicConfig
2025-02-21 09:17:05 -08:00
Misty De Méo
45f352dc86
add logger name to event dict
2025-02-21 09:17:05 -08:00
Misty De Méo
564307c7f8
worker: add thread to the binding
2025-02-21 09:17:05 -08:00
Misty De Méo
5bf831605a
tests: remove unneeded logging setup
...
This was added in 7706bab8b824e0a18c2e883b712966faf2c5b271 to support
some test logging in the same commit. The log statements have since
been removed.
2025-02-21 09:17:05 -08:00
Misty De Méo
626a9530c9
remove trace monkeypatch
2025-02-21 09:17:05 -08:00
Misty De Méo
39c889db47
cluster tests: structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
32b90f7029
black formatting
2025-02-21 09:17:05 -08:00
Misty De Méo
3cdefc0779
cli: set up structlog config
2025-02-21 09:17:05 -08:00
Misty De Méo
b723ab6db5
cli: initial conversion
2025-02-21 09:17:05 -08:00
Misty De Méo
715b16dbc4
dashboard: everything except gunicorn
2025-02-21 09:17:05 -08:00
Misty De Méo
ec268af922
worker: catch some missing statements
2025-02-21 09:17:05 -08:00
Misty De Méo
b33b2fed8c
robots: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
ba0db01d32
pywb: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
7634eb1b57
model: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
d4b493f1ae
frontier: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
cf6b423019
easy: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
19dd7c97f0
chrome: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
97f225d54c
browser: convert to structlog
2025-02-21 09:17:05 -08:00
Misty De Méo
a7e915b35f
__init__: port logging statements
2025-02-21 09:17:05 -08:00
Misty De Méo
712ecb9690
worker: port trace/notice
2025-02-21 09:17:05 -08:00
Misty De Méo
9bf9cf1382
convert ydl module logger
2025-02-21 09:17:05 -08:00
Misty De Méo
715a1471c0
initial stab at worker
2025-02-19 14:48:34 -08:00
Misty De Méo
69d682beb9
Merge pull request #324 from mistydemeo/mdfind
...
Publish Artifacts / Build distribution 📦 (push) Has been cancelled
Python Formatting Check / formatting (push) Has been cancelled
CLI: improve Chrome finding on Mac
2025-02-19 14:48:21 -08:00
Misty De Méo
53cac65540
CLI: improve Chrome finding on Mac
...
On macOS, we can find Chrome even if it's installed in a non-default
path by querying `mdfind`. This is the CLI entrypoint to Spotlight,
and we can use it to look up applications using their unique bundle
identifiers.
If `mdfind` fails to find anything, this falls back to the hardcoded
paths. This should ensure this still works if Spotlight indexing is
off, but Chrome is in the default path.
2025-02-19 13:55:18 -08:00
Barbara Miller
591ba3c95a
bump version
Publish Artifacts / Build distribution 📦 (push) Has been cancelled
Python Formatting Check / formatting (push) Has been cancelled
2025-02-14 13:05:38 -08:00
Barbara Miller
c63f4296a6
Merge pull request #323 from galgeek/bmiller/better_fetch_url_timeout_errors
...
better error handling for _fetch_url
2025-02-14 12:40:04 -08:00
Barbara Miller
71ffbddfeb
log _fetch_url completion
2025-02-14 10:38:24 -08:00
Barbara Miller
ba7031f2da
better exceptions for fetch_url
2025-02-14 09:39:41 -08:00
Barbara Miller
732a7943f0
http, not https, maybe
2025-02-13 17:57:53 -08:00
Barbara Miller
819a483227
black'd
2025-02-13 17:55:36 -08:00
Barbara Miller
9dca200230
cert_reqs="CERT_NONE"
2025-02-13 16:27:05 -08:00
Barbara Miller
4af48be6ca
use urllib3
2025-02-13 16:11:22 -08:00
Barbara Miller
2c9c040b84
black'd
2025-02-13 14:24:27 -08:00
Barbara Miller
53a1869def
better error handling for _fetch_url
2025-02-13 14:21:24 -08:00
Barbara Miller
5fccdd83e3
bump version to 1.6.8
Publish Artifacts / Build distribution 📦 (push) Has been cancelled
Python Formatting Check / formatting (push) Has been cancelled
2025-02-11 17:34:14 -08:00
Barbara Miller
bfc85f5e89
Merge pull request #322 from galgeek/bmiller/more_better_requests
...
requests timeout for fetch_url, plus user_agent
2025-02-11 17:33:14 -08:00
Barbara Miller
ca79c3a329
minor logging fix
2025-02-11 17:28:18 -08:00
Barbara Miller
430c0daf39
catch and log more exceptions on fetch_url error
2025-02-11 12:51:26 -08:00
Barbara Miller
561e0803c6
requests timeout and user_agent
2025-02-11 12:27:50 -08:00
Barbara Miller
65de0d2a5f
timeout for fetch_url
2025-02-09 11:13:03 -08:00
Adam Miller
7ededbc521
Merge pull request #318 from internetarchive/adam/get-page-header-timeout
...
Publish Artifacts / Build distribution 📦 (push) Has been cancelled
Python Formatting Check / formatting (push) Has been cancelled
feat: add timeout to header check
2025-02-06 11:22:28 -08:00
Adam Miller
8ed517c1c0
chore: bump version
2025-02-06 11:19:23 -08:00
Adam Miller
3afc63242b
fix: syntax bug on HEADER_REQUEST_TIMEOUT
2025-02-05 12:38:41 -08:00
Adam Miller
c5844dfdd6
chore: cleanup unused variable
2025-02-04 16:36:23 -08:00
Adam Miller
0feac5cd07
feat: add timeout to header check
2025-02-04 16:21:28 -08:00
Barbara Miller
df4bd148d5
bump version and update copyright
Publish Artifacts / Build distribution 📦 (push) Has been cancelled
Python Formatting Check / formatting (push) Has been cancelled
2025-01-23 16:26:16 -08:00
Barbara Miller
a749b2968b
Merge pull request #316 from galgeek/bmiller/shorter_behavior_timeout
...
shorter behavior timeout
2025-01-23 15:37:29 -08:00
Barbara Miller
5e701e9dbe
Merge pull request #315 from galgeek/bmiller/proxy_select
...
yt-dlp proxy handling update
2025-01-23 15:37:01 -08:00
