Git-Mirrors/PushshiftDumps
1
0
Fork 0
mirror of https://github.com/Watchful1/PushshiftDumps.git synced 2025-07-22 22:30:49 -04:00
Code Issues Projects Releases Packages Wiki Activity

Update logging a bit

Browse source
This commit is contained in:
Watchful1 2024-08-11 20:14:56 -07:00
parent bda7a4c8d6
commit 99ae19f690
3 changed files with 12 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

1
personal/combine/merge_and_backfill.py
View file

@ -103,6 +103,7 @@ def query_pushshift(ids, bearer, object_type, pushshift_token_function):
time.sleep(2)
if response.status_code != 200:
log.warning(f"4 requests failed with status code {response.status_code}")
discord_logging.flush_discord()
sys.exit(1)
return response.json()['data'], bearer