Git-Mirrors/PushshiftDumps
1
0
Fork 0
mirror of https://github.com/Watchful1/PushshiftDumps.git synced 2025-07-23 23:00:40 -04:00
Code Issues Projects Releases Packages Wiki Activity

Bit of cleanup for to_csv

Browse source
This commit is contained in:
Watchful1 2024-02-04 20:32:03 -08:00
parent 591c4a21f6
commit 09334829f6
4 changed files with 39 additions and 13 deletions
Download patch file Download diff file Expand all files Collapse all files

4
scripts/find_overlapping_users.py
View file

@ -7,8 +7,8 @@ import zstandard
import json
input_files = [
r"\\MYCLOUDPR4100\Public\reddit\subreddits\srilanka_comments.zst",
r"\\MYCLOUDPR4100\Public\reddit\subreddits\Warthunder_comments.zst",
r"\\MYCLOUDPR4100\Public\reddit\subreddits23\Chattanooga_comments.zst",
r"\\MYCLOUDPR4100\Public\reddit\subreddits23\Graffiti_comments.zst",
]
ignored_users = ['[deleted]', 'automoderator']
min_comments_per_sub = 1