169 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Watchful1	b102a57b8a	Logging	2023-09-13 21:50:31 -07:00
Watchful1	34c0f93fe1	Save pushshift token, write to discord	2023-09-13 21:48:02 -07:00
Watchful1	e119573d1c	mobile_ad_url	2023-09-13 16:47:04 -07:00
Watchful1	c3b8f0c8af	Log the reauth response	2023-09-13 10:06:12 -07:00
Watchful1	91159f0509	Add merge field	2023-09-13 10:05:32 -07:00
Watchful1	9595fa7e40	First attempt at pushshift re_auth	2023-09-06 12:19:20 -04:00
Watchful1	e1aa8aeda7	edited_on	2023-09-01 17:21:38 -07:00
Watchful1	cb1cefb563	Will have to rethink that	2023-08-31 14:49:24 -07:00
Watchful1	01170ebbdc	Restructure this to catch errors	2023-08-31 14:46:28 -07:00
Watchful1	ac936cd564	Subreddit names can change	2023-08-31 11:23:18 -07:00
Watchful1	dd838aae3e	Wrong exception	2023-08-29 20:49:42 -07:00
Watchful1	1c89f42fbb	Catch this one too	2023-08-29 19:03:17 -07:00
Watchful1	92ac7b7a35	Catch connection errors here	2023-08-28 19:36:25 -07:00
Watchful1	361f35a49e	ad_promoted_user_posts	2023-08-28 09:39:40 -07:00
Watchful1	9376b45f44	We can't support minutes for the end here	2023-08-27 20:10:21 -07:00
Watchful1	9ad5d9c06f	Build by minute so we don't have to redo a whole day if there's a problem	2023-08-27 20:08:36 -07:00
Watchful1	3d453dc6e5	Embed	2023-08-27 17:29:24 -07:00
Watchful1	5aa8f127c4	Discussion type	2023-08-27 11:38:58 -07:00
Watchful1	a2bf7e7927	Evidently this can change. Who knew	2023-08-26 23:09:18 -07:00
Watchful1	2875b227b2	Change pushshift token to command link	2023-08-26 20:46:09 -07:00
Watchful1	cf4962fd4c	Clean up	2023-08-26 20:18:38 -07:00
Watchful1	4f56c141fd	Re-arrange a bit	2023-08-26 17:09:50 -07:00
Watchful1	de209b338a	Move streamer files in	2023-08-26 17:03:35 -07:00
Watchful1	4f1d70d34a	Reorganize	2023-08-26 16:52:58 -07:00
Watchful1	3700b21b81	Add count fields	2023-08-26 16:37:55 -07:00
Watchful1	8a0256285f	Update comment	2023-08-22 22:13:37 -07:00
Watchful1	d7beff9a08	Support multiple files in filter_file	2023-08-22 22:12:30 -07:00
Watchful1	0827eee152	Evidently this is a string sometimes	2023-08-22 19:43:38 -07:00
Watchful1	78c1814a60	Support empty filter	2023-08-21 21:45:58 -07:00
Watchful1	f7146593a0	Log on bad lines too	2023-08-09 19:42:56 -07:00
Watchful1	4110374fe8	Add more logging to filter file	2023-08-09 19:38:16 -07:00
Watchful1	4a50ca6605	Add overlapping users finder	2023-05-25 18:28:37 -07:00
Watchful1	897332b1d7	Update filter file with id output and filter by input list	2023-05-25 18:13:05 -07:00
Watchful1	e103298be3	Update iterate folder with the new decode method	2023-03-16 18:26:40 -07:00
Watchful1	f7286b7572	Full redesign of multiprocess	2023-03-08 17:48:59 -08:00
Watchful1	31ad7179dc	Update the parse here, switch to counting instead of adding scores	2023-03-08 17:48:48 -08:00
Watchful1	1f7a3137f4	Update multiprocess to handle large numbers of output files	2023-03-06 20:37:15 -08:00
Watchful1	8dcc65abf7	Initial work on filter file	2023-03-02 18:41:50 -08:00
Watchful1	c7aa694631	Bit of other work	2023-03-01 21:06:34 -08:00
Watchful1	2bae2a38d2	Add citation file	2023-02-13 16:31:55 -08:00
Watchful1	65819999de	Merge remote-tracking branch 'origin/master'	2023-02-13 16:31:16 -08:00
Watchful1	eb488e5073	Merge pull request #9 from Watchful1/add-license-1 ... Create LICENSE.md	2023-02-12 21:49:04 -08:00
Watchful1	32e42cbd03	Create LICENSE.md	2023-02-12 21:48:49 -08:00
Watchful1	8282a5e765	Count matched lines	2023-01-30 17:53:02 -08:00
Watchful1	ba6da35b37	Fix other chunk sizing	2023-01-30 17:05:22 -08:00
Watchful1	4e8d6c9b6b	Fix to_csv chunk sizing	2023-01-30 17:05:03 -08:00
Watchful1	33b5b938c1	Change to FileHandle	2023-01-28 11:39:27 -08:00
Watchful1	87d2b22a73	Change the pool chunksize to 1 to reduce parallelization	2023-01-24 20:52:53 -08:00
Watchful1	52d65e3c8d	Short script to sort the subreddit counts	2023-01-24 20:51:39 -08:00
Watchful1	2358bf555b	Add value_list argument to take a large list of values to filter on	2023-01-24 20:51:10 -08:00