Create tricks.md

This commit is contained in:
dr. mia von steinkirch, phd 2023-02-14 07:52:41 -08:00 committed by GitHub
parent 26f9448588
commit e402bc5e98
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -0,0 +1,11 @@
### tricks
<br>
#### cex
* craw relays by requesting through a network of proxies to not get ratelimited (for example, by cloudflare ~5 seconds).
* maintain an in-memory list of endpoints that are predicted to be cached, so only use the ones that are predicted to be uncached.
* [proxymesh: rotating anonynous http proxy servers](https://proxymesh.com/)
<br>