Update README.md

This commit is contained in:
dr. mia von steinkirch, phd 2023-02-14 07:52:23 -08:00 committed by GitHub
parent c2a333db0d
commit 26f9448588
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23

View file

@ -13,21 +13,19 @@
<br>
### tricks
---
### in this dir
<br>
#### cex
* craw relays by requesting through a network of proxies to not get ratelimited (for example, by cloudflare ~5 seconds).
* maintain an in-memory list of endpoints that are predicted to be cached, so only use the ones that are predicted to be uncached.
* [proxymesh: rotating anonynous http proxy servers](https://proxymesh.com/)
* [tricks](tricks)
<br>
---
### resources
### links
<br>