mirror of
https://github.com/hahwul/WebHackersWeapons.git
synced 2024-06-29 07:52:08 +00:00
12 lines
2.1 KiB
Markdown
12 lines
2.1 KiB
Markdown
|
|
## Tools for crawl
|
|
|
|
| Type | Name | Description | Star | Tags | Badges |
|
|
| --- | --- | --- | --- | --- | --- |
|
|
|Recon|[cariddi](https://github.com/edoardottt/cariddi)|Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more||[`crawl`](/categorize/tags/crawl.md)|[](/categorize/langs/Go.md)|
|
|
|Recon|[crawlergo](https://github.com/Qianlitp/crawlergo)|A powerful browser crawler for web vulnerability scanners||[`crawl`](/categorize/tags/crawl.md)|[](/categorize/langs/Go.md)|
|
|
|Recon|[gospider](https://github.com/jaeles-project/gospider)|Gospider - Fast web spider written in Go ||[`crawl`](/categorize/tags/crawl.md)|[](/categorize/langs/Go.md)|
|
|
|Recon|[Photon](https://github.com/s0md3v/Photon)|Incredibly fast crawler designed for OSINT. ||[`osint`](/categorize/tags/osint.md) [`crawl`](/categorize/tags/crawl.md)|[](/categorize/langs/Python.md)|
|
|
|Utils|[security-crawl-maze](https://github.com/google/security-crawl-maze)|Security Crawl Maze is a comprehensive testbed for web security crawlers. It contains pages representing many ways in which one can link resources from a valid HTML document.||[`crawl`](/categorize/tags/crawl.md)|[](/categorize/langs/HTML.md)|
|
|
|