WebHackersWeapons/categorize/tags/crawl.md

3.6 KiB

Tools for crawl

Type Name Description Star Tags Badges
Army-Knife BurpSuite The BurpSuite Project mitmproxy live-audit crawl linuxmacoswindowsburpJava
Army-Knife ZAP The ZAP core project mitmproxy live-audit crawl linuxmacoswindowszapJava
Recon gospider Gospider - Fast web spider written in Go crawl linuxmacoswindowsGo
Recon Photon Incredibly fast crawler designed for OSINT. osint crawl linuxmacoswindowsPython
Recon crawlergo A powerful browser crawler for web vulnerability scanners crawl linuxmacoswindowsGo
Recon hakrawler Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application crawl linuxmacoswindowsGo
Recon cariddi Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more crawl linuxmacoswindowsGo
Recon katana A next-generation crawling and spidering framework. crawl linuxmacoswindowsGo
Utils security-crawl-maze Security Crawl Maze is a comprehensive testbed for web security crawlers. It contains pages representing many ways in which one can link resources from a valid HTML document. crawl linuxmacoswindowsHTML