WebHackersWeapons/categorize/tags/crawl.md

3.6 KiB

Tools for crawl

Type Name Description Star Tags Badges
Army-Knife BurpSuite The BurpSuite Project mitmproxy live-audit crawl linuxmacoswindowsburpJava
Army-Knife ZAP The ZAP core project mitmproxy live-audit crawl linuxmacoswindowszapJava
Recon Photon Incredibly fast crawler designed for OSINT. osint crawl linuxmacoswindowsPython
Recon gospider Gospider - Fast web spider written in Go crawl linuxmacoswindowsGo
Recon katana A next-generation crawling and spidering framework. crawl linuxmacoswindowsGo
Recon cariddi Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more crawl linuxmacoswindowsGo
Recon hakrawler Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application crawl linuxmacoswindowsGo
Recon crawlergo A powerful browser crawler for web vulnerability scanners crawl linuxmacoswindowsGo
Utils security-crawl-maze Security Crawl Maze is a comprehensive testbed for web security crawlers. It contains pages representing many ways in which one can link resources from a valid HTML document. crawl linuxmacoswindowsHTML