GitHub / Spix0r / robofinder
Robofinder retrieves historical #robots.txt files from #Archive.org, allowing you to uncover previously disallowed directories and paths for any domain—essential for deepening your #OSINT and #recon process.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Spix0r%2Frobofinder
PURL: pkg:github/Spix0r/robofinder
Stars: 100
Forks: 13
Open issues: 0
License: mit
Language: Python
Size: 44.9 KB
Dependencies parsed at: Pending
Created at: about 2 years ago
Updated at: 6 months ago
Pushed at: 6 months ago
Last synced at: 6 months ago
Topics: bugbounty, bugbounty-tool, osint, osint-python, osint-resources, osint-tool, osint-tools, recon, reconnaissance