waybackrobots
Enumerate old versions of robots.txt paths using Wayback Machine for content discovery
Details
Category: Discovery
Publisher: trickest-mhmdiaa
Created Date: 4/18/2023
Container: quay.io/trickest/waybackrobots:v1.0.1
Source URL: https://github.com/mhmdiaa/waybackrobots
Parameters
limit
string
Command:
-limit
- limit the number crawled snapshots. Use -1 for unlimited (default 50)recent
boolean
Command:
-recent
- use the most recent snapshots without evenly distributing themtarget
string
requiredCommand:
- Target domaintargets
file
requiredCommand:
- List of targets