A wizard that brings old files! wb requires go1.17 to install successfully. Run the following command to get the repo -
go install github.com/riza/wb@latest
echo "https://akamai.airbnb.com/robots.txt"|wb
wb https://akamai.airbnb.com/robots.txt
Usage:
wb [flags]
-u
specify url
-t
specift http timeout
-all
get all snapshots
-date string
get snapshot for a specific date
-no-banner
hide banner
-snapshots
get all snapshots
-help
show help