getallurls (gau)


getallurls (gau) fetches known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, Common Crawl, and URLScan for any given domain. Inspired by Tomnomnom's waybackurls.




$ printf | gau
$ cat domains.txt | gau --threads 5
$ gau
$ gau --o example-urls.txt
$ gau --blacklist png,jpg,gif

To display the help for the tool use the -h flag:

$ gau -h
--blacklistlist of extensions to skipgau --blacklist ttf,woff,svg,png
--fclist of status codes to filtergau --fc 404,302
--fromfetch urls from date (format: YYYYMM)gau --from 202101
--ftlist of mime-types to filtergau --ft text/plain
--fpremove different parameters of the same endpointgau --fp
--jsonoutput as jsongau --json
--mclist of status codes to matchgau --mc 200,500
--mtlist of mime-types to matchgau --mt text/html,application/json
--ofilename to write results togau --o out.txt
--providerslist of providers to use (wayback,commoncrawl,otx,urlscan)gau --providers wayback
--proxyhttp proxy to use (socks5:// or http://gau --proxy
--retriesretries for HTTP clientgau --retries 10
--timeouttimeout (in seconds) for HTTP clientgau --timeout 60
--subsinclude subdomains of target domaingau --subs
--threadsnumber of workers to spawngau --threads
--tofetch urls to date (format: YYYYMM)gau --to 202101
--verboseshow verbose outputgau --verbose
--versionshow gau versiongau --version

Configuration Files

gau automatically looks for a configuration file at $HOME/.gau.toml or%USERPROFILE%\.gau.toml. You can specify options and they will be used for every subsequent run of gau. Any options provided via command line flags will override options set in the configuration file.

An example configuration file can be found here


From source:

$ go install

From github :

git clone; \
cd gau/cmd; \
go build; \
sudo mv gau /usr/local/bin/; \
gau --version;

From binary:

You can download the pre-built binaries from the releases page and then move them into your $PATH.

$ tar xvf gau_2.0.6_linux_amd64.tar.gz
$ mv gau /usr/bin/gau

From Docker:

You can run gau via docker like so:

docker run --rm sxcurity/gau:latest --help

You can also build a docker image with the following command

docker build -t gau .

and then run it

docker run gau

Bear in mind that piping command (echo "" | gau) will not work with the docker container

ohmyzsh note:

ohmyzsh's git plugin has an alias which maps gau to the git add --update command. This is problematic, causing a binary conflict between this tool "gau" and the zsh plugin alias "gau" (git add --update). There is currently a few workarounds which can be found in this Github issue.


Buy Me A Coffee

Donate to CommonCrawl
Donate to the InternetArchive