How do I mirror a whole site?

Enable --recursive or --mirror and cap depth with --level. Add --convert-links so rewritten references work offline.

How do I archive what was transferred?

Pass --warc-file so each download keeps full request and response data for replay or evidence.

How do I download many URLs at once?

Put one URL per line in a file and pass it with --input-file. Use --directory-prefix to keep outputs under one folder.

wget vs curl for workflow fetches?

curl shines on one crafted request. wget adds recursion, site mirroring, and batch --input-file downloads.

Updated Jul 15, 2026

Utilities

Fetch and mirror files over HTTP and FTP

Non-interactive downloader for HTTP, HTTPS, FTP, and FTPS transfers.

Fetch inputs into a workflow Mirror a site for offline analysis Archive exactly what was transferred

overview

What wget does

wget is the non-interactive downloader operators drop into scripts when a transfer must run unattended. It fetches over HTTP, HTTPS, FTP, and FTPS, follows redirects, resumes partial files, and can recurse into a site tree for offline copies.

Controls that matter in pipelines: --mirror or --recursive with --level, --input-file for URL lists, -U for a custom user-agent, --limit-rate to throttle, and --warc-file to archive request and response bytes.

Trickest runs wget as a managed utilities step. Pass a URL or --input-file list; the node writes a folder and a file. Use it to pull wordlists and configs, or to mirror a site before a parser or scanner.

source github.com/jay/wget

use cases

Where wget fits

Fetch inputs into a workflow

Pull a wordlist, config, or target file from a URL so later nodes have the data they need without a manual upload.

Mirror a site for offline analysis

Use recursive mirroring with link conversion to capture a whole site tree that downstream tools can grep and parse.

Archive exactly what was transferred

Write a WARC file to preserve the full request and response of every download for evidence or replay.

Throttle and retry on flaky hosts

Set a rate limit, wait, and retry count so large or unreliable transfers complete without hammering the server.

reference

wget inputs and flags

144 inputs

Name	Type	Flag	Description
url	STRING	·	Specify the URL.
urls	FILE	--input-file	Download URLs found in a local or external file.
recursive	BOOLEAN	--recursive	Specify recursive download.
mirror	BOOLEAN	--mirror	Shortcut for -N -r -l inf --no-remove-listing.
level	STRING	--level	Maximum recursion depth (inf or 0 for infinite).
limit-rate	STRING	--limit-rate	Limit download rate to RATE.
user-agent	STRING	-U	Custom user-agent.
warc-file	FILE	--warc-file	Save request/response data to a .warc.gz file.

Showing key inputs. wget exposes 144 inputs in total.

Full flag reference (144 inputs)

Name	Type	Flag	Description
url	STRING	·	Specify the url.
urls	FILE	--input-file	Download URLs found in local or external FILE
user	STRING	--user	FTP, HTTP user
wait	STRING	--wait	Wait SECONDS between retrievals(applies if more then 1 URL is to be retrieved)
debug	BOOLEAN	--debug	Print lots of debugging information
level	STRING	--level	Maximum recursion depth (inf or 0 for infinite)
quiet	BOOLEAN	--quiet	Quiet mode (no output)
quota	STRING	--quota	Set retrieval quota to NUMBER
xattr	BOOLEAN	--xattr	Turn on storage of metadata in extended file attributes
header	STRING	--header	Insert STRING among the headers
mirror	BOOLEAN	--mirror	Shortcut for -N -r -l inf --no-remove-listing
no-iri	BOOLEAN	--no-iri	Turn off iri support
spider	BOOLEAN	--spider	Don't download anything
unlink	BOOLEAN	--unlink	Remove file before clobber
ciphers	STRING	--ciphers	Set the priority string (GnuTLS) or cipher list string (OpenSSL) directly.
no-glob	BOOLEAN	--no-glob	Turn off FTP file name globbing
no-hsts	BOOLEAN	--no-hsts	Disable HSTS
referer	STRING	--referer	Include 'Referer: URL' header in HTTP request
retries	STRING	--tries	Set number of retries to NUMBER (0 unlimits)
timeout	STRING	--timeout	Set all timeout values to SECONDS
verbose	BOOLEAN	--verbose	Be verbose (this is the default)
crl-file	FILE	--crl-file	File with bundle of CRLs
cut-dirs	STRING	--cut-dirs	Ignore NUMBER remote directory components
ftp-user	STRING	--ftp-user	FTP Username
no-cache	BOOLEAN	--no-cache	Disallow server-cached data
no-netrc	BOOLEAN	--no-netrc	Don't try to obtain credentials from .netrc
no-proxy	BOOLEAN	--no-proxy	Explicitly turn off proxy
password	STRING	--password	FTP, HTTP password
progress	STRING	--progress	Select progress gauge type
relative	BOOLEAN	--relative	Follow relative links only
warc-cdx	BOOLEAN	--warc-cdx	Write CDX index files
body-data	STRING	--body-data	Send STRING as data. --method MUST be set
body-file	FILE	--body-file	Send contents of FILE. --method MUST be set
hsts-file	FILE	--hsts-file	Path of HSTS database (will override default)
http-user	STRING	--http-user	HTTP User
no-config	BOOLEAN	--no-config	Do not read any config file
no-parent	BOOLEAN	--no-parent	Don't ascend to the parent directory
post-data	STRING	--post-data	Post data
post-file	STRING	--post-file	Use the POST method; send contents of FILE
recursive	BOOLEAN	--recursive	Specify recursive download
start-pos	STRING	--start-pos	Start downloading from zero-based position OFFSET
waitretry	STRING	--waitretry	wait 1..SECONDS between retries of a retrieval
warc-file	FILE	--warc-file	Save request/response data to a .warc.gz file
follow-ftp	BOOLEAN	--follow-ftp	Follow FTP links from HTML documents
https-only	BOOLEAN	--https-only	Only follow secure HTTPS links
inet4-only	BOOLEAN	--inet4-only	Connect only to IPv4 addresses
inet6-only	BOOLEAN	--inet6-only	Connect only to IPv6 addresses
limit-rate	STRING	--limit-rate	Limit download rate to RATE
no-cookies	BOOLEAN	--no-cookies	Don't use cookies
no-verbose	BOOLEAN	--no-verbose	Turn off verboseness, without being quiet
proxy-user	STRING	--proxy-user	Proxy user
regex-type	STRING	--regex-type	Regex type
span-hosts	BOOLEAN	--span-hosts	Go to foreign hosts when recursive
user-agent	STRING	-U	Custom user-agent
warc-dedup	FILE	--warc-dedup	Do not store records listed in this CDX file
certificate	FILE	--certificate	Client certificate file
compression	STRING	--compression	Choose compression, one of auto, gzip and none. (default: none)
config-file	FILE	--config	Specify config file
dns-timeout	STRING	--dns-timeout	Set the DNS lookup timeout to SECS
execute-CMD	STRING	--execute	Execute a `.wgetrc'-style command
http-method	STRING	--method	HTTP Method
ignore-case	STRING	--ignore-case	Ignore case when matching files/directories
ignore-tags	STRING	--ignore-tags	Comma-separated list of ignored HTML tags
private-key	FILE	--private-key	Private key file
random-wait	BOOLEAN	--random-wait	wait from 0.5WAIT...1.5WAIT secs between retrievals
reject-list	FILE	--reject	Comma-separated list of rejected extensions
use-askpass	STRING	--use-askpass	Specify credential handler for requesting username and password
warc-header	STRING	--warc-header	Insert STRING into the warcinfo record
accept-regex	STRING	--accept-regex	Regex accepted urls
bind-address	STRING	--bind-address	Bind to ADDRESS (hostname or IP) on local host
ca-directory	FOLDER	--ca-directory	Directory where hash list of CAs is stored
default-page	STRING	--default-page	hange the default page name (normally this is index.html)
ftp-password	STRING	--ftp-password	FTP Password
max-redirect	STRING	--max-redirect	Maximum redirections allowed per page
no-dns-cache	BOOLEAN	--no-dns-cache	Disable caching DNS lookups
pinnedpubkey	FILE	--pinnedpubkey	Public key (PEM/DER) file
read-timeout	STRING	--read-timeout	set the read timeout to SECS
reject-regex	STRING	--reject-regex	Regex rejected urls
rejected-log	BOOLEAN	--rejected-log	Log reasons for URL rejection to FILE
report-speed	STRING	--report-speed	Output bandwidth as TYPE. TYPE can be bits
save-cookies	BOOLEAN	--save-cookies	Save cookies to FILE after session
save-headers	BOOLEAN	--save-headers	Sve the HTTP headers to file
timestamping	BOOLEAN	--timestamping	Don't re-retrieve files unless newer than local
warc-tempdir	FOLDER	--warc-tempdir	Location for temporary files created by the WARC writer
append-output	FILE	--append-output	Append messages to FILE
convert-links	BOOLEAN	--convert-links	make links in downloaded HTML or CSS point to local files
ftps-implicit	STRING	--ftps-implicit	Use implicit FTPS (default port is 990)
http-password	STRING	--http-password	HTTP Password
ignore-length	BOOLEAN	--ignore-length	Ignore 'Content-Length' header field
prefer-family	STRING	--prefer-family	Connect first to addresses of specified family, one of IPv6, IPv4, or none
retr-symlinks	BOOLEAN	--retr-symlinks	When recursing, get linked-to files (not dir)
show-progress	BOOLEAN	--show-progress	Display the progress bar in any verbosity mode
skip-existing	BOOLEAN	--no-clobber	Skip downloads that would download to
warc-max-size	STRING	--warc-max-size	Set maximum size of WARC files to NUMBER
ca-certificate	FILE	--ca-certificate	File with the bundle of CAs
local-encoding	STRING	--local-encoding	Use ENC as the local encoding for IRIs
no-directories	BOOLEAN	--no-directories	Don't create directories
no-passive-ftp	BOOLEAN	--no-passive-ftp	Disable the "passive" transfer mode
proxy-password	STRING	--proxy-password	Proxy pass
connect-timeout	STRING	--connect-timeout	Set the connect timeout to SECS
exclude-domains	FILE	--exclude-domains	Comma-separated list of rejected domains
force-html-urls	BOOLEAN	--force-html	Treat input file as HTML
ftps-resume-ssl	BOOLEAN	--ftps-resume-ssl	Resume the SSL/TLS session started in the control connection when opening a data connection
no-warc-digests	BOOLEAN	--no-warc-digests	Do not calculate SHA1 digests
page-requisites	BOOLEAN	--page-requisites	Get all images, etc. needed to display HTML page
remote-encoding	STRING	--remote-encoding	Use ENC as the default remote encoding
secure-protocol	STRING	--secure-protocol	Choose secure protocol, one of auto, SSLv2, SSLv3, TLSv1, TLSv1_1, TLSv1_2 and PFS
server-response	BOOLEAN	--server-response	Print server response
strict-comments	BOOLEAN	--strict-comments	Turn on strict (SGML) handling of HTML comments
adjust-extension	BOOLEAN	--adjust-extension	Save HTML/CSS documents with proper extensions
certificate-type	STRING	--certificate-type	Client certificate type, PEM or DER
content-on-error	BOOLEAN	--content-on-error	Output the received content on server errors
directory-prefix	STRING	--directory-prefix	Save files to PREFIX/..
domains-accepted	FILE	--domains	Comma-separated list of accepted domains
follow-tags-list	STRING	--follow-tags	Comma-separated list of followed HTML tags
no-warc-keep-log	BOOLEAN	--no-warc-keep-log	Do not store the log file in a WARC record
private-key-type	STRING	--private-key-type	Private key type, PEM or DER
random-file-data	FILE	--random-file	File with random data for seeding the SSL PRNG
auth-no-challenge	BOOLEAN	--auth-no-challenge	Send Basic HTTP authentication information without first waiting for the server's challenge
convert-file-only	BOOLEAN	--convert-file-only	Convert the file part of the URLs only (usually known as the basename)
force-directories	BOOLEAN	--force-directories	Force creation of directories
load-cookies-file	FILE	--load-cookies	Load cookies from FILE before session
no-remove-listing	BOOLEAN	--no-remove-listing	Don't remove '.listing' files
retry-connrefused	BOOLEAN	--retry-connrefused	Retry even if connection is refused
no-http-keep-alive	BOOLEAN	--no-http-keep-alive	Disable HTTP keep-alive (persistent connections)
resolve-html-input	STRING	--base	Resolves HTML input-file links (-i -F) relative to URL
trust-server-names	BOOLEAN	--trust-server-names	Use the name specified by the redirection URL's last component
content-disposition	BOOLEAN	--content-disposition	Honor the Content-Disposition header when choosing local file names
exclude-directories	FILE	--exclude-directories	List of excluded directories
include-directories	FILE	--include-directories	List of allowed directories
no-host-directories	BOOLEAN	--no-host-directories	Don't create host directories
no-warc-compression	BOOLEAN	--no-warc-compression	Do not compress WARC files with GZIP
restrict-file-names	STRING	--restrict-file-names	Restrict chars in file names to ones OS allows
retry-on-http-error	STRING	--retry-on-http-error	Comma-separated list of HTTP errors to retry
ftps-fallback-to-ftp	BOOLEAN	--ftps-fallback-to-ftp	Fall back to FTP if FTPS is not supported in the target server
keep-session-cookies	BOOLEAN	--keep-session-cookies	Load and save session (non-permanent) cookies
no-check-certificate	BOOLEAN	--no-check-certificate	Don't validate the server's certificate
no-if-modified-since	BOOLEAN	--no-if-modified-since	Don't use conditional if-modified-since get requests in timestamping mode
preserve-permissions	BOOLEAN	--preserve-permissions	Preserve remote file permissions
protocol-directories	BOOLEAN	--protocol-directories	Use protocol name in directories
accept-list-extensions	FILE	--accept	Comma-separated list of accepted extensions
no-use-server-timestamps	BOOLEAN	--no-use-server-timestamps	Do-no-use-server-timestamps the one on the server
ftps-clear-data-connection	BOOLEAN	--ftps-clear-data-connection	Cipher the control channel only; all the data will be in plaintext
continue-partially-downloaded-file	BOOLEAN	--continue	Resume getting a partially-downloaded file

example

Run wget

wget · command

# mirror example.com with a custom UA and rate limit; write a WARC archivewget --mirror --level=2 -U "Trickest-wget" --limit-rate=500k --warc-file=example-mirror https://www.example.com/

sample output

--2026-06-22 12:01:04--  https://www.example.com/Resolving www.example.com... 198.51.100.10Connecting to www.example.com|198.51.100.10|:443... connected.HTTP request sent, awaiting response... 200 OKLength: 1256 (1.2K) [text/html]Saving to: 'www.example.com/index.html'--2026-06-22 12:01:05--  https://www.example.com/aboutSaving to: 'www.example.com/about'FINISHED --2026-06-22 12:01:08--Downloaded: 2 files, 3.1K in 0.4s

guidance

Choosing wget

Use wget when you need to download or mirror content into a workflow over HTTP or FTP. It retrieves files; it does not test them. Pair with a parser or scanner downstream. For a single request with precise header control, curl is the lighter sibling.

curl

Single-request transfer tool with precise header control. wget adds recursion and site mirroring.

httrack

Dedicated website copier with a richer mirroring UI. wget is the lighter, scriptable option.

aria2

Multi-connection, multi-protocol downloader tuned for large-file throughput.

faq

wget questions

HTTP, HTTPS, FTP, and FTPS, with redirect following, resume, and authentication for each.

Run wget yourself

A URL feeds Wget, which retrieves the content and writes the downloaded files as a queryable output for later nodes.

Run wget in Trickest View the workflow

Facts on this page come from the live Trickest tool library.

Name

Type

Flag

Description

url

STRING

Specify the URL.

urls

FILE

--input-file

Download URLs found in a local or external file.

recursive

BOOLEAN

--recursive

Specify recursive download.

mirror

BOOLEAN

--mirror

Shortcut for -N -r -l inf --no-remove-listing.

level

STRING

--level

Maximum recursion depth (inf or 0 for infinite).

limit-rate

STRING

--limit-rate

Limit download rate to RATE.

user-agent

STRING

-U

Custom user-agent.

warc-file

FILE

--warc-file

Save request/response data to a .warc.gz file.

Name

Type

Flag

Description

url

STRING

Specify the url.

urls

FILE

--input-file

Download URLs found in local or external FILE

user

STRING

--user

FTP, HTTP user

wait

STRING

--wait

Wait SECONDS between retrievals(applies if more then 1 URL is to be retrieved)

debug

BOOLEAN

--debug

Print lots of debugging information

level

STRING

--level

Maximum recursion depth (inf or 0 for infinite)

quiet

BOOLEAN

--quiet

Quiet mode (no output)

quota

STRING

--quota

Set retrieval quota to NUMBER

xattr

BOOLEAN

--xattr

Turn on storage of metadata in extended file attributes

header

STRING

--header

Insert STRING among the headers

mirror

BOOLEAN

--mirror

Shortcut for -N -r -l inf --no-remove-listing

no-iri

BOOLEAN

--no-iri

Turn off iri support

spider

BOOLEAN

--spider

Don't download anything

unlink

BOOLEAN

--unlink

Remove file before clobber

ciphers

STRING

--ciphers

Set the priority string (GnuTLS) or cipher list string (OpenSSL) directly.

no-glob

BOOLEAN

--no-glob

Turn off FTP file name globbing

no-hsts

BOOLEAN

--no-hsts

Disable HSTS

referer

STRING

--referer

Include 'Referer: URL' header in HTTP request

retries

STRING

--tries

Set number of retries to NUMBER (0 unlimits)

timeout

STRING

--timeout

Set all timeout values to SECONDS

verbose

BOOLEAN

--verbose

Be verbose (this is the default)

crl-file

FILE

--crl-file

File with bundle of CRLs

cut-dirs

STRING

--cut-dirs

Ignore NUMBER remote directory components

ftp-user

STRING

--ftp-user

FTP Username

no-cache

BOOLEAN

--no-cache

Disallow server-cached data

no-netrc

BOOLEAN

--no-netrc

Don't try to obtain credentials from .netrc

no-proxy

BOOLEAN

--no-proxy

Explicitly turn off proxy

password

STRING

--password

FTP, HTTP password

progress

STRING

--progress

Select progress gauge type

relative

BOOLEAN

--relative

Follow relative links only

warc-cdx

BOOLEAN

--warc-cdx

Write CDX index files

body-data

STRING

--body-data

Send STRING as data. --method MUST be set

body-file

FILE

--body-file

Send contents of FILE. --method MUST be set

hsts-file

FILE

--hsts-file

Path of HSTS database (will override default)

http-user

STRING

--http-user

HTTP User

no-config

BOOLEAN

--no-config

Do not read any config file

no-parent

BOOLEAN

--no-parent

Don't ascend to the parent directory

post-data

STRING

--post-data

Post data

post-file

STRING

--post-file

Use the POST method; send contents of FILE

recursive

BOOLEAN

--recursive

Specify recursive download

start-pos

STRING

--start-pos

Start downloading from zero-based position OFFSET

waitretry

STRING

--waitretry

wait 1..SECONDS between retries of a retrieval

warc-file

FILE

--warc-file

Save request/response data to a .warc.gz file

follow-ftp

BOOLEAN

--follow-ftp

Follow FTP links from HTML documents

https-only

BOOLEAN

--https-only

Only follow secure HTTPS links

inet4-only

BOOLEAN

--inet4-only

Connect only to IPv4 addresses

inet6-only

BOOLEAN

--inet6-only

Connect only to IPv6 addresses

limit-rate

STRING

--limit-rate

Limit download rate to RATE

no-cookies

BOOLEAN

--no-cookies

Don't use cookies

no-verbose

BOOLEAN

--no-verbose

Turn off verboseness, without being quiet

proxy-user

STRING

--proxy-user

Proxy user

regex-type

STRING

--regex-type

Regex type

span-hosts

BOOLEAN

--span-hosts

Go to foreign hosts when recursive

user-agent

STRING

-U

Custom user-agent

warc-dedup

FILE

--warc-dedup

Do not store records listed in this CDX file

certificate

FILE

--certificate

Client certificate file

compression

STRING

--compression

Choose compression, one of auto, gzip and none. (default: none)

config-file

FILE

--config

Specify config file

dns-timeout

STRING

--dns-timeout

Set the DNS lookup timeout to SECS

execute-CMD

STRING

--execute

Execute a `.wgetrc'-style command

http-method

STRING

--method

HTTP Method

ignore-case

STRING

--ignore-case

Ignore case when matching files/directories

ignore-tags

STRING

--ignore-tags

Comma-separated list of ignored HTML tags

private-key

FILE

--private-key

Private key file

random-wait

BOOLEAN

--random-wait

wait from 0.5*WAIT...1.5*WAIT secs between retrievals

reject-list

FILE

--reject

Comma-separated list of rejected extensions

use-askpass

STRING

--use-askpass

Specify credential handler for requesting username and password

warc-header

STRING

--warc-header

Insert STRING into the warcinfo record

accept-regex

STRING

--accept-regex

Regex accepted urls

bind-address

STRING

--bind-address

Bind to ADDRESS (hostname or IP) on local host

ca-directory

FOLDER

--ca-directory

Directory where hash list of CAs is stored

default-page

STRING

--default-page

hange the default page name (normally this is index.html)

ftp-password

STRING

--ftp-password

FTP Password

max-redirect

STRING

--max-redirect

Maximum redirections allowed per page

no-dns-cache

BOOLEAN

--no-dns-cache

Disable caching DNS lookups

pinnedpubkey

FILE

--pinnedpubkey

Public key (PEM/DER) file

read-timeout

STRING

--read-timeout

set the read timeout to SECS

reject-regex

STRING

--reject-regex

Regex rejected urls

rejected-log

BOOLEAN

--rejected-log

Log reasons for URL rejection to FILE

report-speed

STRING

--report-speed

Output bandwidth as TYPE. TYPE can be bits

save-cookies

BOOLEAN

--save-cookies

Save cookies to FILE after session

save-headers

BOOLEAN

--save-headers

Sve the HTTP headers to file

timestamping

BOOLEAN

--timestamping

Don't re-retrieve files unless newer than local

warc-tempdir

FOLDER

--warc-tempdir

Location for temporary files created by the WARC writer

append-output

FILE

--append-output

Append messages to FILE

convert-links

BOOLEAN

--convert-links

make links in downloaded HTML or CSS point to local files

ftps-implicit

STRING

--ftps-implicit

Use implicit FTPS (default port is 990)

http-password

STRING

--http-password

HTTP Password

ignore-length

BOOLEAN

--ignore-length

Ignore 'Content-Length' header field

prefer-family

STRING

--prefer-family

Connect first to addresses of specified family, one of IPv6, IPv4, or none

retr-symlinks

BOOLEAN

--retr-symlinks

When recursing, get linked-to files (not dir)

show-progress

BOOLEAN

--show-progress

Display the progress bar in any verbosity mode

skip-existing

BOOLEAN

--no-clobber

Skip downloads that would download to

warc-max-size

STRING

--warc-max-size

Set maximum size of WARC files to NUMBER

ca-certificate

FILE

--ca-certificate

File with the bundle of CAs

local-encoding

STRING

--local-encoding

Use ENC as the local encoding for IRIs

no-directories

BOOLEAN

--no-directories

Don't create directories

no-passive-ftp

BOOLEAN

--no-passive-ftp

Disable the "passive" transfer mode

proxy-password

STRING

--proxy-password

Proxy pass

connect-timeout

STRING

--connect-timeout

Set the connect timeout to SECS

exclude-domains

FILE

--exclude-domains

Comma-separated list of rejected domains

force-html-urls

BOOLEAN

--force-html

Treat input file as HTML

ftps-resume-ssl

BOOLEAN

--ftps-resume-ssl

Resume the SSL/TLS session started in the control connection when opening a data connection

no-warc-digests

BOOLEAN

--no-warc-digests

Do not calculate SHA1 digests

page-requisites

BOOLEAN

--page-requisites

Get all images, etc. needed to display HTML page

remote-encoding

STRING

--remote-encoding

Use ENC as the default remote encoding

secure-protocol

STRING

--secure-protocol

Choose secure protocol, one of auto, SSLv2, SSLv3, TLSv1, TLSv1_1, TLSv1_2 and PFS

server-response

BOOLEAN

--server-response

Print server response

strict-comments

BOOLEAN

--strict-comments

Turn on strict (SGML) handling of HTML comments

adjust-extension

BOOLEAN

--adjust-extension

Save HTML/CSS documents with proper extensions

certificate-type

STRING

--certificate-type

Client certificate type, PEM or DER

content-on-error

BOOLEAN

--content-on-error

Output the received content on server errors

directory-prefix

STRING

--directory-prefix

Save files to PREFIX/..

domains-accepted

FILE

--domains

Comma-separated list of accepted domains

follow-tags-list

STRING

--follow-tags

Comma-separated list of followed HTML tags

no-warc-keep-log

BOOLEAN

--no-warc-keep-log

Do not store the log file in a WARC record

private-key-type

STRING

--private-key-type

Private key type, PEM or DER

random-file-data

FILE

--random-file

File with random data for seeding the SSL PRNG

auth-no-challenge

BOOLEAN

--auth-no-challenge

Send Basic HTTP authentication information without first waiting for the server's challenge

convert-file-only

BOOLEAN

--convert-file-only

Convert the file part of the URLs only (usually known as the basename)

force-directories

BOOLEAN

--force-directories

Force creation of directories

load-cookies-file

FILE

--load-cookies

Load cookies from FILE before session

no-remove-listing

BOOLEAN

--no-remove-listing

Don't remove '.listing' files

retry-connrefused

BOOLEAN

--retry-connrefused

Retry even if connection is refused

no-http-keep-alive

BOOLEAN

--no-http-keep-alive

Disable HTTP keep-alive (persistent connections)

resolve-html-input

STRING

--base

Resolves HTML input-file links (-i -F) relative to URL

trust-server-names

BOOLEAN

--trust-server-names

Use the name specified by the redirection URL's last component

content-disposition

BOOLEAN

--content-disposition

Honor the Content-Disposition header when choosing local file names

exclude-directories

FILE

--exclude-directories

List of excluded directories

include-directories

FILE

--include-directories

List of allowed directories

no-host-directories

BOOLEAN

--no-host-directories

Don't create host directories

no-warc-compression

BOOLEAN

--no-warc-compression

Do not compress WARC files with GZIP

restrict-file-names

STRING

--restrict-file-names

Restrict chars in file names to ones OS allows

retry-on-http-error

STRING

--retry-on-http-error

Comma-separated list of HTTP errors to retry

ftps-fallback-to-ftp

BOOLEAN

--ftps-fallback-to-ftp

Fall back to FTP if FTPS is not supported in the target server

keep-session-cookies

BOOLEAN

--keep-session-cookies

Load and save session (non-permanent) cookies

no-check-certificate

BOOLEAN

--no-check-certificate

Don't validate the server's certificate

no-if-modified-since

BOOLEAN

--no-if-modified-since

Don't use conditional if-modified-since get requests in timestamping mode

preserve-permissions

BOOLEAN

--preserve-permissions

Preserve remote file permissions

protocol-directories

BOOLEAN

--protocol-directories

Use protocol name in directories

accept-list-extensions

FILE

--accept

Comma-separated list of accepted extensions

no-use-server-timestamps

BOOLEAN

--no-use-server-timestamps

Do-no-use-server-timestamps the one on the server

ftps-clear-data-connection

BOOLEAN

--ftps-clear-data-connection

Cipher the control channel only; all the data will be in plaintext

continue-partially-downloaded-file

BOOLEAN

--continue

Resume getting a partially-downloaded file

--2026-06-22 12:01:04-- https://www.example.com/Resolving www.example.com... 198.51.100.10Connecting to www.example.com|198.51.100.10|:443... connected.HTTP request sent, awaiting response... 200 OKLength: 1256 (1.2K) [text/html]Saving to: 'www.example.com/index.html'--2026-06-22 12:01:05-- https://www.example.com/aboutSaving to: 'www.example.com/about'FINISHED --2026-06-22 12:01:08--Downloaded: 2 files, 3.1K in 0.4s

Fetch and mirror files over HTTP and FTP

What wget does

Where wget fits

Fetch inputs into a workflow

Mirror a site for offline analysis

Archive exactly what was transferred

Throttle and retry on flaky hosts

wget inputs and flags

Run wget

Choosing wget

curl

httrack

aria2

wget questions

More Utilities tools

cewl

dnsgen

airtable-integration

apktool-decode

assert-tool

aws-route53-zones

Run wget yourself

Fetch and mirror files over HTTP and FTP

What wget does

Where wget fits

Fetch inputs into a workflow

Mirror a site for offline analysis

Archive exactly what was transferred

Throttle and retry on flaky hosts

wget inputs and flags

Run wget

Choosing wget

curl

httrack

aria2

wget questions

More Utilities tools

cewl

dnsgen

airtable-integration

apktool-decode

assert-tool

aws-route53-zones

Run wget yourself