wget and curl

This post is part of a series of posts categorized as “Wiki” that contain basic how-to information. The intent is to create a reference repository for myself, but I’m not selfish so if anyone else can also benefit from it then I’m happy to share the knowledge!

curl

  • OS: Linux/Windows
  • Description: Download files or website assets
Helpful Options:
 -A   user-agent string
 -b   cookie value
 -d   post data
 -D   dump headers to specified file
 -e   referer string
 -F   post data emulating a filled-in form
 -G   send data as a get instead of post
 -H   extra header string
 -K   curl config file
 -o   output file

default config file is ~/.curlrc. to use a different file use -K option

wget

  • OS: Linux/Windows
  • Description: Download files or website assets
Helpful Options:
 --config         wget config file
 --header         extra header string
 --load-cookies   load cookies from file
 --post-data      post data
 --referer        referer string
 --save-cookies   save cookies to file
 -o               logfile
 -O               output file
 -S               print headers
 -U               user-agent string

default config file is ~/.wgetrc. to use a different file use --config option