Table of Contents

Wget learn through examples  

If you are on centos use yum to install it

yum install wget
  cd /home/downloads

If you are on windows, Ofcourse you can use your browser to download this. But i would still recommend to install wget on windows, since it is such a useful utility.

To install on windows, i would suggest installing windows terminal emulator MobaXterm. Once you have MobaXterm installed. Install wget using following command...

apt-get install wget

Once it is installed you can do man wget to look at the detailed usage of this command. I have put together some of the most use cases of wget in this post.

Lets first start with a simple case, lets say we want to download a file nti_minirator.exe  from realtraps.com

wget http://www.realtraps.com/nti_minirator.exe

  --2019-08-17 22:58:36-- http://www.realtraps.com/nti_minirator.exe
  Resolving www.realtraps.com (www.realtraps.com)... 67.210.104.150
  Connecting to www.realtraps.com (www.realtraps.com)|67.210.104.150|:80... connected.
  HTTP request sent, awaiting response... 301 Moved Permanently
  Location: http://realtraps.com/nti_minirator.exe [following]
  --2019-08-17 22:58:36-- http://realtraps.com/nti_minirator.exe
  Resolving realtraps.com (realtraps.com)... 67.210.104.150
  Reusing existing connection to www.realtraps.com:80.
  HTTP request sent, awaiting response... 200 OK
  Length: 1399900 (1.3M) [application/octet-stream]
  Saving to: nti_minirator.exe
   
  100%[======================================>] 1,399,900  1.05MB/s  in 1.3s  
   
  2019-08-17 22:58:38 (1.05 MB/s) - nti_minirator.exe saved [1399900/1399900]

   Instead of printing everything on the command prompt, we can log everything to a file using -o switch

  wget http://www.realtraps.com/nti_minirator.exe -o logfile

If we cat the above file, we will see same log messages printed in the file

  cat logfile | tail -5
   1300K .......... .......... .......... .......... .......... 98% 12.1M 0s
   1350K .......... .......                  100% 10.6M=1.3s
   
  2019-08-17 22:59:04 (1.06 MB/s) - nti_minirator.exe.1 saved [1399900/1399900]

   One thing to notice here is that, since we downloaded the same file again, it saved the file with ".1" suffix. wget will keep appending and increment the counter

To overwrite the file use -O switch

  wget http://www.realtraps.com/nti_minirator.exe -o logfile -O nti_minirator.exe

Without the -O switch, it would have appended .2, lets do ls to see, we should have only two files 

 ls nti_minir*
  nti_minirator.exe nti_minirator.exe.1

Lets look in to the log file, how many lines are there 

 wc -l logfile
  43 logfile

Instead of overwriting the log file, we can append in to same log file using -a switch 

 wget http://www.realtraps.com/nti_minirator.exe -a logfile -O nti_minirator.exe
  wc -l logfile
  86 logfile

There are some other useful command which I would like to expand in the future post. I am putting it down for reference in case you are interested. 

 wget http://www.realtraps.com/nti_minirator.exe -q -O nti_minirator.exe
  wget -i http://www.realtraps.com/nti_minirator.exe -o logfile -O nti_minirator.exe
  wget --limit-rate=1m http://www.realtraps.com/nti_minirator.exe
  wget -c http://www.realtraps.com/nti_minirator.exe
  wget -b http://www.realtraps.com/nti_minirator.exe
  wget --user-agent="Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0" http://www.realtraps.com/nti_minirator.exe
  wget --ftp-user=FTP_USERNAME --ftp-password=FTP_PASSWORD ftp://ftp.example.com/filename.tar.gz
  wget -m https://example.com
  wget -m -k -p https://example.com
  wget --no-check-certificate http://www.realtraps.com/nti_minirator.exe


Related Posts