Comments on: The Ultimate Wget Download Guide With 15 Awesome Examples

By: Jay P

Jay P — Tue, 03 Jan 2012 20:32:36 +0000

A cool trick. If you come across a site with download links using a PHP redirect that won’t work with WGET (you get an html file named *.php* instead of what you want) What you can do is use WGET to mirror the page with the links.

wget –mirror -p -A.php -P ./LOCAL-DIR WEBSITE-URL

It will start downloading all of the PHP on the page including the files behind the PHP redirects. Now what you can do is stop with CTRL+C once it starts downloading one of those files behind the PHP redirect. Above the Progress bar you’ll see a URL next to a Date stamp and above “Resolving [some address here]… [some IP]“, That’s the real location of that file. Using that you can now figure out the actual location of the file you want.

You could also just let WGET keep running until it’s downloaded all the files and just find the one you want from the dump, but depending on how many Download links there are, you could end up with a lot of really large files. If you want to do this I reccomend making sure the Download Loctaion has plenty of Free Space.

By: Tapas Mishra

Tapas Mishra — Wed, 21 Dec 2011 02:22:32 +0000

Nice article but there is one more interesting link include the things given here also

By: ned

ned — Thu, 24 Nov 2011 16:09:17 +0000

To Arun: you can limite the speed (–limit-rate=value k) but you can’t increase it.
It depend with the connexion that you use.
Regards.

By: Arun

Arun — Thu, 24 Nov 2011 05:21:51 +0000

I am using the wget command to download a file. But, the speed is too slow its happening B/S. Can we increase it to KB/S?. Is there any network settings I need to do in order to increase the speed?

By: ned

ned — Tue, 15 Nov 2011 10:33:01 +0000

I found a solution of my prob, it’s only missed a “”:
wget -O “File_%DATE%”.txt ftp://username:pass@Host/folder/File.txt

By: ned

ned — Thu, 27 Oct 2011 09:45:13 +0000

2. Download and Store With a Different File name Using wget -O
How can I store with a different file name dynamiquely
exemple:
I wanna add the date to the name of file
wget -O File_%DATE%.txt ftp://username:pass@Host/folder/File.txt
that doesn’t work
P.S: I use wget on windows.
Thanks for your help
Regards

By: Ravikant

Ravikant — Thu, 22 Sep 2011 04:24:59 +0000

Where the is saved when downloaded using command “wget” ?????

By: Franklin

Franklin — Tue, 06 Sep 2011 03:13:53 +0000

If you have a download link (e.g.download_script.php?src_id=7701) but do know the extension of the file being provided (it could be zip, rar, dmg, gz, etc..), how do you know what to call the file in your -O argument?

Is there any way to get wget to resolve the file extensions automatically?

By: Evan Bartholomeusz

Evan Bartholomeusz — Thu, 21 Apr 2011 03:35:19 +0000

I use a fairly simple WGET command to verify if the IP Address and port are open or closed for a particular server (wget -a /tmp/ports.log -t1 -T1 10.178.30.45:443).

The issue I have is that there are a number of servers that I need to check, and each server links to other IP addresses/ports.

Currently I have several of these one liner type scripts deployed on each of the specific servers which require being run manually as and when required.

Ideally, I am looking to customize this by hopefully creating one script that can recursively read in perhaps a flat file of IP addresses/ports against a WGET command and report on only those that are not connected (ie: “failed: Connection timed out.”). Results to be written out to an output file.

Is it possible to create this single script in such a way that it can be run from a single location (like windows) rather than deploying the script and running it in each of the servers?

Thanks,

Evan.

By: magicwand

magicwand — Tue, 29 Mar 2011 16:58:48 +0000

This is very handy information. Awesome job! Thanks for sharing!