LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 10-06-2012, 09:59 AM   #1
sumeet inani
Member
 
Registered: Oct 2008
Posts: 902
Blog Entries: 26

Rep: Reputation: 49
using wget for parallel downloading


I have this idea of donloading a file using multiple wget (one for each piece)
I am using tiny core which is a light weight distro and I find wget reliable as well as ubiquitous.
Say we know that file is of exactly 100Mbytes.
I will wget first to download first upto 10M bytes.
Tell another wget to get (10M+1)th byte till 20M.
So on ..
for 10 processes.
Is that possible ?

If we do not have control over the length then say we have to kill first wget when part1 file exceeds 10M.
 
Old 10-06-2012, 01:06 PM   #2
kooru
Senior Member
 
Registered: Sep 2012
Posts: 1,385

Rep: Reputation: 273Reputation: 273Reputation: 273
Try with curl
 
Old 09-03-2013, 08:05 AM   #3
sumeet inani
Member
 
Registered: Oct 2008
Posts: 902
Blog Entries: 26

Original Poster
Rep: Reputation: 49
update

The requested page was not found.
for http://linuxandfriends.com/2008/11/0...ple-locations/
 
Old 09-04-2013, 05:55 AM   #4
eklavya
Member
 
Registered: Mar 2013
Posts: 622

Rep: Reputation: 136Reputation: 136
Which type of file is it?
Is it a text file?

If you want to download in parts because download is broken after sometimes, you can resume download using
Code:
wget -c
If you want to use curl... see this.
http://spsneo.com/blog/2008/08/18/do...ownload-limit/
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Wget: Downloading Pictures from a website mattseanbachman Linux - Software 1 12-29-2010 06:11 PM
wget: Multi-Threaded downloading wwnexc Linux - Networking 8 05-15-2010 09:40 PM
wget problem - not downloading ALL files AwW41 Linux - Software 2 08-28-2008 08:46 PM
wget - downloading files from a directory Oris13 Linux - General 8 05-15-2008 06:42 PM
HOWTo restart downloading with wget ashwin_cse Red Hat 5 08-26-2004 11:07 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 12:27 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration