Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum. |
Notices |
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
Are you new to LinuxQuestions.org? Visit the following links:
Site Howto |
Site FAQ |
Sitemap |
Register Now
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
|
 |
|
05-14-2017, 02:10 AM
|
#1
|
Senior Member
Registered: Jan 2015
Posts: 1,432
Rep: 
|
wget with multiple connection.
Hello.
How can I set "wget" for download a file with multiple connections?
Thank you.
|
|
|
05-14-2017, 02:21 AM
|
#2
|
Member
Registered: Jan 2017
Location: Manhattan, NYC NY
Distribution: Mac OS X, iOS, Solaris
Posts: 508
Rep: 
|
Why do you need multiple connections, it's not likely to increase your speed?
|
|
|
05-14-2017, 03:48 AM
|
#3
|
LQ Addict
Registered: Dec 2011
Location: UK
Distribution: Debian Sid AMD64, Raspbian Wheezy, various VMs
Posts: 7,680
|
I'm not sure that wget can do that -- have you looked at axel instead?
|
|
|
05-14-2017, 04:44 AM
|
#4
|
LQ Guru
Registered: Apr 2005
Distribution: Linux Mint, Devuan, OpenBSD
Posts: 7,752
|
Using a torrent will allow use of multiple connections and thus increase speed, but as far as I know wget just does a single connection.
|
|
|
05-14-2017, 06:12 AM
|
#5
|
LQ Addict
Registered: Dec 2013
Posts: 19,872
|
there's a myth of increasing download speeds through "multiple download slots" or some such technobabble.
i think it comes from certain commercial download sites like megaupload etc., that would limit bandwidth per user.
some addons/software claimed to be able to circumvent that restriction (and maybe did until the providers circumvented THAT again), but i just don't see how wget has anything to do with it.
|
|
|
05-14-2017, 06:15 AM
|
#6
|
LQ Guru
Registered: Apr 2005
Distribution: Linux Mint, Devuan, OpenBSD
Posts: 7,752
|
Quote:
Originally Posted by ondoho
there's a myth of increasing download speeds through "multiple download slots" or some such technobabble.
i think it comes from certain commercial download sites like megaupload etc., that would limit bandwidth per user.
some addons/software claimed to be able to circumvent that restriction (and maybe did until the providers circumvented THAT again), but i just don't see how wget has anything to do with it.
|
Even with multiple connections, it would still be using a single source and thus be limited. Since torrents use multiple sources, the throughput is much, much higher and limited only by the destination bandwidth, at least if there are enough seeds available.
|
|
|
05-14-2017, 06:16 AM
|
#7
|
LQ Addict
Registered: Dec 2011
Location: UK
Distribution: Debian Sid AMD64, Raspbian Wheezy, various VMs
Posts: 7,680
|
Quote:
Originally Posted by ondoho
there's a myth of increasing download speeds through "multiple download slots" or some such technobabble.
|
Strangely enough in my limited testing I found that axel seems to be able to download quicker than wget from sites where the downkoad is slower than my internet connection. I have been sceptical about the issue so even with some limited evidence I'm not yet prepared to state that multiple connections is definitely faster but it seems there may be some truth in it under certain conditions at least.
|
|
|
05-14-2017, 06:38 AM
|
#8
|
LQ Addict
Registered: Dec 2013
Posts: 19,872
|
i'm looking at search results for "download multi" from my package manager, and there's about a dozen AUR packages (all of them unsupported, as AUR packages always are).
i'm reading things like
"Xtreme Download Manager is a powerful tool to increase download speed up-to 500%, save videos from video sharing sites and integration with ANY browser."
and
"A full featured, advanced, multi-threaded, multisegment download manager and accelerator."
it all sounds a lot like snake oil to me, but so many coders can't be completely wrong i guess.
i will have a closer look.
|
|
|
05-14-2017, 06:44 AM
|
#9
|
LQ Addict
Registered: Dec 2011
Location: UK
Distribution: Debian Sid AMD64, Raspbian Wheezy, various VMs
Posts: 7,680
|
Quote:
Originally Posted by ondoho
it all sounds a lot like snake oil to me,
|
Oh, to me too and I was surprised when axel seemed faster than wget. I think it may depend very much on the reasons why wget isn't maxing out the link.
|
|
|
05-14-2017, 07:06 AM
|
#10
|
LQ Addict
Registered: Dec 2013
Posts: 19,872
|
ok, this is the one got the most votes on AUR:
https://www.flareget.com/
no source code. go figure.
i now found axel, from the man page:
"Axel is a program that downloads a file from a FTP or HTTP server through multiple connection. Each connection downloads its own part of the file."
just like i thought, this only makes sense when the provider throttles bandwidth (and is stupid enough to not recognize this trick).
|
|
|
05-14-2017, 08:12 AM
|
#11
|
LQ Addict
Registered: Dec 2011
Location: UK
Distribution: Debian Sid AMD64, Raspbian Wheezy, various VMs
Posts: 7,680
|
Quote:
Originally Posted by ondoho
ok, this is the one got the most votes on AUR:
https://www.flareget.com/
no source code. go figure.
i now found axel, from the man page:
"Axel is a program that downloads a file from a FTP or HTTP server through multiple connection. Each connection downloads its own part of the file."
just like i thought, this only makes sense when the provider throttles bandwidth (and is stupid enough to not recognize this trick).
|
I think that's roughly how it works, yes, but I think it could also combat unintentional throttling due to server processes not been given enough resources or possibly processes scanning the outbound data. Sadly I don't know enough about this kind of thing so the previous may be nonsense but something like that would make sense to me. A bit like when, sometimes, it seems quicker to copy files from a file sever simultaneously rather than one after the other.
|
|
|
05-23-2017, 01:40 AM
|
#12
|
Senior Member
Registered: Jan 2015
Posts: 1,432
Original Poster
Rep: 
|
Quote:
Originally Posted by Laserbeak
Why do you need multiple connections, it's not likely to increase your speed?
|
Yes.
|
|
|
05-23-2017, 01:41 AM
|
#13
|
Senior Member
Registered: Jan 2015
Posts: 1,432
Original Poster
Rep: 
|
I like to use "wget" not "axel" !!!
|
|
|
05-23-2017, 05:58 AM
|
#14
|
LQ Addict
Registered: Mar 2012
Location: Hungary
Distribution: debian/ubuntu/suse ...
Posts: 24,268
|
https://www.tecmint.com/download-managers-for-linux/
in general look for linux download manager - if interested.
wget itself is unable to use multiple connections. If you really want to use wget just do, but there will be only single connections or probably you can try to implement that feature into it.
|
|
|
05-23-2017, 10:05 AM
|
#15
|
LQ Addict
Registered: Dec 2013
Posts: 19,872
|
Quote:
Originally Posted by hack3rcon
I like to use "wget" not "axel" !!!
|
read the "documentation" !!!
either the feature is there, or it isn't !!!
|
|
|
All times are GMT -5. The time now is 04:49 AM.
|
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.
|
Latest Threads
LQ News
|
|