LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > General
User Name
Password
General This forum is for non-technical general discussion which can include both Linux and non-Linux topics. Have fun!

Notices


Reply
  Search this Thread
Old 10-17-2008, 11:09 AM   #1
ciden
Member
 
Registered: Dec 2006
Location: New Delhi, India
Distribution: PCLinuxOS 2010
Posts: 246
Blog Entries: 1

Rep: Reputation: 31
strange wget behaviour. cant download beyond 2gb (Windoze)


I was trying to download the Knoppix 5.3.1 dvd iso using wget for windows.
it says that the filesize is 144mb. Still i continued download with the -c switch since my download kept being interrupted.
wget downloaded the file and showed the progress going beyond 100%, upto 1400% and eventually downloaded about 2.1 Gb of the file (total 4.1 Gb). during this time the size and percentage in the progress bar changed to negative(after crossing 2Gb mark). When i terminated and tried

wget -c url

it gave me a 416 error about wrong header or something.
I am stuck with a 2Gb partial download and it wont continue. What can I do?
 
Old 10-17-2008, 11:47 AM   #2
rabbit2345
Member
 
Registered: Apr 2007
Location: SC
Distribution: Kubuntu 20.04 LTS
Posts: 378

Rep: Reputation: 41
if you want to download knoppix, then you can just use the torrent version of the knoppix iso file. wget probably has a lot of bugs, since you're running it on windows. the torrents for knoppix run very fast, i got up to 768 kB/s, average 434 kB/s. that's pretty good for my internet at least. and if you get interupted, you don't have to redownload the whole thing. you can pause and restart anytime.

and about that partial iso file you have, it's now worthless, since wget won't continue it. this is why you don't want to download massive files over plain http. bittorrent really saves time when you have to restart the entire download
 
Old 10-17-2008, 12:56 PM   #3
druuna
LQ Veteran
 
Registered: Sep 2003
Posts: 10,532
Blog Entries: 7

Rep: Reputation: 2405Reputation: 2405Reputation: 2405Reputation: 2405Reputation: 2405Reputation: 2405Reputation: 2405Reputation: 2405Reputation: 2405Reputation: 2405Reputation: 2405
Hi,

@ciden: I'm not a windows man, but isn't there a 2Gb file limit on (some of??) the windows file systems/caching? A clear case of hearing something somewhere on my site, but it might be worth looking into.
 
Old 10-17-2008, 01:00 PM   #4
makuyl
Senior Member
 
Registered: Dec 2004
Location: Helsinki
Distribution: Debian Sid
Posts: 1,107

Rep: Reputation: 54
You could try saving the file to a ntfs partition.
 
Old 10-17-2008, 11:58 PM   #5
ciden
Member
 
Registered: Dec 2006
Location: New Delhi, India
Distribution: PCLinuxOS 2010
Posts: 246

Original Poster
Blog Entries: 1

Rep: Reputation: 31
I know about the fat32 file size limit. I am using a NTFS partition. I personally use debian but my friend has unlimited bandwidth but runs windows.

Any place where I can get a patched version of wget for windows which can continue where the previous one left off.??
 
Old 10-18-2008, 12:20 AM   #6
jschiwal
LQ Guru
 
Registered: Aug 2001
Location: Fargo, ND
Distribution: SuSE AMD64
Posts: 15,733

Rep: Reputation: 682Reputation: 682Reputation: 682Reputation: 682Reputation: 682Reputation: 682
Look at the file in Linux with the "file" command. If there is a 2 gb limit for that program, it may be using 32-bit pointers and may have started the 3rd GB from the begining of the file. The "file" program should say that it is an iso9660 image. If it says "data" then what you have is bad and you need to start over.

Last edited by jschiwal; 10-18-2008 at 12:22 AM.
 
Old 10-18-2008, 05:22 AM   #7
ErV
Senior Member
 
Registered: Mar 2007
Location: Russia
Distribution: Slackware 12.2
Posts: 1,202
Blog Entries: 3

Rep: Reputation: 62
A bit "offtopic", but I wouldn't download huge files using http. Using bittorrent would be better idea (you know download size, connection termination won't be fatal). About the problems: several times when I was downloading *.tar.gz with wget I received file in uncompressed form (*.tar instead of *.tar.gz). Not sure why this happened, maybe this is some kind of proxy problem. Maybe something similar happened with you.
 
Old 10-18-2008, 09:16 AM   #8
ciden
Member
 
Registered: Dec 2006
Location: New Delhi, India
Distribution: PCLinuxOS 2010
Posts: 246

Original Poster
Blog Entries: 1

Rep: Reputation: 31
I dont have a removable storage above 2 Gb. I have a 2Gb pen drive and in true geek spirit partitioned it into 2 parts, one with GRML and other with data...


<Note: I am so stupid. Why dont I just boot my friends laptop with GRML and check the file ??>
Will do that right now.
)
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
ps -ef strange behaviour ?? lionking_x Linux - Newbie 1 11-28-2007 05:22 PM
Fedora 8 dvd download stopping at 2GB kunal2sh Fedora 3 11-24-2007 03:01 AM
strange behaviour marsques Slackware 11 02-15-2006 06:05 PM
how one could download an fedora core dvd iso which is above 2GB hippy2981 Linux - Newbie 8 06-14-2005 02:36 AM
Linux Download Crashes at 2GB T3 Rules Linux - General 10 03-02-2005 11:00 PM

LinuxQuestions.org > Forums > Non-*NIX Forums > General

All times are GMT -5. The time now is 06:41 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration