LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 07-20-2006, 03:49 AM   #1
michapma
Member
 
Registered: Oct 2003
Location: Zürich
Distribution: Debian
Posts: 537

Rep: Reputation: 39
large download with wget -c


I've been working on downloading a FC5 DVD. Normally wget is a great tool for this, but this time I'm confused.

I first used
Code:
wget ftp://path/to/image.iso
I went to do other stuff and when I came back expecting it to have finished, it had aborted after downloading quite a bit. The target is the FC5 DVD ISO, which is listed as 3177412 KB, so I figured I was almost home. A quick study of the manpage affirmed what I remembered:
Code:
wget -c ftp://path/to/image.iso
It resumed the download, but was somehow "counting backwards." To my astonishment, the file size grew to 5.2 GB before I had to shut down for the night (poor wife).

In the meantime, I downloaded the DVD on the LAN connection at work, checked the SHA1 sum and burned it, but when I went to use it no media is recognized. Nero express...

So I'm downloading again, hoping it doesn't abort. Here's the output so far:
[code]$ wget ftp://mirror.switch.ch/mirror/fedora/linux/core/5/i386/iso/FC-5-i386-DVD.iso
--10:10:44-- ftp://mirror.switch.ch/mirror/fedora/linux/core/5/i386/iso/FC-5-i386-DVD.iso
=> `FC-5-i386-DVD.iso'
Resolving mirror.switch.ch... 130.59.10.35, 130.59.10.34
Connecting to mirror.switch.ch[130.59.10.35]:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD /mirror/fedora/linux/core/5/i386/iso ... done.
==> PASV ... done. ==> RETR FC-5-i386-DVD.iso ... done.
Length: -1,041,297,408 (unauthoritative)
[ <=> ] 1,088,234,043 518.43K/s[code]

Did I make a mistake using wget -c? It seems more likely to me that the download was aborted due to some corruption. I guess I assumed wget would handle that and write over the corrupted part. Wishful thinking?

What I really don't understand is why it would count backwards, showing a progress bar something like:
[++++++++++++<=======================]

. . . and why it would create a 5.2+ GB file when the target is only about 3.4 GB.

Any ideas?
 
Old 07-20-2006, 04:56 AM   #2
michapma
Member
 
Registered: Oct 2003
Location: Zürich
Distribution: Debian
Posts: 537

Original Poster
Rep: Reputation: 39
Nope, aborted again.
Code:
$ wget ftp://mirror.switch.ch/mirror/fedora/linux/core/5/i386/iso/FC-5-i386-DVD.iso
--10:10:44--  ftp://mirror.switch.ch/mirror/fedora/linux/core/5/i386/iso/FC-5-i386-DVD.iso
           => `FC-5-i386-DVD.iso'
Resolving mirror.switch.ch... 130.59.10.35, 130.59.10.34
Connecting to mirror.switch.ch[130.59.10.35]:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done.    ==> PWD ... done.
==> TYPE I ... done.  ==> CWD /mirror/fedora/linux/core/5/i386/iso ... done.
==> PASV ... done.    ==> RETR FC-5-i386-DVD.iso ... done.
Length: -1,041,297,408 (unauthoritative)

    [                                               <=> ] -1,041,297,408  518.01K/s

wget: retr.c:292: calc_rate: Assertion `bytes >= 0' failed.
Aborted
What's with the negative number of bytes: -1,041,297,408 ?

Edit: Maybe I should mention that this is under Debian Sarge, though I guess that dosen't matter.

Last edited by michapma; 07-20-2006 at 04:58 AM.
 
Old 07-20-2006, 04:56 AM   #3
michapma
Member
 
Registered: Oct 2003
Location: Zürich
Distribution: Debian
Posts: 537

Original Poster
Rep: Reputation: 39
Edit: Sorry, double post

Last edited by michapma; 07-20-2006 at 04:58 AM.
 
Old 07-20-2006, 05:03 AM   #4
Bruce Hill
HCL Maintainer
 
Registered: Jun 2003
Location: McCalla, AL, USA
Distribution: Arch, Gentoo
Posts: 6,939

Rep: Reputation: 129Reputation: 129
I can't tell you why it's counting backwards, etc., but wget is not the program to use for downloads that large.

Try "rsync" if available from that mirror, or Downloader for X, or the FlashGot plugin with Mozilla Firefox will use a program available on your system. Mine uses cUrl, which is also preferable to wget.

From experience, I have never been able to get a good download of an image that large with wget.
 
Old 07-20-2006, 05:12 AM   #5
konsolebox
Senior Member
 
Registered: Oct 2005
Distribution: Gentoo, Slackware, LFS
Posts: 2,248
Blog Entries: 8

Rep: Reputation: 235Reputation: 235Reputation: 235
negative? maybe it's the problem of wget. are you sure you're using the new versions of wget? i've heard that older versions of wget has had problems downloading large files.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
wget and slackware download ivanatora Slackware 4 01-12-2008 05:12 AM
Using wget to copy large amounts of data via ftp. AndrewCAtWayofthebit Linux - General 1 05-11-2006 11:55 AM
WGET: How do I cancel a download? PionexUser Linux - Software 3 12-06-2005 12:30 PM
wget wont download ?? paul_mat Linux - Software 1 11-01-2005 12:45 AM
what to do with 5 parts of wget download Bruce Hill Linux - Software 2 09-11-2003 10:47 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 08:08 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration