[SOLVED] wget-log

chris_crunch · 02-05-2016, 09:13 AM

There's a download that didn't quite complete on my computer. I found this wget-log file, and google reluctantly won't do anything else.

I have a text editior, I read it and it says:

2016-02-04 06:40:35 (626 KB/s) - Connection closed at byte 109505067490. Retrying.

--2016-02-04 06:40:36-- (try: 2) http://www.image-net.org/challenges/..._img_train.tar
Connecting to www.image-net.org (www.image-net.org)|171.64.68.16|:80... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 147897477120 (138G), 38392409630 (36G) remaining [application/x-tar]
Saving to: ‘ILSVRC2012_img_train.tar’

78% [+++++++++++++++++++++++++++++++++=> ] 115,458,742,747 846KB/s eta 10h
total 112750324

TB0ne · 02-05-2016, 09:21 AM

Quote:

Originally Posted by chris_crunch

There's a download that didn't quite complete on my computer. I found this wget-log file, and google reluctantly won't do anything else.

I have a text editior, I read it and it says:

2016-02-04 06:40:35 (626 KB/s) - Connection closed at byte 109505067490. Retrying.

--2016-02-04 06:40:36-- (try: 2) http://www.image-net.org/challenges/..._img_train.tar
Connecting to www.image-net.org (www.image-net.org)|171.64.68.16|:80... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 147897477120 (138G), 38392409630 (36G) remaining [application/x-tar]
Saving to: ‘ILSVRC2012_img_train.tar’

78% [+++++++++++++++++++++++++++++++++=> ] 115,458,742,747 846KB/s eta 10h
total 112750324

Sorry to sound nasty, but what do you THINK it says? It's telling you that the connection failed, it retried, and continued. It's also telling you very plainly that it's at 78% complete, downloaded 115G (out of the 138G), and that you're downloading at 846KB/s, and the ETA for the file completion is 10h.

chris_crunch · 02-10-2016, 02:42 AM

Hahaha, yes you're correct. Sorry, I wasn't clear on my question- I didn't know files like this where created when the download was interrupted.
I was wondering if you could resume the download somehow, but after researching this I believe that you cannot by using "wget", you need another downloaded to do this.
Also if you close the command line window while wget is downloading something, it is cancelled. Are these both correct?

TB0ne · 02-10-2016, 08:03 AM

Quote:

Originally Posted by chris_crunch

Hahaha, yes you're correct. Sorry, I wasn't clear on my question- I didn't know files like this where created when the download was interrupted.
I was wondering if you could resume the download somehow, but after researching this I believe that you cannot by using "wget", you need another downloaded to do this.
Also if you close the command line window while wget is downloading something, it is cancelled. Are these both correct?

Please see the "Question Guidelines" link in my posting signature....doing basic research first before posting a question is a good thing.

Putting "can wget resume" into Google pulls up lots, and the man page for wget will also. Pay particular attention to the "-c" option:

Quote:

Originally Posted by wget man page

Code:

-c
--continue
     Continue getting a partially-downloaded file.  This is useful when you want to finish up a download started by a previous instance of Wget, or by another program.  For instance:

                   wget -c ftp://sunsite.doc.ic.ac.uk/ls-lR.Z

    If there is a file named ls-lR.Z in the current directory, Wget will assume that it is the first portion of the remote file, and will ask the server to continue the retrieval    
    from an offset equal to the length of the local file.

Also, if you have wget running in the foreground, it behaves no differently than any other process...if you close the session, you cancel it. That said, if you run append "nohup" in front of the wget command, and follow it with a "&", it will spawn its own background process, and closing the terminal won't have any effect.