Please Help! How Do I Download A File Over 4 Gb !!!?
 

I can't find a Window OR EVEN LINUX program that will download files over 4 GB!!! HELP!!! They all download the first 300 MB and quit on me!!!

Try wget:
wget -c http://www.somesite.com/file.ext

didn't work

how do u download the file? where's the file located?

wget will at least get more than 300 meg :-) Must be something wrong with the connection???

If wget drops out you can restart it with wget -c and it will start from where it left off...

Also what filesystem are you putting it on. Some are limitted to 2gig file size if not created with large filesize in mind...

Dude - what the heck kind of file is over 4G, other than pirated movies and the like? Maybe I'm overlooking something obvious, but even with a fast connection, moving this much data would still take a great deal of time, and at least for me, the need to perform a 4G transfer sounds mighty unusual. -- J.W.

Alright people, here is the info...

What I'm trying to download are two unofficial debian DVD disks for their Sid distro. I've got a link to download these disks and 5 mirrors. The first goes over the 4 GB threshold and therefore most/all programs will not download it if the server will tell the software what the size of the file is. I got away with downloading Fedora Core 1 DVD from an ftp server that wouldn't tell my client what the file's size was, but all my sources for this download tell my client what the size is.

Why does wget and other software only download about 300 MB? I know why --
When programmers make software, they use variables (much like in math) to store values. These variables have different types. Some store characters, some store numbers, etc. The point is that these variables have limits. For example, an "integer" can store values from *about* -32000 to 32000 or so. A "unsigned long integer" on the other hand, can store a number from 0 to 4294967295, which is 4 GB. Most programmers use this unsigned long integer to store the size of the files I'm trying to download. So what happens if I try to download a files that has size, 4609540096 bytes? Simple, overflow occurs. Basically, the computer goes from 4294967295 to zero and then starts counting up from there... so it basically does a (4609540096 - 4294967295) which equals 314572801 which is 300 MB. The download client then downloads 300 MB and quits thinking it did it's job.

There is nothing wrong with the connection. wget download the exact same number of bytes that all the other software did and quit. wget is the problem.

I'm downloading from a college LAN where I get over 1 MB per second download speed (and yes, these mirrors give me that speed).

The mirrors for this debian DVD download are as follows:

ftp://ftp.proxad.net/mirrors/ftp.fsn...ficial/sid-dvd
http://mirrors.sec.informatik.tu-dar...ficial/sid-dvd
http://mirror.switch.ch/ftp/mirror/d...ficial/sid-dvd
http://debian.linux.org.tw/debian-unofficial/sid-dvd
ftp://ftp.kfki.hu/pub/linux/cdimages...ficial/sid-dvd
ftp://ftp.fsn.hu/pub/CDROM-Images/de...ficial/sid-dvd


My problem is that I cannot find *any* software in windows or linux that will download that first dvd, sid-i386-1.iso. The second one will download, but not the first. I'm almost ready to go find some source code and change all the file size variables to long double.

Does anyone know of any software that will download this file? Under linux I tried wget, d4x, ftp (command line), and some other stuff I can't remember right now...

Re: Please Help! How Do I Download A File Over 4 Gb !!!?
 

Simple. Use a "range" header and progressively download. Or use a download manager that supports download-resume.

An example:

http://aspn.activestate.com/ASPN/Coo...n/Recipe/83208

Great! I'll be able to download the first 4 GB but not the last 300 MB! WOOT!

I can't specify that last 300 MB even using the range method. And software that downloads files in parts do not read the file size correctly either. They download the first 300 MB like everything else.

Some things for you to check. Are there any filesize limitations (max bytes/file) of your system? ulimit ?

If yes then you need to clear that. Second thing to check if you've got enough free space.

What's wrong with the mozilla download manager?

I have no file size limitations and mozilla doesn't know how to download files in excess of 4 GB either. I have about 40 GB of free space to download into.

If many programmes have this problem then the debian people probably would have been affected, so maybe they might know a way around it. Have you asked them?

I don't think debian officially distributes DVD images since there are not many people that have DVD burners yet.

Read this:
http://www.debian.org/distrib/cd

In particular:
Jigbo splits the download into many (I guess we can assume 300MB) chunks and assembles them afterwards.

Well, I guess that solves the riddle. Thank you very much! I'm running Jigdo right now.

The issue is handling files larger than 2G .. not 4G. It occurs because long is 32 bits and after 2G you get unsigned numbers.

DVD images for download are not supported yet on most browsers.
Mozilla has a zillon bug reports on it.

Windows has an adhoc solution that goes to 4G but nothing beyond that.

Jiglo or other tools will be able to do it.

how do you use jiglo to download fedora core 2 dvd iso it's 4.3gb (i wget the file, and i got only 2gb and it errors out) ? :|

This link may be of use then. You will need to use one of the posted wget patches and compile from source, or just use Gentoo and feel smug.

http://bugs.gentoo.org/show_bug.cgi?id=30985

TIM

BitTorrent would of been able to do it too, maybe 'sid' should offer a torrent for the DVD Image :)

I think I know how to solve the problem. Here is the discription of GetRight download manager version 5.2 beta 1 and beta 2:
http://www.getright.com/beta52.html

The first improvment says that:
Fixes & Improvements in Beta 1:
Increase from 32 bit numbers (which maxes out at about 2GB for a single file) to 64 bits (which is about 8 billion Gigabytes). Should be good for another 1000 years or so!
TIP: How your disk is formatted can limit file sizes too. FAT limit is 2GB, FAT32 limit is 4GB, NTFS is unlimited. Info from Microsoft.

So I tried it and... it works! I've seen clear that the program have been downloading the file with the size of 4157 MB (Fedora Core 2 DVD ISO).