[SOLVED] tar + gzip/bzip2 with big file size limitation/solution

limdel · 03-22-2012, 03:34 AM

I'm looking to compress a folder containing multiple big files (.vmdk files), over 100GB.

my first attempt was:

Code:

>tar -jcvf myfolder.tar.bz2 myfolder

but returned:

Code:

tar: can't store file 'myfolder/myvm-flat.vmdk' of size 107374182400, aborting

Since i want to have a single compressed file, i've heard about the option "-M" and "-F" on tar man pages but can't found any sample command line.

Anyone already used those options ?

Thanks

PS: the system is BusyBox v1.16.1 ("uname -prosi" return: Linux 2.6.32.12 unknown unknown GNU/Linux)

pan64 · 03-22-2012, 06:34 AM

just a tip: tar needs a temp space to store the tar file (before bzip2), maybe you do not have enough space in /tmp?

chrism01 · 03-22-2012, 07:47 PM

It could be a 32 bit limit (2GB signed or 4GB unsigned), but it appears to be hard to tell from your uname output.
Can you find out if its 32 or 64 bit?

limdel · 03-24-2012, 10:29 AM

Hi Guys

Thanks for reply.
The system is a 32bit SYNOLOGY NAS

df return

Code:

Filesystem                Size      Used Available Use% Mounted on
/dev/md0                  2.3G    494.3M      1.8G  22% /
/tmp                    496.5M      7.5M    488.9M   2% /tmp
/dev/md2                  7.1T      3.0T      4.1T  42% /volume1

@pan64: tar isn't supposed to write on disk once buffer is full ?

I will try on a biggers 64bit debian system and post result later.

If anyone have soem other idea !

Thanks