LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices

Reply
 
Search this Thread
Old 03-22-2012, 04:34 AM   #1
limdel
Member
 
Registered: May 2009
Location: Ho Chi Minh City, Vietnam
Distribution: CentOS 6.4, FEDORA 18 x64, Linux Mint 15 x64
Posts: 57

Rep: Reputation: 15
Question tar + gzip/bzip2 with big file size limitation/solution


I'm looking to compress a folder containing multiple big files (.vmdk files), over 100GB.

my first attempt was:
Code:
>tar -jcvf myfolder.tar.bz2 myfolder
but returned:
Code:
tar: can't store file 'myfolder/myvm-flat.vmdk' of size 107374182400, aborting
Since i want to have a single compressed file, i've heard about the option "-M" and "-F" on tar man pages but can't found any sample command line.

Anyone already used those options ?

Thanks

PS: the system is BusyBox v1.16.1 ("uname -prosi" return: Linux 2.6.32.12 unknown unknown GNU/Linux)

Last edited by limdel; 03-22-2012 at 04:39 AM.
 
Old 03-22-2012, 07:34 AM   #2
pan64
Guru
 
Registered: Mar 2012
Location: Hungary
Distribution: debian i686 (solaris)
Posts: 5,018

Rep: Reputation: 1324Reputation: 1324Reputation: 1324Reputation: 1324Reputation: 1324Reputation: 1324Reputation: 1324Reputation: 1324Reputation: 1324Reputation: 1324
just a tip: tar needs a temp space to store the tar file (before bzip2), maybe you do not have enough space in /tmp?
 
Old 03-22-2012, 08:47 PM   #3
chrism01
Guru
 
Registered: Aug 2004
Location: Sydney
Distribution: Centos 6.5, Centos 5.10
Posts: 16,311

Rep: Reputation: 2040Reputation: 2040Reputation: 2040Reputation: 2040Reputation: 2040Reputation: 2040Reputation: 2040Reputation: 2040Reputation: 2040Reputation: 2040Reputation: 2040
It could be a 32 bit limit (2GB signed or 4GB unsigned), but it appears to be hard to tell from your uname output.
Can you find out if its 32 or 64 bit?
 
Old 03-24-2012, 11:29 AM   #4
limdel
Member
 
Registered: May 2009
Location: Ho Chi Minh City, Vietnam
Distribution: CentOS 6.4, FEDORA 18 x64, Linux Mint 15 x64
Posts: 57

Original Poster
Rep: Reputation: 15
Hi Guys

Thanks for reply.
The system is a 32bit SYNOLOGY NAS

df return
Code:
Filesystem                Size      Used Available Use% Mounted on
/dev/md0                  2.3G    494.3M      1.8G  22% /
/tmp                    496.5M      7.5M    488.9M   2% /tmp
/dev/md2                  7.1T      3.0T      4.1T  42% /volume1
@pan64: tar isn't supposed to write on disk once buffer is full ?

I will try on a biggers 64bit debian system and post result later.

If anyone have soem other idea !

Thanks
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
gzip but keep the original file, and bzip2 - multiple files to one file? SirTristan Linux - Newbie 4 10-20-2009 04:37 AM
CPAN.pm needs either the external programs tar, gzip and bzip2 anndy Linux - Newbie 4 09-27-2008 08:09 AM
cannot tar a big size file shipon_97 Linux - Newbie 3 11-18-2007 11:26 PM
Bzip2 and File Size Limits floog Linux - Software 3 02-27-2007 11:14 AM
Tar says it's not a bzip2 nor a tar file Blibblob Linux - Newbie 5 01-03-2004 05:38 AM


All times are GMT -5. The time now is 08:00 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration