tar not working with large number of files
 

Hi all i have 1 problem

in my middle of script i am using tar command
to tar some 1000 images and size of each image is 5MB.

all the images are provided as argument
as tar -cvf file.tar <all images as argument>

but my tar file file.tar does not contain all the images.


can anyone help me
thanks in advance

How many does it contain?
How do you know all the images have been accounted for?
Are they all manual entries or is it somehow calculated?
If calculated, how?

hmmm ... maybe we need some more information??

Hi,

Which tar version are u using?

some tar versions will not be able to compress more than 2gb (eg.Solaris), you please search and download gnutar.

Hi,

tar should handle large files in any actual distribution. Did you try to take the folder containing the images as argument to tar and not the filenames by itself.

Actually current Solaris tar is large file aware but assuming you are running Gnu/Linux and then Gnu tar, you might want to create a file containing the list of files to archive then use That would rule out a command line /environment overflow.

The file system you use to store the tar file might also causing the issue. For example FAT32 cannot store files larger than 4GB so only about 800 of your 1000 5MB images would fit in a single archive.