massive tar file, can't untar

dtra · 05-23-2005, 08:46 PM

hi all

i am trying to tar up my web server directory
which ends up being around 13GB

using ssh
but when i try to untar it on another server
it takes up heaps of cpu and memory
and then eventually the ssh connection drops out
and the tar just quits

is there anyway i can get around this?
like tar into several archives and then merge them on untar

thanks
dave

mherring02 · 05-23-2005, 08:49 PM

I'm not expert in TAR, but I would generally avoid handling anything in bites that big. Too many different issues can get you.

What's the downside of moving 3-4 "tarballs" rather than 1?

dtra · 05-23-2005, 09:15 PM

hey, thanks for your reply
that's what i'm asking
is it possible to run something like
tar -cf -split 500MB file%d.tar

and end up with like file01.tar, file02.tar, file03.tar, file04.tar
then use something like tar xf -join file01.tar file02.tar file03.tar file04.tar

to join them all back together untarred

mulyadi.santosa · 09-08-2011, 05:32 AM

Hi...

Sorry to resurrect such an old thread....

maybe the problem is that ssh can't cope with such a big memory allocation. So, how about doing that not inside ssh? maybe programs like dtach, screen, or tmux could help here.

Quote:

Originally Posted by dtra

hey, thanks for your reply
that's what i'm asking
is it possible to run something like
tar -cf -split 500MB file%d.tar

and end up with like file01.tar, file02.tar, file03.tar, file04.tar
then use something like tar xf -join file01.tar file02.tar file03.tar file04.tar

to join them all back together untarred