LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 05-19-2010, 08:08 AM   #1
Euler2
LQ Newbie
 
Registered: Oct 2009
Posts: 20

Rep: Reputation: 0
Splitting Large directory over multiple blank DVDs


I am currently trying to copy a directory of roughly 400GBs to dvd, have gotten myself stuck. I tried to tar and then split; however, I don't have enough room on my hard-drive to make a compressed tar and split it up and then burn to disk, so I need a way to tar the and compress the directory, split it, and burn to disk every 4.3GBs.

I went ahead and installed DAR as an alternative, as I hear it is designed for this type of task, but I can't figure out which way is heads or tails.

If it will help, my OS is the newest version of ubuntu 10.
Thanks for your help.
 
Old 05-19-2010, 08:15 AM   #2
pixellany
LQ Veteran
 
Registered: Nov 2005
Location: Annapolis, MD
Distribution: Mint
Posts: 17,809

Rep: Reputation: 743Reputation: 743Reputation: 743Reputation: 743Reputation: 743Reputation: 743Reputation: 743
First, I would group things into sub-directories and--if necessary--split large files BEFORE doing any TARing or Compressing. Organize things so that your tar.gz archives fit on one DVD

If you need more room to generate archives, then just buy another drive (storage is cheap)

With respect to DAR, I don't know what it is, but you will need to ask a more specific question.....
 
Old 05-19-2010, 08:21 AM   #3
alli_yas
Member
 
Registered: Apr 2010
Location: Johannesburg
Distribution: Fedora 14, RHEL 5.5, CentOS 5.5, Ubuntu 10.04
Posts: 559

Rep: Reputation: 92
Hi,

Haven't personally done it myself but from reading the DAR site it does seem like it will do what you want.

There's a great tutorial here: http://dar.linux.free.fr/doc/Tutorial.html

I suggest you try it on two USB Flash drives or two 1.44 floppy's first - instead of trashing DVD-R's unnecessarily.

cheers,
Yas
 
Old 05-19-2010, 09:05 AM   #4
catkin
LQ 5k Club
 
Registered: Dec 2008
Location: Tamil Nadu, India
Distribution: Debian
Posts: 8,578
Blog Entries: 31

Rep: Reputation: 1208Reputation: 1208Reputation: 1208Reputation: 1208Reputation: 1208Reputation: 1208Reputation: 1208Reputation: 1208Reputation: 1208
Quote:
Originally Posted by Euler2 View Post
I am currently trying to copy a directory of roughly 400GBs to dvd ...
Why? I would be surprised if using DVDs is the best option compared with the alternatives when cost, time (personal and system), machine load, reliability and re-usability are considered.

DVDs are great for video where a few missing blocks don't matter. At one time DVDs were so much cheaper than the alternatives that the shortcomings were outweighed by price; that no longer applies.

dar is a great program but not intuitive and does not write to DVD directly so it's a two stage process of writing to disk first and then copying to DVD (and ideally a third stage of verifying that what's on DVD matches what's on disk).

When using DVDs as backup media it is strongly recommended that error detection and correction data is also written. par2 is a good utility for that. The CPU and disk IO to create such data is significant, say 30 mins per 4 GB.
 
Old 05-19-2010, 11:32 AM   #5
Euler2
LQ Newbie
 
Registered: Oct 2009
Posts: 20

Original Poster
Rep: Reputation: 0
As a response to why the dvd's, its what I have on hand. I need to clear up this hard-drive space so I can take another set of data (about 400Gbs) off of a supercomputing cluster before it gets deleted and the file-server that would normally store this new data is full.

In order to continue working, I need to make room in the file-server for a few months until I can afford to buy a larger file server. So at the moment all old data that isn't being currently used needs to be saved to dvd until the new system arrives.

Thanks for the suggestions so far.
 
Old 05-20-2010, 04:30 PM   #6
pixellany
LQ Veteran
 
Registered: Nov 2005
Location: Annapolis, MD
Distribution: Mint
Posts: 17,809

Rep: Reputation: 743Reputation: 743Reputation: 743Reputation: 743Reputation: 743Reputation: 743Reputation: 743
Quote:
In order to continue working, I need to make room in the file-server for a few months until I can afford to buy a larger file server. So at the moment all old data that isn't being currently used needs to be saved ..... until the new system arrives.
External USB hard drive...
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Backup large file to multiple DVDs originalmoose Linux - Newbie 5 11-02-2009 02:59 PM
copy one large directory or multiple cp's on the sub directories superc0w Linux - General 7 12-15-2008 02:14 PM
Knoppix on CD, Upon starting I get large menu with large text & blank submenus samdaria Linux - Newbie 1 06-06-2008 09:59 PM
Help! Splitting 1 large partition into 3! sh1ft Linux - Hardware 2 06-30-2004 09:04 AM
splitting large tar file derfberg Linux - Newbie 1 01-08-2003 07:44 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 02:07 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration