LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices

Reply
 
Search this Thread
Old 09-13-2009, 02:59 PM   #1
frenchn00b
Senior Member
 
Registered: Jun 2007
Location: E.U., Mountains :-)
Distribution: Debian, Etch, the greatest
Posts: 2,546

Rep: Reputation: 50
How to backup a 1 Tera bytes Harddisk to DVD without X ?


Hello,
Rescue rescue

cauchemar, crash hdd

Is there some solution, in that direction?
How to backup a 1 Tera bytes Harddisk to DVD without X ?
growisofs is installed
(no compression or eventually yes, but no DVD dependencies)

Is there scripts under console?

Last edited by frenchn00b; 09-13-2009 at 03:06 PM.
 
Old 09-13-2009, 09:44 PM   #2
lutusp
Member
 
Registered: Sep 2009
Distribution: Fedora
Posts: 835

Rep: Reputation: 101Reputation: 101
Quote:
Originally Posted by frenchn00b View Post
Hello,
Rescue rescue

cauchemar, crash hdd

Is there some solution, in that direction?
How to backup a 1 Tera bytes Harddisk to DVD without X ?
growisofs is installed
(no compression or eventually yes, but no DVD dependencies)

Is there scripts under console?
"Is there scripts under console?" That's where they were invented. And it wasn't so long ago that no computers had graphical displays, and yet, people were actually able to work with them and didn't lament over what they were missing.

Read up on tar, split and growisofs. Tar will create a reliable archive of all the files on the hard drive, split will break the archive up into DVD-sized chunks, then growisofs will burn the resulting files to a series of DVDs. I can assure you this method works, I have done it many times.

Don't assume you can put 4.7 GB on a DVD. While deciding what size to make the pieces of the archive, try for something a little more realistic, like 4.5 or even 4.0 GB (in which case 500 MB per piece makes sense).

But don't try to write the original files piecemeal directly to DVD as regular files -- that way is the dark side. You are much better off saving a compressed, segmented archive that can reliably be recreated by tar. Remember all the goofy things an ISO9660 filesystem is famous for -- mangling file and path names, a dinky maximum file size, and general cussedness.
 
Old 09-13-2009, 09:57 PM   #3
sploot
Member
 
Registered: Sep 2009
Location: Phoenix, AZ
Distribution: Gentoo, Debian, Ubuntu
Posts: 121

Rep: Reputation: 27
I think a better way to resolve this is to use dd. Do some reading up on it or consider the information presented in this thread:

http://wiki.linuxquestions.org/wiki/Dd

http://www.linuxquestions.org/questi...ommand-362506/

To burn to a dvd,
Code:
growisofs -use-the-force-luke=dao -dvd-compat -J -R -l -f -Z /dev/burner -speed=16 /path/to/burn
substituting the path to your burn device for /dev/burner. Also, ensure that this is the proper write speed for your device.
 
Old 09-13-2009, 10:50 PM   #4
frenchn00b
Senior Member
 
Registered: Jun 2007
Location: E.U., Mountains :-)
Distribution: Debian, Etch, the greatest
Posts: 2,546

Original Poster
Rep: Reputation: 50
Quote:
Originally Posted by sploot View Post
I think a better way to resolve this is to use dd. Do some reading up on it or consider the information presented in this thread:

http://wiki.linuxquestions.org/wiki/Dd

http://www.linuxquestions.org/questi...ommand-362506/

To burn to a dvd,
Code:
growisofs -use-the-force-luke=dao -dvd-compat -J -R -l -f -Z /dev/burner -speed=16 /path/to/burn
substituting the path to your burn device for /dev/burner. Also, ensure that this is the proper write speed for your device.
thank you !
well I means that I can split the several folders? there is lots of folder of >4gb. also the folder path can be too deep for growisoformat, or being compatible dvd ... ?
Well I study it
 
Old 09-14-2009, 03:24 AM   #5
lutusp
Member
 
Registered: Sep 2009
Distribution: Fedora
Posts: 835

Rep: Reputation: 101Reputation: 101
Quote:
Originally Posted by frenchn00b View Post
thank you !
well I means that I can split the several folders? there is lots of folder of >4gb. also the folder path can be too deep for growisoformat, or being compatible dvd ... ?
Well I study it
If you try to write the original filesystem to the DVDs as a filsystem, you will regret it. Please read my original post above -- use a tar archive. A tar archive avoids the problems inherent in an ISO9660 filesystem.
 
1 members found this post helpful.
Old 09-14-2009, 12:44 PM   #6
frenchn00b
Senior Member
 
Registered: Jun 2007
Location: E.U., Mountains :-)
Distribution: Debian, Etch, the greatest
Posts: 2,546

Original Poster
Rep: Reputation: 50
Quote:
Originally Posted by lutusp View Post
If you try to write the original filesystem to the DVDs as a filsystem, you will regret it. Please read my original post above -- use a tar archive. A tar archive avoids the problems inherent in an ISO9660 filesystem.
they are just data, no filesystem

Regarding
growisofs -use-the-force-luke=dao -dvd-compat -J -R -l -f -Z /dev/burner -speed=16 /path/to/burn

i got a dvd burning crash error, with genimage.... to say
on my first dvd trial

then didnnt do more yet
 
Old 09-14-2009, 06:52 PM   #7
lutusp
Member
 
Registered: Sep 2009
Distribution: Fedora
Posts: 835

Rep: Reputation: 101Reputation: 101
Quote:
Originally Posted by frenchn00b View Post
they are just data, no filesystem

Regarding
growisofs -use-the-force-luke=dao -dvd-compat -J -R -l -f -Z /dev/burner -speed=16 /path/to/burn

i got a dvd burning crash error, with genimage.... to say
on my first dvd trial

then didnnt do more yet
Not surprising. You need to ask yourself what is going on. A DVD can contain 4.7 GB -- and actually, a bit less than that. If you start streaming data to a DVD burner, it will gasp and choke once it gets near 4.7 GB.

So stream the data into something like "split", break it into chunks, and burn groups of chunks onto individual DVDs. If you set a chunk size of 500MB, chances are 9 of those chunks will fit onto a single DVD.

And remember, if you try for larger chunks, ISO9660 filesystems have a maximum filesize of 2 GB. Again, whatever you do, don't try to duplicate the original filesystem on DVDs. Most people who try to do this end up sounding like Darth Vader after the third day of trying.

The drawback to imaging the entire drive is that you will burn a lot of DVDs with nothing useful on them. The drawback to saving the actual filesystem on DVDs is it won't work. Which leads back to my first post on this thread -- use "tar" to read and compress the entire filesystem, use "split" to split up the tar archive, and burn it to DVDs.
 
Old 09-14-2009, 07:23 PM   #8
saikee
Senior Member
 
Registered: Sep 2005
Location: Newcastle upon Tyne UK
Distribution: Any free distro.
Posts: 3,398
Blog Entries: 1

Rep: Reputation: 112Reputation: 112
Why not purchase another 1TB disk, put it in an enclosure, hook it up as an external USB disk, issue the following command before you going to bed
Code:
dd if=/dev/sda of=/dev/sdb bs=32256
and have a 100% clone, bootable if you wish, available in the morning?

I reckon the cost may be double that of the DVD but your hard disk is reusable, faster, and in one piece.

Last edited by saikee; 09-14-2009 at 07:26 PM.
 
Old 09-14-2009, 08:36 PM   #9
jschiwal
Guru
 
Registered: Aug 2001
Location: Fargo, ND
Distribution: SuSE AMD64
Posts: 15,733

Rep: Reputation: 654Reputation: 654Reputation: 654Reputation: 654Reputation: 654Reputation: 654
You may have better luck using dar rather than tar. It is written to produce cd or dvd sized slices, and supports security attributes. However, there are tar options to produce fixed sized slices as well. For a file backup, only back up directories that make sense. Don't back up /proc or /sys. They are dynamic (psuedo) filesystems. Don't backup /dev. It is created when booting. Don't backup /tmp. That would be a waste of time. Backup symbolic links as symbolic links. Also use "sudo fdisk -lu" to list the partition table. Save it or print it out. This will allow you to create a new partition table if you need to replace the hard drive.

IMHO, getting an external 1 or 2 TB drive, formatting it in a Linux filesystem, such as ext3, mounting it and producing the tar output on that disk would be a better way to go than burning slices of a backup to dvd. How do you intend to restore from the backup when it is split up on different discs? It is possible to cat together the slices, and pipe that to dd (for an image backup) but you need to create a fifo file for each disc. Otherwise the end of the file on the disk will cause the pipe to break.
You also need to be careful you don't get the discs in the wrong order and if you have a read error on one disc you are stuck (unless you use an offset for the others).
 
Old 11-22-2009, 10:00 PM   #10
frenchn00b
Senior Member
 
Registered: Jun 2007
Location: E.U., Mountains :-)
Distribution: Debian, Etch, the greatest
Posts: 2,546

Original Poster
Rep: Reputation: 50
error

Code:
# growisofs -use-the-force-luke=dao -dvd-compat -J -R -l -f -Z /dev/hdb -speed=16 burn
Executing 'genisoimage -J -R -l -f burn | builtin_dd of=/dev/hdb obs=32k seek=0'
Warning: -follow-links does not always work correctly; be careful.
I: -input-charset not specified, using utf-8 (detected in locale settings)
genisoimage: Error: burn/rar/Linux Blog_rmnl  remove new line characters with tr, awk, perl, sed or C_C++.htm and burn/rar/Linux Blog_rmnl  remove new line characters with tr, awk, perl, sed or C_C++-Dateien have the same Joliet name
Joliet tree sort failed. The -joliet-long switch may help you.
:-( write failed: Input/output error
 
Old 11-23-2009, 07:03 AM   #11
voyciz
Member
 
Registered: Mar 2004
Distribution: Slackware
Posts: 425

Rep: Reputation: 40
In the O'Reilly book Running Linux the author recommends cpio over tar for backing up data, as he says it is a more reliable method of archiving.

Well did you try using the -joilet-long switch? You could also change the names of the files or remove the -J switch altogether if you don't need it. It also is more reliable to burn at a lower speed like -speed=1

Last edited by voyciz; 11-23-2009 at 07:05 AM.
 
Old 11-23-2009, 01:41 PM   #12
H_TeXMeX_H
Guru
 
Registered: Oct 2005
Location: $RANDOM
Distribution: slackware64
Posts: 12,928
Blog Entries: 2

Rep: Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269
I hope you do realize that if it's a full 1 TB, it would take around 223 DVDs to back it all up.

Anyway, this is the command I use:

Code:
growisofs -dvd-compat -speed=4 -use-the-force-luke=bufsize:32m -Z /dev/dvdrw -graft-points -rational-rock -full-iso9660-filenames -iso-level 2 /source/directory/goes/here
Change the speed accordingly.
 
1 members found this post helpful.
Old 11-23-2009, 02:09 PM   #13
mostlyharmless
Senior Member
 
Registered: Jan 2008
Distribution: Slackware -current (multilib) with kernel 3.15.5
Posts: 1,498
Blog Entries: 12

Rep: Reputation: 155Reputation: 155
Quote:
I hope you do realize that if it's a full 1 TB, it would take around 223 DVDs to back it all up.
Nice! ...and that's assuming that the drive doesn't break; then'd be 223 DVDs and a new DVD burner. All in all I vote for the external HDD, much cheaper and faster, and you can boot off it too in a pinch.
 
Old 11-23-2009, 02:51 PM   #14
H_TeXMeX_H
Guru
 
Registered: Oct 2005
Location: $RANDOM
Distribution: slackware64
Posts: 12,928
Blog Entries: 2

Rep: Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269Reputation: 1269
Or it would take you say 20 dual layer blu-ray, at a cost of about $400 for the disks (plus a possible $300 for the drive if you don't have one). Compare this to $60 for 300 DVD-Rs (but it would take a while, and where would you store them).

Yeah, it would be much cheaper and better to use a HDD ($80 for 1TB in best case), not that I consider it a backup method tho.

Last edited by H_TeXMeX_H; 11-23-2009 at 02:57 PM.
 
Old 11-23-2009, 06:57 PM   #15
frenchn00b
Senior Member
 
Registered: Jun 2007
Location: E.U., Mountains :-)
Distribution: Debian, Etch, the greatest
Posts: 2,546

Original Poster
Rep: Reputation: 50
Quote:
Originally Posted by mostlyharmless View Post
Nice! ...and that's assuming that the drive doesn't break; then'd be 223 DVDs and a new DVD burner. All in all I vote for the external HDD, much cheaper and faster, and you can boot off it too in a pinch.
I was thinking that 223 dvd. the pc can creates 223 LST files with the content of files :
dvd222.lst
Code:
/home/me/folder/file333331
/home/me/folder/foldersub/file333332 
/home/me/folder/file333333
..
and then begins burning

sure that there a big big problem once we need to backup such amount of dvd because there is no solution up today under linux a tar.gz will be very huge
splitting rar would avoid names failures, but if one dvd is scratched all is lost, and it'll ask all the time the first DVD.

any innovative solution guys?
Any command are very very welcome, thansk for above, for the growisofs command. I already made or lost lot of dvd's trying and failing burning with growisofs
more than 10-15 dvds
can I simulate it btw?

I am out of ideas .... (but it'll be on dvd, cuz I successfully after a hdd crash recover most the data)

Last edited by frenchn00b; 11-23-2009 at 07:02 PM.
 
  


Reply

Tags
backup


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
What's best Linux way to backup (clone) a big harddisk ? frenchn00b Linux - General 6 08-31-2008 06:01 AM
cpio: warning: skipped ### bytes of junk on backup to tape job DoSerMaN Linux - Server 4 09-13-2007 01:21 AM
Arghhhh! All my backup files are gone from USB harddisk luke sleeman Linux - Hardware 13 10-30-2005 06:16 AM
Tera Term Pro gretp General 1 02-20-2001 03:23 PM
Tera Term gretp Linux - General 1 02-20-2001 01:49 PM


All times are GMT -5. The time now is 05:31 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration