LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware
User Name
Password
Linux - Hardware This forum is for Hardware issues.
Having trouble installing a piece of hardware? Want to know if that peripheral is compatible with Linux?

Notices


Reply
  Search this Thread
Old 04-05-2012, 06:24 AM   #1
WizadNoNext
Member
 
Registered: Nov 2009
Posts: 140

Rep: Reputation: 9
RAID on files instead of HDDs? Is it possible? How?


Hello.

I need ultra safe storage for backups. I came with idea of RAID in mirror level on 6 devices, but here the problem starts. I have 6 HDDs, but all of them contain data and only 5 of them could repartitioned - 6th cannot be, as data, which is there won't fit anywhere else. So I came up with idea, that I would use 6 file-partitions. Now how make dm or lvm use it? Basically all of them are 5GiB files (should be enough for several months or even years).

Any ideas?
 
Old 04-05-2012, 12:10 PM   #2
NyteOwl
Member
 
Registered: Aug 2008
Location: Nova Scotia, Canada
Distribution: Slackware, OpenBSD, others periodically
Posts: 512

Rep: Reputation: 139Reputation: 139
RAID is not designed as a backup system. it is intended to provide fault tolerance for an running system in the even of one or more physical drive failures. RAID can be used with partitions instead of entire drives. Just specify the partitions to be used as the RAID devices when creating the array.

Though from your intended purpose, you would be just as well off rsynching your data to a secondary storage system (additional HDD, external HDD, NAS) as well as to some form of off-site storage be it an off-site server or cloud account.
 
Old 04-05-2012, 03:49 PM   #3
jefro
Moderator
 
Registered: Mar 2008
Posts: 21,976

Rep: Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623
Each of the drives could have a days backup maybe M-S. Rotate it so you are only a day behind on failure.
 
Old 04-06-2012, 04:21 AM   #4
WizadNoNext
Member
 
Registered: Nov 2009
Posts: 140

Original Poster
Rep: Reputation: 9
First of all. I stated, that partitions go out of question, as one HDD won't ever be partitioned (I would have to loose data to do that). I have NAS on those those drives.

Second rotating isn't solution! I need backup of every change made to system, not just last one. It is not just failure-proofing, but it is simply store every change.
 
Old 04-06-2012, 03:22 PM   #5
jefro
Moderator
 
Registered: Mar 2008
Posts: 21,976

Rep: Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623
I guess you could make files and mount them loop or fuse and then construct an array that way.

To get every change though you ought to look at some other file system. ZFS might be a solution. It will take a lot of resources to rsync or otherwise copy all this. Software raids tend to be cpu intensive.

The reason you don't see thousands of web pages devoted to this idea is because of what was stated above. It kind of stinks from an admin point of view. But you are welcome to try.

I felt your response was in anger. I guess that is just me.

Last edited by jefro; 04-06-2012 at 03:23 PM.
 
Old 04-06-2012, 11:42 PM   #6
WizadNoNext
Member
 
Registered: Nov 2009
Posts: 140

Original Poster
Rep: Reputation: 9
No my response wasn't in anger. Simply need to make hard point why I need it that way not the other. I thought about btrfs, but it is not real solution, casue btrfs isn't stable yet and fsck isn't ready yet. ZFS is going out of question, as there is no support in kernel for ZFS yet (maybe in 3.3, but I dislike fresh branches - I have learnt, that they are free of errors).
At the moment I am using 3.2.14 and it won't change any time soon - I just started to use it and I tend to run on single boot for weeks even for desktop (that is why its hard to separate me with Virtualization), simply rebooting GNU/Linux, seams like joke to me (it is designed to run and run and run, even in case of almost grave errors).

Maybe I would be able to shift all data around and back, then I would have two LVM arrays (one for RAID0 and one for RAID1). RAID0 would used mostly for building software (journalled data - it is bit slow) and RAID1 obviously only for backup.

P.S. I am security and data integrity obsessed, so I am using acl, journal checksum and journalled data to prevent data loss and SELinux to secure my servers (and quite big set of IPtables and protected keys for SSH - no passwords for SSH).
 
Old 04-11-2012, 07:37 AM   #7
ba.page
Member
 
Registered: Feb 2012
Location: Canada
Distribution: Scientific,Debian
Posts: 35

Rep: Reputation: 7
my suggested approach:
-scrap the existing partitions on each of the 5 devices that you can afford to do so on.
-build a RAID6 using those 5 devices.
-format and mount
-copy the big data that you have stuffed on device #6 over to your newly created RAID6.
-confirm both sides match
-scrap the partition on device 6
-add it to the RAID 6 as a new member
-expand your RAID to use all available device space
-expand your filesystem to use all available RAID space.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Backup Daemons or mdadm RAID Across Internal and External HDDs? PehJota Linux - General 6 08-18-2010 07:44 AM
soft RAID (mirror) on Debian with different HDDs size jtag Linux - Server 3 04-18-2010 02:51 PM
Viewing Windows HDDs in RAID Anelysium Linux - Newbie 1 02-24-2007 10:02 PM
Can I have RAID 1 and RAID 5 with 3 HDDs? Akhran Linux - Newbie 3 10-13-2006 03:36 AM
Debian Woody r1 Installer won't detect SATA RAID HDDs on SiI 3122A bluPSU Linux - Hardware 11 01-20-2004 03:36 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware

All times are GMT -5. The time now is 01:58 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration