LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 06-17-2011, 11:18 PM   #1
reptiler
Member
 
Registered: Mar 2009
Location: Hong Kong
Distribution: Fedora
Posts: 184

Rep: Reputation: 42
Looking for a Distributed File System with RAID5 like features


Hi guys,

I am currently looking for a file system that needs to be distributed over several nodes and need redundancy, like RAID5, and the ability to grow if needed, like LVM.
Also not all nodes are going to be located in the same data center, but I guess that's not that important as long as the connection between DCs is sufficiently fast.

I am currently looking at AFS, Coda, GFS and OCFS to see if they have what I need.

Anybody got experience with this? Any suggestions?

Thanks in advance!
Dennis

Edit: I just figured that it may be better to have the RAID5-like setup within one location, and have RAID1-like mirroring between the locations. That would probably better for performance, right?

Last edited by reptiler; 06-17-2011 at 11:32 PM.
 
Old 06-18-2011, 03:49 PM   #2
acid_kewpie
Moderator
 
Registered: Jun 2001
Location: UK
Distribution: Gentoo, RHEL, Fedora, Centos
Posts: 43,417

Rep: Reputation: 1985Reputation: 1985Reputation: 1985Reputation: 1985Reputation: 1985Reputation: 1985Reputation: 1985Reputation: 1985Reputation: 1985Reputation: 1985Reputation: 1985
Initially this just sounds mental. Why different dc's? What is the experience you are after? Why lay one level of raid on another? Using systems like drbd you can keep two block devices identical remotely within reason but that's (afaik) an active standby model only.
 
Old 06-18-2011, 08:22 PM   #3
Slax-Dude
Member
 
Registered: Mar 2006
Location: Valadares, V.N.Gaia, Portugal
Distribution: Slackware
Posts: 528

Rep: Reputation: 272Reputation: 272Reputation: 272
Quote:
Originally Posted by reptiler View Post
Hi guys,

I am currently looking for a file system that needs to be distributed over several nodes and need redundancy, like RAID5, and the ability to grow if needed, like LVM.
Also not all nodes are going to be located in the same data center, but I guess that's not that important as long as the connection between DCs is sufficiently fast.

I am currently looking at AFS, Coda, GFS and OCFS to see if they have what I need.

Anybody got experience with this? Any suggestions?

Thanks in advance!
Dennis

Edit: I just figured that it may be better to have the RAID5-like setup within one location, and have RAID1-like mirroring between the locations. That would probably better for performance, right?
As for the distributed volume, you can use AoE to make network block devices and then arrange them in RAID5 or 6 or a nested RAID level, like RAID5+0 or RAID5+1.

If you want to mount this distributed volume R/W in more than one server, then you need to use a shared filesystem one it.
I like OCFS2 for its simplicity.

---------- Post added 19-06-11 at 02:22 ----------

Quote:
Originally Posted by acid_kewpie View Post
Initially this just sounds mental. Why different dc's? What is the experience you are after? Why lay one level of raid on another? Using systems like drbd you can keep two block devices identical remotely within reason but that's (afaik) an active standby model only.
You can use drbd in an active-active model, if you use a shared filesystem like OCFS2 or GFS2
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Distributed/Replicated file system bmcguire Linux - Software 4 05-17-2010 05:57 PM
Distributed file storage with RAID5 alike features vasko2grama Linux - Server 3 10-16-2009 09:03 PM
distributed file system + transparancy computer General 0 08-15-2006 10:31 AM
Fam with Distributed File System libertarian Linux - Software 0 02-15-2006 05:46 AM
Distributed file system in Linux? longblock454 Linux - Networking 4 11-02-2004 05:37 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 11:05 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration