Looking for a Distributed File System with RAID5 like features
Linux - ServerThis forum is for the discussion of Linux Software used in a server related context.
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
Looking for a Distributed File System with RAID5 like features
Hi guys,
I am currently looking for a file system that needs to be distributed over several nodes and need redundancy, like RAID5, and the ability to grow if needed, like LVM.
Also not all nodes are going to be located in the same data center, but I guess that's not that important as long as the connection between DCs is sufficiently fast.
I am currently looking at AFS, Coda, GFS and OCFS to see if they have what I need.
Anybody got experience with this? Any suggestions?
Thanks in advance!
Dennis
Edit: I just figured that it may be better to have the RAID5-like setup within one location, and have RAID1-like mirroring between the locations. That would probably better for performance, right?
Initially this just sounds mental. Why different dc's? What is the experience you are after? Why lay one level of raid on another? Using systems like drbd you can keep two block devices identical remotely within reason but that's (afaik) an active standby model only.
I am currently looking for a file system that needs to be distributed over several nodes and need redundancy, like RAID5, and the ability to grow if needed, like LVM.
Also not all nodes are going to be located in the same data center, but I guess that's not that important as long as the connection between DCs is sufficiently fast.
I am currently looking at AFS, Coda, GFS and OCFS to see if they have what I need.
Anybody got experience with this? Any suggestions?
Thanks in advance!
Dennis
Edit: I just figured that it may be better to have the RAID5-like setup within one location, and have RAID1-like mirroring between the locations. That would probably better for performance, right?
As for the distributed volume, you can use AoE to make network block devices and then arrange them in RAID5 or 6 or a nested RAID level, like RAID5+0 or RAID5+1.
If you want to mount this distributed volume R/W in more than one server, then you need to use a shared filesystem one it.
I like OCFS2 for its simplicity.
---------- Post added 19-06-11 at 02:22 ----------
Quote:
Originally Posted by acid_kewpie
Initially this just sounds mental. Why different dc's? What is the experience you are after? Why lay one level of raid on another? Using systems like drbd you can keep two block devices identical remotely within reason but that's (afaik) an active standby model only.
You can use drbd in an active-active model, if you use a shared filesystem like OCFS2 or GFS2
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.