Review your favorite Linux distribution.
Go Back > Forums > Linux Forums > Linux - Server
User Name
Linux - Server This forum is for the discussion of Linux Software used in a server related context.


  Search this Thread
Old 07-02-2007, 11:36 AM   #1
Registered: Jun 2005
Posts: 374

Rep: Reputation: 30
Scalable Storage Clustering with redundancy? What to use?

I'm looking at implementing a large and scalable storage solution to replace lots of file servers which needs to meet the following requirements:

1. Redundancy
2. Scalability/Expandability
3. Performance
4. Single Directory tree for all storage
5. Preferably runs on Linux, my favourite.
6. Preferably on commodity hardware that is easy to replace/add, although not necessary

Ideally I'd like it to have something like a Global Filesystem like AFS or Microsoft's DFS where everything is organized into one directory tree, but also to have redundancy and data security like a Cluster Filesystem, so if one or more nodes breaks then it still works and we just put in new nodes. I also need to be able to extend it by putting in new nodes so that I can make the storage grow indefinitely.

At the moment my storage requirements are 15-30TB, but this will increase and so I need to able to add more space by adding more nodes.

What I think I am really after is a Cluster FileSystem, something like the Google File System, except that is not available cos Google are evil and eat up lots of talented open source people and keep cool stuff like that to themselves.

Ideally the solution should also be fast and reliable, so that I can crunch data on it from other servers.
Of course it doesn't __have__ to be open source or unixy or anything, but it would be nice...

Any ideas?
Old 07-02-2007, 10:20 PM   #2
Senior Member
Registered: Dec 2005
Location: Massachusetts, USA
Distribution: Ubuntu 10.04 and CentOS 5.5
Posts: 3,873

Rep: Reputation: 332Reputation: 332Reputation: 332Reputation: 332
It sounds to me like you are ready to start looking at the big EMC boxes. They work great. Instantaneous snapshots, redundancy, mirroring, and lots more.
Old 07-03-2007, 05:04 AM   #3
Registered: Jun 2005
Posts: 374

Original Poster
Rep: Reputation: 30
thanks I'll take a lot, anything you would recommend in particular?


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: Scalable anonymity with I2P LXer Syndicated Linux News 1 02-05-2008 01:40 AM
Scalable, cheap disk storage? (Hypothetical, interested in ideas) tormentum Linux - General 4 06-09-2006 03:34 AM
what is the Scalable numerical algorithms ztdep Linux - Software 1 01-15-2006 02:32 AM
Scalable Font Problem, Please Help Skywing Linux - General 4 03-09-2005 01:35 PM
XFree86 xfonts-scalable errors krazj73 Linux - Newbie 1 03-06-2004 01:49 AM > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 09:42 AM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration