LinuxQuestions.org
Help answer threads with 0 replies.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices

Reply
 
LinkBack Search this Thread
Old 07-02-2007, 10:36 AM   #1
humbletech99
Member
 
Registered: Jun 2005
Posts: 374

Rep: Reputation: 30
Scalable Storage Clustering with redundancy? What to use?


I'm looking at implementing a large and scalable storage solution to replace lots of file servers which needs to meet the following requirements:

1. Redundancy
2. Scalability/Expandability
3. Performance
4. Single Directory tree for all storage
5. Preferably runs on Linux, my favourite.
6. Preferably on commodity hardware that is easy to replace/add, although not necessary

Ideally I'd like it to have something like a Global Filesystem like AFS or Microsoft's DFS where everything is organized into one directory tree, but also to have redundancy and data security like a Cluster Filesystem, so if one or more nodes breaks then it still works and we just put in new nodes. I also need to be able to extend it by putting in new nodes so that I can make the storage grow indefinitely.

At the moment my storage requirements are 15-30TB, but this will increase and so I need to able to add more space by adding more nodes.

What I think I am really after is a Cluster FileSystem, something like the Google File System, except that is not available cos Google are evil and eat up lots of talented open source people and keep cool stuff like that to themselves.

Ideally the solution should also be fast and reliable, so that I can crunch data on it from other servers.
Of course it doesn't __have__ to be open source or unixy or anything, but it would be nice...

Any ideas?
 
Old 07-02-2007, 09:20 PM   #2
stress_junkie
Senior Member
 
Registered: Dec 2005
Location: Massachusetts, USA
Distribution: Ubuntu 10.04 and CentOS 5.5
Posts: 3,873

Rep: Reputation: 331Reputation: 331Reputation: 331Reputation: 331
It sounds to me like you are ready to start looking at the big EMC boxes. They work great. Instantaneous snapshots, redundancy, mirroring, and lots more.
 
Old 07-03-2007, 04:04 AM   #3
humbletech99
Member
 
Registered: Jun 2005
Posts: 374

Original Poster
Rep: Reputation: 30
thanks I'll take a lot, anything you would recommend in particular?
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: Scalable anonymity with I2P LXer Syndicated Linux News 1 02-05-2008 12:40 AM
Scalable, cheap disk storage? (Hypothetical, interested in ideas) tormentum Linux - General 4 06-09-2006 02:34 AM
what is the Scalable numerical algorithms ztdep Linux - Software 1 01-15-2006 01:32 AM
Scalable Font Problem, Please Help Skywing Linux - General 4 03-09-2005 12:35 PM
XFree86 xfonts-scalable errors krazj73 Linux - Newbie 1 03-06-2004 12:49 AM


All times are GMT -5. The time now is 08:33 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration