LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware > Linux - Embedded & Single-board computer
User Name
Password
Linux - Embedded & Single-board computer This forum is for the discussion of Linux on both embedded devices and single-board computers (such as the Raspberry Pi, BeagleBoard and PandaBoard). Discussions involving Arduino, plug computers and other micro-controller like devices are also welcome.

Notices


Reply
  Search this Thread
Old 08-30-2016, 04:03 PM   #1
MrUmunhum
Member
 
Registered: May 2006
Location: Mt Umunhum, CA, USA, Earth
Distribution: Debian/ Fedora/ Ubuntu/ Raspbian
Posts: 549

Rep: Reputation: 40
Fault tolerant Raspberry Pi cluster, maybe?


Hi group,
Hope this is the right group?
On a lark, I am contemplating building a Fault Tolerate Linux Cluster using 4 Raspberry Pis.
There are a few components that I can not figure out how to make redundant.
The set up will be as follows:
  1. 4 Raspberry Pis
  2. two power supplies, diodes to separate them.
  3. 2 USB hubs
  4. 8 USB flash drives ( 2 RAID arrays ).
  5. Ethernet hub
The main problem is all hubs are a single point of failure. Since there is only one Ethernet port on each Pi, it is not possible to connect more. The only way is to add another port would be a USB interface?

But the USB hubs are a real problem. The USB hubs will be connected to 2 different Pis. Is there a way to mirror the data from 1 Pi to another?

I hope my intentions are clear? I can figure out everything except the USB hubs. Any ideas?

Thanks for your time.
 
Old 08-31-2016, 09:17 AM   #2
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,912

Rep: Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513
As I understand the USB design, it is strictly a master/slave connection. There can only be ONE master. Thus no "mirror the data".

There is a patent (https://www.google.com/patents/US8447890) for a USB hub to allow two masters to be connected - but I have seen no products.

You can make use of the network by using a distributed filesystem that provides the redundancy. Each system would then perform the I/O to its respective USB devices.

You might be able to use iscsi to share disk level access - but that again tends to be a "master-slave" connection in that the iscsi client controls the I/O done on the iscsi target.

But doing either of these may require a kernel rebuild to that includes the iscsi modules (or distributed filesystem) for both systems.

A more complex/expensive solution is to use 4 pi nodes, two are I/O nodes acting as controllers for the respective USB attachments, the other two are the HA nodes. At that point the two I/O nodes can communicate to provide distributed access transparent to the two HA nodes. This way the two I/O processors can provide redundant NFS services - and the HA nodes use NFS failover for data, as well as HA services for one node to failover to the other.

What this doesn't get you is failover of things like USB mice/keyboards - which have to attached to only ONE hub. Using a USB-over-ethernet you can get such "sharing" during the failover from one HA node to another. But if one of the I/O nodes fail, you would lose the keyboard/mouse if they are attached to that node.

With that many nodes, you would want a network switch rather than usb network adapters (it would also simplify the network configuration (otherwise each node has to have 3 network adapters, using up the built-in USB connections - the native network connection would be to an administrative network for logging purposes... leaving only one USB connection for all the devices). Of course this also makes the network switch the single point of failure...

Last edited by jpollard; 08-31-2016 at 09:46 AM.
 
Old 08-31-2016, 09:23 AM   #3
TenTenths
Senior Member
 
Registered: Aug 2011
Location: Dublin
Distribution: Centos 5 / 6 / 7
Posts: 3,481

Rep: Reputation: 1553Reputation: 1553Reputation: 1553Reputation: 1553Reputation: 1553Reputation: 1553Reputation: 1553Reputation: 1553Reputation: 1553Reputation: 1553Reputation: 1553
Consider using a NAS device for your "large storage" and then access it over ethernet rather than USB.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Fault-tolerant backup to DVD too Ulysses_ Linux - Server 3 03-11-2013 10:57 PM
LVM Strategy for a fault tolerant server chrisinspace Linux - Server 1 01-22-2010 10:11 PM
LXer: Fault-tolerant Web hosting on a shoestring LXer Syndicated Linux News 0 05-10-2007 12:16 PM
Fault tolerant IMAP server setup mikenac Linux - Software 2 02-27-2005 10:52 AM
Fault tolerant boot? Power outages? KendersPlace Linux - General 8 07-27-2003 03:21 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware > Linux - Embedded & Single-board computer

All times are GMT -5. The time now is 12:55 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration