LinuxQuestions.org
Register a domain and help support LQ
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware
User Name
Password
Linux - Hardware This forum is for Hardware issues.
Having trouble installing a piece of hardware? Want to know if that peripheral is compatible with Linux?

Notices


Reply
 
Search this Thread
Old 07-30-2014, 09:47 PM   #1
Wocky
Member
 
Registered: Oct 2004
Location: Australia
Posts: 34

Rep: Reputation: 2
Backup options


Not really sure if this is the right forum for this, but I'm not really sure if this is the right website for this, either.

A couple of years ago I built myself a home-made NAS. While it presently has 160 TB of storage space, in its present form it can support up to 1PiB, and is easily expandable to at least 4PiB (probably more, but I haven't really tested its limits.) I've gone out of my way to it as reliable as possible (registered ECC RAM; dual power supplies with built-in battery backup; RAID-6 with 3 redundant disks instead of 2; enterprise-level rather than domestic disks; ZFS for its self-healing and provable data integrity properties) but I can't prevent physical loss due to theft or fire, so I need to keep off-site backups.

What are my options? Online backup or cloud storage is not really an option: even if there were companies able to provide this kind of storage (some claim to provide infinite storage, but don't) uploading or downloading even the data I've got now (about 140TB) would take too long, even at the fastest data rates I've got available to me. LTO-6 tapes can only hold up to 2.5TB (more with compression, but still way too little). LTO-8, which is planned but not yet implemented, should have up to 12.5TB capacity, but (a) it's still too small and (b) it's not even available. External drives are still much too small (an external enclosure with the biggest disk available can still only hold 4TB). I could build a duplicate NAS, but it would still need to be kept off-site, and keeping it synchronised would still be an issue.

Any suggestions?
 
Old 07-30-2014, 10:03 PM   #2
notKlaatu
Member
 
Registered: Sep 2010
Location: Wellington, New Zealand
Distribution: Slackware
Posts: 467

Rep: Reputation: 126Reputation: 126
Mhy not build a second NAS like your first, keep it off site, and run nightly or weekly rsync's to keep the two up to date? Unless you are generating terabytes of data each day, the rsyncs should be manageable over a common network.
 
Old 07-31-2014, 11:14 AM   #3
lleb
Senior Member
 
Registered: Dec 2005
Location: Florida
Distribution: CentOS/Fedora
Posts: 2,602

Rep: Reputation: 486Reputation: 486Reputation: 486Reputation: 486Reputation: 486
just a side note to what notKlaatu stated, and IMHO he is correct, when you make the 2nd NAS like your first, perform the first rsync local over your LAN, then move the 2nd NAS off site. this will reduce the bandwidth required nightly/weekly for the rsync backups.

also keep in mind if you are only looking for a 1:1 backup with zero tolerance that would be fine, but a true backup will have at least 7 different states of data. one of the simpler means is to backup daily and keep 7 days worth of backups. that way if the data is corrupted on say a Tue and its not caught until a Fri, you can still roll back to the previous Mon's data and have minimal data loss.
 
1 members found this post helpful.
Old 08-04-2014, 09:54 AM   #4
Beryllos
Member
 
Registered: Apr 2013
Location: Massachusetts
Distribution: Debian
Posts: 211

Rep: Reputation: 70
Are you using any kind of deduplication?
 
  


Reply

Tags
backup, backupoptions


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Backup Options herrmag Linux - General 5 04-30-2007 11:37 AM
backup with tar: which options? Lotharster Linux - Newbie 1 06-08-2006 01:32 PM
Backup options kkiedrowski Slackware 5 12-13-2005 10:44 AM
Backup options jrdioko Linux - Software 2 11-28-2004 12:11 AM
Backup Options? Snump Linux - Hardware 7 10-02-2004 09:34 PM


All times are GMT -5. The time now is 05:16 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration