Did you know LQ has a Linux Hardware Compatibility List?
Go Back > Forums > Linux Forums > Linux - Hardware
User Name
Linux - Hardware This forum is for Hardware issues.
Having trouble installing a piece of hardware? Want to know if that peripheral is compatible with Linux?


  Search this Thread
Old 07-30-2014, 10:47 PM   #1
Registered: Oct 2004
Location: Australia
Posts: 37

Rep: Reputation: 2
Backup options

Not really sure if this is the right forum for this, but I'm not really sure if this is the right website for this, either.

A couple of years ago I built myself a home-made NAS. While it presently has 160 TB of storage space, in its present form it can support up to 1PiB, and is easily expandable to at least 4PiB (probably more, but I haven't really tested its limits.) I've gone out of my way to it as reliable as possible (registered ECC RAM; dual power supplies with built-in battery backup; RAID-6 with 3 redundant disks instead of 2; enterprise-level rather than domestic disks; ZFS for its self-healing and provable data integrity properties) but I can't prevent physical loss due to theft or fire, so I need to keep off-site backups.

What are my options? Online backup or cloud storage is not really an option: even if there were companies able to provide this kind of storage (some claim to provide infinite storage, but don't) uploading or downloading even the data I've got now (about 140TB) would take too long, even at the fastest data rates I've got available to me. LTO-6 tapes can only hold up to 2.5TB (more with compression, but still way too little). LTO-8, which is planned but not yet implemented, should have up to 12.5TB capacity, but (a) it's still too small and (b) it's not even available. External drives are still much too small (an external enclosure with the biggest disk available can still only hold 4TB). I could build a duplicate NAS, but it would still need to be kept off-site, and keeping it synchronised would still be an issue.

Any suggestions?
Old 07-30-2014, 11:03 PM   #2
Registered: Sep 2010
Location: Wellington, New Zealand
Distribution: Slackware
Posts: 484

Rep: Reputation: 133Reputation: 133
Mhy not build a second NAS like your first, keep it off site, and run nightly or weekly rsync's to keep the two up to date? Unless you are generating terabytes of data each day, the rsyncs should be manageable over a common network.
Old 07-31-2014, 12:14 PM   #3
Senior Member
Registered: Dec 2005
Location: Florida
Distribution: CentOS/Fedora
Posts: 2,625

Rep: Reputation: 487Reputation: 487Reputation: 487Reputation: 487Reputation: 487
just a side note to what notKlaatu stated, and IMHO he is correct, when you make the 2nd NAS like your first, perform the first rsync local over your LAN, then move the 2nd NAS off site. this will reduce the bandwidth required nightly/weekly for the rsync backups.

also keep in mind if you are only looking for a 1:1 backup with zero tolerance that would be fine, but a true backup will have at least 7 different states of data. one of the simpler means is to backup daily and keep 7 days worth of backups. that way if the data is corrupted on say a Tue and its not caught until a Fri, you can still roll back to the previous Mon's data and have minimal data loss.
1 members found this post helpful.
Old 08-04-2014, 10:54 AM   #4
Registered: Apr 2013
Location: Massachusetts
Distribution: Debian
Posts: 263

Rep: Reputation: 89
Are you using any kind of deduplication?


backup, backupoptions

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
Backup Options herrmag Linux - General 5 04-30-2007 12:37 PM
backup with tar: which options? Lotharster Linux - Newbie 1 06-08-2006 02:32 PM
Backup options kkiedrowski Slackware 5 12-13-2005 11:44 AM
Backup options jrdioko Linux - Software 2 11-28-2004 01:11 AM
Backup Options? Snump Linux - Hardware 7 10-02-2004 10:34 PM

All times are GMT -5. The time now is 10:51 PM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration