LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 06-21-2016, 02:06 AM   #1
Varkhond
LQ Newbie
 
Registered: Jun 2016
Posts: 2

Rep: Reputation: Disabled
Rsync first time offsite backup


Hi guys

I would like to implement an offsite backup service to my clients over the internet
Firstly my idea is to run rsnapshot on a backup box onsite to an installed disk inside the box. I would then like to rsync that backup over the internet to another aplliance at my office.

Question1: if some of the clients have slow upload speed. Can i do an rsync of the snapshot data to an external first, take it to my office copy it to the backup destination and then run the rsync again to the internet backup only saving changes from there on?

Question2: is there anything of concern that i missed for this setup? The only hickup i saw is that ranapshot uses hardlinks so i have to be sure to use the -H flag when rsyncing remotely to preserve the links

Question3: if my client backups one copy of a pst file to their server and overwrites it everyday. Will rsnap still use delta syncing to copy the file or copy the entire pst again?. I get conflicted data online regarding this and would like to know if its actually possible copy this burdon of a file incrementally.

I would really appreciate the help since im quite new to linux administration.
 
Old 06-21-2016, 10:59 AM   #2
suicidaleggroll
LQ Guru
 
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 5,353

Rep: Reputation: 1989Reputation: 1989Reputation: 1989Reputation: 1989Reputation: 1989Reputation: 1989Reputation: 1989Reputation: 1989Reputation: 1989Reputation: 1989Reputation: 1989
Answer1: Yes, as long as you use '-a' to turn on archive mode and make sure your source/destination paths are correct.

Answer2: I've never used rsnapshot, so I can't help there.

Answer3: Good question, I'm not sure. If the file was edited in-place it would do an incremental copy, one example of that is the "disk" for a VM, which is often a very large file that gets updated every time the VM is turned on. rsync will only copy the changes in the file, rather than the entire thing, but I'm not sure if that would apply to a file that gets copied and overwritten every day. My guess is it would behave the same way and do an incremental copy.
 
1 members found this post helpful.
Old 06-21-2016, 05:02 PM   #3
jefro
Moderator
 
Registered: Mar 2008
Posts: 15,658

Rep: Reputation: 2257Reputation: 2257Reputation: 2257Reputation: 2257Reputation: 2257Reputation: 2257Reputation: 2257Reputation: 2257Reputation: 2257Reputation: 2257Reputation: 2257
#3
Dunno why I think this but it should just update the changes in the file.


Might be possible to use the dry run option to see.
 
Old 06-21-2016, 06:54 PM   #4
rknichols
Senior Member
 
Registered: Aug 2009
Distribution: CentOS
Posts: 3,116

Rep: Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339
The delta-transfer algorithm in rsync spends a lot of effort to identify sections of the destination file that already match the source nd thus do not need to be transferred. Delta transfer is the default when the transfer is going to an rsync process on a remote system, but note that NFS and other network filesystems would not involve a remote rsync process and thus would be considered "local". You can alter this behavior with the "--whole-file" option to disable delta transfer or the "--no-whole-file" option (perhaps combined with "--inplace") to force delta transfer even for local files.
 
1 members found this post helpful.
Old 06-21-2016, 07:12 PM   #5
notKlaatu
Member
 
Registered: Sep 2010
Location: Wellington, New Zealand
Distribution: Slackware, Fedora
Posts: 921

Rep: Reputation: 585Reputation: 585Reputation: 585Reputation: 585Reputation: 585Reputation: 585
You might also take a look at rdiff-backup. I've been using it for about two years now, couldn't be more pleased. Truly just backs up the diffs, but makes recovery very easy.

Other than that comment, I agree with all comments above.
 
Old 06-21-2016, 07:29 PM   #6
rknichols
Senior Member
 
Registered: Aug 2009
Distribution: CentOS
Posts: 3,116

Rep: Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339Reputation: 1339
Quote:
Originally Posted by notKlaatu View Post
You might also take a look at rdiff-backup. I've been using it for about two years now, couldn't be more pleased. Truly just backs up the diffs, but makes recovery very easy.
The problem with rdiff-backup is that it's been unsupported since 2009. Yes, I use it too, but it has its share of bugs and is dependent on python-2 libraries that aren't going to be around forever. I keep looking for a substitute. SafeKeep looks promising.
 
Old 06-23-2016, 05:00 PM   #7
biosboy4
Member
 
Registered: Aug 2015
Distribution: Devuan/LFS
Posts: 239

Rep: Reputation: 38
Rsync is seriously powerful. I actually put together a VEEAM replacement with it not long ago. It does versioning and everything....
 
1 members found this post helpful.
Old 06-24-2016, 08:51 AM   #8
sundialsvcs
LQ Guru
 
Registered: Feb 2004
Location: SE Tennessee, USA
Distribution: Gentoo, LFS
Posts: 7,480

Rep: Reputation: 2376Reputation: 2376Reputation: 2376Reputation: 2376Reputation: 2376Reputation: 2376Reputation: 2376Reputation: 2376Reputation: 2376Reputation: 2376Reputation: 2376
Bear in mind that rsync normally uses timestamp and file-size information to determine if a file has been "touched," although it can also use (slower ...) "checksums."

However, your basic premise is a sound one. If the amount of data is very large, "sneaker-netting" the first set of data to your office might be expedient.

Be very sure that the backup (and all other dealings with your remote office) take place using certificate-secured OpenVPN (or IPSec) connections. Although --rsh=ssh can provide cryptographic protection for the transfer, exposing ssh to the general public invites "kiddies" to start pounding at your door.

Last edited by sundialsvcs; 06-24-2016 at 08:53 AM.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: Encrypted offsite backup with EncFS, Amazon S3, and s3cmd LXer Syndicated Linux News 1 07-31-2016 08:39 PM
rsync-based offsite backup incl SQL db bkup rjtucke Linux - Server 2 10-02-2008 09:42 AM
rsync.net opens offsite storage to entire SSH suite jbrooks Linux - Software 0 05-02-2006 04:47 PM


All times are GMT -5. The time now is 06:10 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration