LinuxQuestions.org
Did you know LQ has a Linux Hardware Compatibility List?
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices

Reply
 
Search this Thread
Old 09-06-2007, 11:36 AM   #1
wh33t
Member
 
Registered: Oct 2003
Location: Canada
Distribution: Ubuntu LTS
Posts: 427

Rep: Reputation: 34
More Rsync help please


Hey guys,

I've managed to figure out how to get Rsync working across the network with ssh with out needing a log in password. I ran rsync yesterday against our main server in the office and it backed up 600GB of data in a few hours. I ran it this morning expecting to see it only update <50mb but it looks like its gonna download all 600GB again...

What I would like is for it to only download the changed files, or even better, just download the binary differences from the server. Could someone post me an rsync command that would allow me to do this? I've read the manpage and there is so many options, i have no idea in what order or which ones to use to pull this off and i've tried a few, and at 600GB a try it's quickly wasting my life. Thanks guys.
 
Old 09-06-2007, 12:02 PM   #2
AlucardZero
Senior Member
 
Registered: May 2006
Location: USA
Distribution: Debian
Posts: 4,625

Rep: Reputation: 518Reputation: 518Reputation: 518Reputation: 518Reputation: 518Reputation: 518
It only transfers the changes, by default. Are you backing up to a different place?
 
Old 09-06-2007, 12:17 PM   #3
wh33t
Member
 
Registered: Oct 2003
Location: Canada
Distribution: Ubuntu LTS
Posts: 427

Original Poster
Rep: Reputation: 34
Well I should say, I am running rsync through rsync for windows, and using the win32 binary of openSSH and cygwin.dll to make all this happen. I ran the exact same command and I saw it downloading all these files again. I was expecting it to see it update just a few changes and that's all. The files I am backing up are all Virtual Machines. Rsync would have the ability to read the difference of binary data and just send that wouldn't it?
 
Old 09-06-2007, 12:23 PM   #4
wh33t
Member
 
Registered: Oct 2003
Location: Canada
Distribution: Ubuntu LTS
Posts: 427

Original Poster
Rep: Reputation: 34
I'm running

Code:
rsync -avzr --progress user@ipaddress:/mnt/ x:\
And that ended up downloading 191GB. Much less than the 600Gb before. So I was wrong about it downloading everything all over again, but I promise 191GB haven't changed since last night.
 
Old 09-06-2007, 12:41 PM   #5
wh33t
Member
 
Registered: Oct 2003
Location: Canada
Distribution: Ubuntu LTS
Posts: 427

Original Poster
Rep: Reputation: 34
Ok, after doing more research I have discovered that I am probably reading the progress bars incorrectly. When I see the progress bar saying 32MB/s I think that means it's scanning the file for changes at that speed. Not transfering? I think 191GB is the size of everything that it checked. The transfered data might be as small as a few hundred kilobytes. That sounds a little better doesn't it?
 
  


Reply

Tags
backup, rsync, update


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
rsync redline1022 Linux - Software 1 11-13-2006 11:33 PM
Rsync server vs rsync over ssh humbletech99 Linux - Networking 1 10-18-2006 12:10 PM
rsync help! slack66 Linux - Newbie 1 10-27-2005 07:40 AM
Windows Rsync Upload to Linux Rsync - permissions inspleak Linux - Software 0 10-12-2004 02:49 PM
rsync becks.lin Linux - Software 6 03-22-2004 07:45 PM


All times are GMT -5. The time now is 08:19 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration