LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Software (http://www.linuxquestions.org/questions/linux-software-2/)
-   -   rsync problems, can you look at my command? - Rsync gurus. (http://www.linuxquestions.org/questions/linux-software-2/rsync-problems-can-you-look-at-my-command-rsync-gurus-833397/)

Spuddy 09-20-2010 02:43 PM

rsync problems, can you look at my command? - Rsync gurus.
 
Hello,

I work for a company that rsyncs its media content to a datacentre daily for distribution via https to our clients. Unfortunately we've started to have problems with our rsync command/script.

It runs fine, but it seems to re-copy files that are already at the destination, of the same size and of the same date modified? We have hundreds of thousands of files, so this really cant happen. Our team here at the company use Windows XP to create the media, then put in on a the local suse server via SMB.

The code is
Code:

/usr/bin/rsync  -p --chmod=ugo+rwX -rltvH --exclude 'mc*' --exclude 'mca*' --modify-window=1 192.168.0.83::KVMediaDJV/DJVideo/Clips/mp3/ /home/ftpupload.kv_users/config/ftp/clips/mp3
Both servers local and remote are Suse 10. The target/paths are irrelevant because they are correct and work.

Local server LS -L
Code:

-rwxrwx--- 1 design kvmediagroup 4545946 Feb 15  2006 d.o.n.s. feat. techtronic - .m3e
-rwxrwx--- 1 design kvmediagroup      4 Mar 28  2008 d.o.n.s. feat. techtronic - .m3e.date
-rwxrwx--- 1 test  kvmediagroup 4494361 Jul 25  2008 d.o.n.s. feat. techtronic - _pn.m3e

For example

Remote server LS -L
Code:

-rwxrwxrwx 1 504 502 4545946 Feb 15  2006 d.o.n.s. feat. techtronic - .m3e
-rwxrwxrwx 1 504 502      4 Mar 28  2008 d.o.n.s. feat. techtronic - .m3e.date
-rwxrwxrwx 1 504 502 4494361 Jul 25  2008 d.o.n.s. feat. techtronic - _pn.m3e

As you can see local/remote files are the same, any ideas why this re-copy would happen? What's rsync playing at? We obviously just want it to sync new files and changes.

Spuddy 09-20-2010 03:15 PM

I have run the command from a different remote server and the rsync completes immediately without re-copying files. Why would one server notice the local/remote files are the same and another wqouldn't? IS there a file somewhere which saves file indexes or something?

Guttorm 09-20-2010 03:32 PM

Not sure. I'm no rsync guru, but it could help to increase --modify-window=1 to some higher number. Also you can use -v twice to get more info about what it does.

Edit: or -v 3 times to get even more info.

Spuddy 09-21-2010 04:27 AM

Hello --modify-window doesn't make any difference. I tried --modify-window=3 but the same happens.

It I run the same script from another server it notes there are no changes and exits?

Guttorm 09-21-2010 10:25 AM

Did you try -v -v -v on the problematic server? You will get lots of output, so maybe try it with a single file. It could maybe be timezone/daylight-saving difference?


All times are GMT -5. The time now is 04:02 AM.