LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 09-20-2010, 02:43 PM   #1
Spuddy
Member
 
Registered: Jul 2010
Posts: 83

Rep: Reputation: 15
Question rsync problems, can you look at my command? - Rsync gurus.


Hello,

I work for a company that rsyncs its media content to a datacentre daily for distribution via https to our clients. Unfortunately we've started to have problems with our rsync command/script.

It runs fine, but it seems to re-copy files that are already at the destination, of the same size and of the same date modified? We have hundreds of thousands of files, so this really cant happen. Our team here at the company use Windows XP to create the media, then put in on a the local suse server via SMB.

The code is
Code:
/usr/bin/rsync  -p --chmod=ugo+rwX -rltvH --exclude 'mc*' --exclude 'mca*' --modify-window=1 192.168.0.83::KVMediaDJV/DJVideo/Clips/mp3/ /home/ftpupload.kv_users/config/ftp/clips/mp3
Both servers local and remote are Suse 10. The target/paths are irrelevant because they are correct and work.

Local server LS -L
Code:
-rwxrwx--- 1 design kvmediagroup 4545946 Feb 15  2006 d.o.n.s. feat. techtronic - .m3e
-rwxrwx--- 1 design kvmediagroup       4 Mar 28  2008 d.o.n.s. feat. techtronic - .m3e.date
-rwxrwx--- 1 test   kvmediagroup 4494361 Jul 25  2008 d.o.n.s. feat. techtronic - _pn.m3e
For example

Remote server LS -L
Code:
-rwxrwxrwx 1 504 502 4545946 Feb 15  2006 d.o.n.s. feat. techtronic - .m3e
-rwxrwxrwx 1 504 502       4 Mar 28  2008 d.o.n.s. feat. techtronic - .m3e.date
-rwxrwxrwx 1 504 502 4494361 Jul 25  2008 d.o.n.s. feat. techtronic - _pn.m3e
As you can see local/remote files are the same, any ideas why this re-copy would happen? What's rsync playing at? We obviously just want it to sync new files and changes.
 
Old 09-20-2010, 03:15 PM   #2
Spuddy
Member
 
Registered: Jul 2010
Posts: 83

Original Poster
Rep: Reputation: 15
I have run the command from a different remote server and the rsync completes immediately without re-copying files. Why would one server notice the local/remote files are the same and another wqouldn't? IS there a file somewhere which saves file indexes or something?
 
Old 09-20-2010, 03:32 PM   #3
Guttorm
Senior Member
 
Registered: Dec 2003
Location: Trondheim, Norway
Distribution: Debian and Ubuntu
Posts: 1,449

Rep: Reputation: 446Reputation: 446Reputation: 446Reputation: 446Reputation: 446
Not sure. I'm no rsync guru, but it could help to increase --modify-window=1 to some higher number. Also you can use -v twice to get more info about what it does.

Edit: or -v 3 times to get even more info.

Last edited by Guttorm; 09-20-2010 at 03:34 PM.
 
Old 09-21-2010, 04:27 AM   #4
Spuddy
Member
 
Registered: Jul 2010
Posts: 83

Original Poster
Rep: Reputation: 15
Hello --modify-window doesn't make any difference. I tried --modify-window=3 but the same happens.

It I run the same script from another server it notes there are no changes and exits?
 
Old 09-21-2010, 10:25 AM   #5
Guttorm
Senior Member
 
Registered: Dec 2003
Location: Trondheim, Norway
Distribution: Debian and Ubuntu
Posts: 1,449

Rep: Reputation: 446Reputation: 446Reputation: 446Reputation: 446Reputation: 446
Did you try -v -v -v on the problematic server? You will get lots of output, so maybe try it with a single file. It could maybe be timezone/daylight-saving difference?
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
rsync solaris + ld.so.1: rsync: fatal: libiconv.so.2: open failed: xxx_anuj_xxx Solaris / OpenSolaris 25 02-23-2012 03:23 AM
rsync can not rsync files with include filter... xiutuo Linux - Server 2 07-23-2010 02:10 AM
Could I run rsync to download files from a server without rsync daemon? Richard.Yang Linux - Software 1 09-18-2009 04:08 AM
rsync command problems krisrae675 Linux - Newbie 17 08-01-2009 03:23 AM
Windows Rsync Upload to Linux Rsync - permissions inspleak Linux - Software 0 10-12-2004 02:49 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 10:53 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration