Based on what condition, will rsync delete files?

edenCC · 04-06-2009, 10:11 PM

Hi, List,

I got a critical error here on rsync. It removes some of my files without my permisstion.

I'm running RHEL-AS4U6 with the default installed rsync.
I use rsync to copy about 10TB files from one server to another.

Quote:

[datum@matrix33 data]$ cat /etc/redhat-release
Red Hat Enterprise Linux AS release 4 (Nahant Update 6)
[datum@matrix33 data]$ rsync --version
rsync version 2.6.3 protocol version 28
Copyright (C) 1996-2004 by Andrew Tridgell and others
<http://rsync.samba.org/>
Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles,
inplace, IPv6, 64-bit system inums, 64-bit internal inums

rsync comes with ABSOLUTELY NO WARRANTY. This is free software, and you
are welcome to redistribute it under certain conditions. See the GNU
General Public Licence for details.

The rsync server config files are:

Quote:

$ cat /etc/rsyncd.conf
log file = /var/log/rsyncd.log
pid file = /var/run/rsyncd.pid
lock file = /var/run/rsync.lock

[data]
path = /data
comment = dir for backup
uid = datum
gid = datum
use chroot = yes
syslog facility = local5
list = yes
read only = yes
ignore errors
hosts allow = 192.168.0.0/16

Here as the logfile says:

Quote:

file has vanished: "26/244/216/4576E91E68912F" (in data)
file has vanished: "29/243/154/4576E91D541D2F" (in data)
file has vanished: "25/247/148/4576E923EA5A2F" (in data)
file has vanished: "11/243/145/4576E91D28392F" (in data)
file has vanished: "29/246/032/4576E9222D3B2F" (in data)
file has vanished: "30/243/130/4576E91CDAEC2F" (in data)
file has vanished: "31/243/145/4576E91DC9512F" (in data)
file has vanished: "24/247/234/4576E924B7842F" (in data)
file has vanished: "14/244/103/4576E91EC0452F" (in data)
file has vanished: "31/246/104/4576E9220B872F" (in data)
file has vanished: "08/243/081/4576E91D2BE72F" (in data)
file has vanished: "31/248/145/4576E92542062F" (in data)
file has vanished: "08/247/196/4576E923B2362F" (in data)
rsync: opendir "/01/029/138/4576E848CD262F" (in data) failed: Permission denied (13)
rsync: readlink "/01/030/023/4576E84A187D2F" (in data) failed: Input/output error (5)
rsync: readlink "/01/030/023/4576E84A2EB02F" (in data) failed: Input/output error (5)
rsync: readlink "/01/030/023/4576E84AAE872F" (in data) failed: Input/output error (5)

These files are deleted from both sides, I cannot read them any more from both the source side and destination side.

It's unacceptable!
After google around, I cannot find anything helpful, is there anyone able to give me a hand please?
Thanks for any input,
all the best,
joe

Quakeboy02 · 04-07-2009, 03:05 PM

Are you sure these weren't temp files that were there when you started rsync, but had been removed when rsync reached the point where it should have copied them? This can happen when you have processes running while you do your rsync backup. You would have seen a message something like "file xxx disappeared before it could be copied". I'd have to google for the exact message.

AlucardZero · 04-07-2009, 03:16 PM

What flags are you passing to rsync?

edenCC · 04-08-2009, 02:05 AM

Quote:

Originally Posted by AlucardZero

What flags are you passing to rsync?

Hi, AZ, I'm using:

/usr/bin/rsync -az --delete user@192.168.192.168::data ./ &

At the server side, "read only" has been set.

edenCC · 04-08-2009, 02:10 AM

Quote:

Originally Posted by Quakeboy02

Are you sure these weren't temp files that were there when you started rsync, but had been removed when rsync reached the point where it should have copied them? This can happen when you have processes running while you do your rsync backup. You would have seen a message something like "file xxx disappeared before it could be copied". I'd have to google for the exact message.

yes, I have other instances running at the same time which may delete these files.

Quakeboy02 · 04-08-2009, 12:32 PM

Quote:

Originally Posted by edenCC

yes, I have other instances running at the same time which may delete these files.

In that case, there may not actually be a problem. Consider the case where you make up a list of things to do, and someone else does one of the tasks before you've completed, but since they don't know about your list, they can't mark it done. It's more or less the same thing, here.

edenCC · 04-09-2009, 01:21 AM

Thanks, I'm much clear now

All the best - joe