LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 04-06-2009, 10:11 PM   #1
edenCC
Member
 
Registered: May 2006
Location: China
Distribution: Debian
Posts: 198
Blog Entries: 1

Rep: Reputation: 32
Based on what condition, will rsync delete files?


Hi, List,

I got a critical error here on rsync. It removes some of my files without my permisstion.

I'm running RHEL-AS4U6 with the default installed rsync.
I use rsync to copy about 10TB files from one server to another.

Quote:
[datum@matrix33 data]$ cat /etc/redhat-release
Red Hat Enterprise Linux AS release 4 (Nahant Update 6)
[datum@matrix33 data]$ rsync --version
rsync version 2.6.3 protocol version 28
Copyright (C) 1996-2004 by Andrew Tridgell and others
<http://rsync.samba.org/>
Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles,
inplace, IPv6, 64-bit system inums, 64-bit internal inums

rsync comes with ABSOLUTELY NO WARRANTY. This is free software, and you
are welcome to redistribute it under certain conditions. See the GNU
General Public Licence for details.
The rsync server config files are:
Quote:
$ cat /etc/rsyncd.conf
log file = /var/log/rsyncd.log
pid file = /var/run/rsyncd.pid
lock file = /var/run/rsync.lock

[data]
path = /data
comment = dir for backup
uid = datum
gid = datum
use chroot = yes
syslog facility = local5
list = yes
read only = yes
ignore errors
hosts allow = 192.168.0.0/16

Here as the logfile says:

Quote:
file has vanished: "26/244/216/4576E91E68912F" (in data)
file has vanished: "29/243/154/4576E91D541D2F" (in data)
file has vanished: "25/247/148/4576E923EA5A2F" (in data)
file has vanished: "11/243/145/4576E91D28392F" (in data)
file has vanished: "29/246/032/4576E9222D3B2F" (in data)
file has vanished: "30/243/130/4576E91CDAEC2F" (in data)
file has vanished: "31/243/145/4576E91DC9512F" (in data)
file has vanished: "24/247/234/4576E924B7842F" (in data)
file has vanished: "14/244/103/4576E91EC0452F" (in data)
file has vanished: "31/246/104/4576E9220B872F" (in data)
file has vanished: "08/243/081/4576E91D2BE72F" (in data)
file has vanished: "31/248/145/4576E92542062F" (in data)
file has vanished: "08/247/196/4576E923B2362F" (in data)
rsync: opendir "/01/029/138/4576E848CD262F" (in data) failed: Permission denied (13)
rsync: readlink "/01/030/023/4576E84A187D2F" (in data) failed: Input/output error (5)
rsync: readlink "/01/030/023/4576E84A2EB02F" (in data) failed: Input/output error (5)
rsync: readlink "/01/030/023/4576E84AAE872F" (in data) failed: Input/output error (5)
These files are deleted from both sides, I cannot read them any more from both the source side and destination side.

It's unacceptable!
After google around, I cannot find anything helpful, is there anyone able to give me a hand please?
Thanks for any input,
all the best,
joe
 
Old 04-07-2009, 03:05 PM   #2
Quakeboy02
Senior Member
 
Registered: Nov 2006
Distribution: Debian Linux 11 (Bullseye)
Posts: 3,407

Rep: Reputation: 141Reputation: 141
Are you sure these weren't temp files that were there when you started rsync, but had been removed when rsync reached the point where it should have copied them? This can happen when you have processes running while you do your rsync backup. You would have seen a message something like "file xxx disappeared before it could be copied". I'd have to google for the exact message.
 
Old 04-07-2009, 03:16 PM   #3
AlucardZero
Senior Member
 
Registered: May 2006
Location: USA
Distribution: Debian
Posts: 4,824

Rep: Reputation: 615Reputation: 615Reputation: 615Reputation: 615Reputation: 615Reputation: 615
What flags are you passing to rsync?
 
Old 04-08-2009, 02:05 AM   #4
edenCC
Member
 
Registered: May 2006
Location: China
Distribution: Debian
Posts: 198

Original Poster
Blog Entries: 1

Rep: Reputation: 32
Quote:
Originally Posted by AlucardZero View Post
What flags are you passing to rsync?
Hi, AZ, I'm using:

/usr/bin/rsync -az --delete user@192.168.192.168::data ./ &

At the server side, "read only" has been set.
 
Old 04-08-2009, 02:10 AM   #5
edenCC
Member
 
Registered: May 2006
Location: China
Distribution: Debian
Posts: 198

Original Poster
Blog Entries: 1

Rep: Reputation: 32
Quote:
Originally Posted by Quakeboy02 View Post
Are you sure these weren't temp files that were there when you started rsync, but had been removed when rsync reached the point where it should have copied them? This can happen when you have processes running while you do your rsync backup. You would have seen a message something like "file xxx disappeared before it could be copied". I'd have to google for the exact message.
yes, I have other instances running at the same time which may delete these files.
 
Old 04-08-2009, 12:32 PM   #6
Quakeboy02
Senior Member
 
Registered: Nov 2006
Distribution: Debian Linux 11 (Bullseye)
Posts: 3,407

Rep: Reputation: 141Reputation: 141
Quote:
Originally Posted by edenCC View Post
yes, I have other instances running at the same time which may delete these files.
In that case, there may not actually be a problem. Consider the case where you make up a list of things to do, and someone else does one of the tasks before you've completed, but since they don't know about your list, they can't mark it done. It's more or less the same thing, here.
 
Old 04-09-2009, 01:21 AM   #7
edenCC
Member
 
Registered: May 2006
Location: China
Distribution: Debian
Posts: 198

Original Poster
Blog Entries: 1

Rep: Reputation: 32
Thanks, I'm much clear now

All the best - joe
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
rsync not delete non existing files on remote server proNick Linux - Software 2 09-10-2008 03:47 AM
Delete files based on current date -1 Winanjaya Linux - Newbie 3 06-23-2008 04:38 AM
delete files based on keywords pinoyskull Linux - Newbie 17 07-03-2007 01:44 PM
Delete files based on date stefaandk Linux - General 3 06-17-2005 02:20 AM
cron job to delete files based on attributes alpha21 Linux - General 3 11-09-2004 12:06 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 03:06 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration