rsync not deleting the destinations while using /* wild card in linux

boby.kumar · 11-29-2013, 02:08 AM

Hi Team

I have a rsync on going for below two remote dir.

rsync -avg --delete /home/abc/* Host@Server:/home/jasmine/foo/

its not deleting the files or dir at receiving end if not exists at sending side.

while using without * its working properly like for

rsync -avg --delete /home/abc/ Host@Server:/home/jasmine/foo/

can anyone have any idea how to use --delete option with wild card for the same. i am totally stucked here.

Thanks in Advance

druuna · 11-29-2013, 02:24 AM

To my knowledge you cannot use --delete and wild-cards together, this from the rsync manual page:

Quote:

This tells rsync to delete extraneous files from the receiving
side (ones that aren’t on the sending side), but only for the
directories that are being synchronized. You must have asked
rsync to send the whole directory (e.g. "dir" or "dir/") without
using a wildcard for the directory’s contents (e.g. "dir/*")
since the wildcard is expanded by the shell and rsync thus gets
a request to transfer individual files, not the files’ parent
directory.

boby.kumar · 11-29-2013, 03:12 AM

thanks.

How will be this if I use --delete-excluded for the same. I have no option without wild card for rsync.

Is another way for this?

druuna · 11-29-2013, 03:26 AM

Without knowing exactly what it is you are trying to accomplish it is rather hard to help you.

If I look at your first post I wonder why you need to use the wildcard, why not use the example that works?

Code:

rsync -avg --delete /home/abc/ Host@Server:/home/jasmine/foo/

If wanted/needed you can add --exclude somedir/* --delete-excluded

Maybe this will help (examples and explanations):
- What exactly will --delete-excluded do for rsync?
- rsync

boby.kumar · 11-29-2013, 03:53 AM

yes. The actually point is rsync to different destination from the same source like this..

[rsync -avg --delete /home/abc/QW2* Host@Server:/home/jasmine/foo/

rsync -avg --delete /home/abc/PM* Host@Server:/home/jasmine/ZOO/
.
.
.
.

rsync -avg --delete /home/abc/PL123* Host@Server:/home/jasmine/foo12/

Actually /home/abc have the different dir and files. so i need to copy individually rather than whole dir.

Is the idea clear? so i am using wild card(*) for the same.

Thanks again.

druuna · 11-29-2013, 04:11 AM

Quote:

Originally Posted by boby.kumar

yes. The actually point is rsync to different destination from the same source like this..
rsync -avg --delete /home/abc/QW2* Host@Server:/home/jasmine/foo/
rsync -avg --delete /home/abc/PM* Host@Server:/home/jasmine/ZOO/
rsync -avg --delete /home/abc/PL123* Host@Server:/home/jasmine/foo12/

Actually /home/abc have the different dir and files. so i need to copy individually rather than whole dir.

Is the idea clear? so i am using wild card(*) for the same.

It is not clear if QW2* / PM* / PL123* are files or directories.

Assuming they are directories, give this a try:

Code:

rsync -avg --delete /home/abc/QW2*/ Host@Server:/home/jasmine/foo/

Mind the slash....

boby.kumar · 11-29-2013, 06:45 AM

Thanks a lot druuna.

Its working but not our expectations as we were looking. Its coping only directory content without directory name.

Generally it should be for us with directory+content for the same time as rsync going

druuna · 11-29-2013, 08:51 AM

I had time to test this and this is the result:

Directories (and content) that need to be rsync-ed: /home/druuna/Foo and /home/druuna/FooBar

Content of those directories:

Code:

$ ls -l Foo/ Foo/Foo2/ FooBar/
Foo/:
total 4
drwxr-x--- 2 druuna druuna 4096 nov 29 15:43 Foo2
-rw-r----- 1 druuna druuna    0 nov 29 15:43 foo.1
-rw-r----- 1 druuna druuna    0 nov 29 15:34 foo.2
-rw-r----- 1 druuna druuna    0 nov 29 15:34 foo.3

Foo/Foo2/:
total 0
-rw-r----- 1 druuna druuna 0 nov 29 15:43 foo2.1
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foo2.2
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foo2.3

FooBar/:
total 0
-rw-r----- 1 druuna druuna 0 nov 29 15:44 foobar.1
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foobar.2
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foobar.3

Content of /data/General/Target/ before syncing:

Code:

$ ls -l /data/General/Target/
total 0

Running rsync:

Code:

$ rsync -avg --delete /home/druuna/Fo* /data/General/Target/
sending incremental file list
Foo/
Foo/foo.1
Foo/foo.2
Foo/foo.3
Foo/Foo2/
Foo/Foo2/foo2.1
Foo/Foo2/foo2.2
Foo/Foo2/foo2.3
FooBar/
FooBar/foobar.1
FooBar/foobar.2
FooBar/foobar.3

sent 585 bytes  received 195 bytes  1560.00 bytes/sec
total size is 0  speedup is 0.00

Content of /data/General/Target/ after syncing:

Code:

$ ls -l /data/General/Target/* /data/General/Target/Foo/Foo2/
/data/General/Target/Foo:
total 4
drwxr-x--- 2 druuna druuna 4096 nov 29 15:43 Foo2
-rw-r----- 1 druuna druuna    0 nov 29 15:43 foo.1
-rw-r----- 1 druuna druuna    0 nov 29 15:34 foo.2
-rw-r----- 1 druuna druuna    0 nov 29 15:34 foo.3

/data/General/Target/Foo/Foo2/:
total 0
-rw-r----- 1 druuna druuna 0 nov 29 15:43 foo2.1
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foo2.2
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foo2.3

/data/General/Target/FooBar:
total 0
-rw-r----- 1 druuna druuna 0 nov 29 15:44 foobar.1
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foobar.2
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foobar.3

Remove Foo/foo.1, Foo/Foo2/foo2.1 and FooBar/foobar.1 and sync again:

Code:

$ rm Foo/foo.1 Foo/Foo2/foo2.1 FooBar/foobar.1
$ rsync -avg --delete /home/druuna/Fo* /data/General/Target/
sending incremental file list
Foo/
deleting Foo/foo.1
Foo/Foo2/
deleting Foo/Foo2/foo2.1
FooBar/
deleting FooBar/foobar.1

sent 185 bytes  received 24 bytes  418.00 bytes/sec
total size is 0  speedup is 0.00

Content of /data/General/Target/ after syncing:

Code:

$ ls -l /data/General/Target/* /data/General/Target/Foo/Foo2/
/data/General/Target/Foo:
total 4
drwxr-x--- 2 druuna druuna 4096 nov 29 15:49 Foo2
-rw-r----- 1 druuna druuna    0 nov 29 15:34 foo.2
-rw-r----- 1 druuna druuna    0 nov 29 15:34 foo.3

/data/General/Target/Foo/Foo2/:
total 0
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foo2.2
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foo2.3

/data/General/Target/FooBar:
total 0
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foobar.2
-rw-r----- 1 druuna druuna 0 nov 29 15:34 foobar.3

Works like a charm....