[SOLVED] first time use of rsync: few errors are coming; any advice how to solve it is welcome

floppy_stuttgart · 12-26-2013, 05:19 PM

hello,
since I installed a central house server with printer/storage during christmas ("raspberry pi" with raspbian), I am making the first backup with the raspberry and a 500GB drive attached to it.
I use the command:

Quote:

rsync -avz ~/* rsync://192.168.178.50/asusfamily

(copy of files on a central house server)

Few error messages are coming and it seems this must be solved. For the reason this is the first time in my life I am using rsync (I used "mc" for file copy/backup before), I kindly ask here for few answer in order for me to solve quicker the issues.

Start of the messages of rsync

Code:

sending incremental file list 
examples.desktop 
Arbeitsfläche/

..
the rsync seems not to create any new directory (ok for me):

Code:

rsync: recv_generator: mkdir "/Arbeitsfläche" (in asusfamily) failed: Permission denied (13) 
*** Skipping any contents from this failed directory ***

..
A time stamps can not be created. This is probably an issue for the comparison of new/old files. How to solve this?

Code:

Bilder/ 
rsync: failed to set times on "/Bilder" (in asusfamily): Operation not permitted (1)

--
Set permissions not possible.. how to solve this? this is probably disturbing the update of files.

Code:

Bilder/Fotos_Family/2008/CiaraChristening/ 
rsync: failed to set permissions on "/Bilder/Fotos_Family/2008/CiaraChristening" (in asusfamily): Operation not permitted (1)

..

Code:

sent 87512 bytes  received 280 bytes  35116.80 bytes/sec 
total size is 2480295900  speedup is 28251.96 
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1070) [sender=3.0.9]

End of the messages.

rknichols · 12-26-2013, 05:31 PM

Is your server trying to store the files on any type of FAT or NTFS filesystem? Those filesystems do not support Unix-style permissions and timestamps.

roberto32 · 12-26-2013, 06:06 PM

and consider using backintime - it uses rsync but it has a nice GUI so smaller chance of making mistake. And for the future try btrfs (it makes snapshots by default), on my suse 13.1 I can easily manage it via snapper. Try to look at rsyncd.conf

floppy_stuttgart · 12-27-2013, 10:03 AM

Quote:

Originally Posted by rknichols

Is your server trying to store the files on any type of FAT or NTFS filesystem? Those filesystems do not support Unix-style permissions and timestamps.

This is an ext4 filesystem

floppy_stuttgart · 12-29-2013, 04:44 PM

Hello,
I am still working on rsync (I will try backintime later).
There a differences between a dry run and a run. Why? (option "n").
The first one dont show errors.
The second one yes.

rsync -nvurz * rsync://192.168.178.50/asusfamily

Quote:

sending incremental file list
examples.desktop
Arbeitsfläche/
Arbeitsfläche/2012-13individual.pdf
Arbeitsfläche/2012-13timetable all.pdf
...
Arbeitsfläche/samsung_gt_s5660_galaxy_gio.pdf
Dokumente/testfilebackup.odt
Dokumente/Jxxxxxx
...
Dokumente/Temp/test.kig
Downloads/
Musik/01 - Simple Man.mp3
Vorlagen/
efax-gtk-server/
faxin/
faxout/
faxsent/
Öffentlich/

sent 34762 bytes received 208 bytes 69940.00 bytes/sec
total size is 2487391842 speedup is 71129.31 (DRY RUN)

rsync -qurz * rsync://192.168.178.50/asusfamily

Quote:

rsync: recv_generator: mkdir "/Arbeitsfläche" (in asusfamily) failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
rsync: mkstemp "/.examples.desktop.SPRoee" (in asusfamily) failed: Permission denied (13)
rsync: recv_generator: mkdir "/Downloads" (in asusfamily) failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
rsync: recv_generator: mkdir "/Vorlagen" (in asusfamily) failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
rsync: recv_generator: mkdir "/efax-gtk-server" (in asusfamily) failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
rsync: recv_generator: mkdir "/faxin" (in asusfamily) failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
rsync: recv_generator: mkdir "/faxout" (in asusfamily) failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
rsync: mkstemp "/Dokumente/.testfilebackup.odt.UbCYYs" (in asusfamily) failed: Permission denied (13)
rsync: recv_generator: mkdir "/faxsent" (in asusfamily) failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
rsync: recv_generator: mkdir "/Öffentlich" (in asusfamily) failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
rsync: mkstemp "/Dokumente/Jxxxx
...
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1070) [sender=3.0.9]

The rsyncd.conf is
========================
use chroot = true

transfer logging = true
log file = /var/log/rsyncd.log
log format = %h %o %f %l %b

[asusfamily]
comment = central storage asus family
path = /mnt/externalstorage/asusk51ae/family/
read only = no
list = yes
uid = nobody
gid = nogroup
hosts allow = 192.168.178.25

rknichols · 12-30-2013, 09:41 AM

Those "Permission denied" errors are telling you that the receiving rsyncd process does not have write permission in /mnt/externalstorage/asusk51ae/family/ . If you are not running rsyncd with root privileges, then it needs to run under a UID that has write permission in that directory.

floppy_stuttgart · 12-31-2013, 08:04 AM

Quote:

Originally Posted by rknichols

Those "Permission denied" errors are telling you that the receiving rsyncd process does not have write permission in /mnt/externalstorage/asusk51ae/family/ . If you are not running rsyncd with root privileges, then it needs to run under a UID that has write permission in that directory.

Thanks.
rsyncd seems to work with root. So,
I changed the rights. I made...

sudo find /mnt/externalstorage/ -type d -exec chmod 777 {} +
sudo find /mnt/externalstorage/ -type f -exec chmod 777 {} +
rsync -qurz * rsync://192.168.178.50/asusfamily

Everything was transfered. This is certainly NOT the best way of doing it (open to anybody) but it works and my storage is normaly offline.