(I turn the whole internet upside down for the past 20 hours, none of the similar threads helped)

This is between two debian(from) and ubuntu(to) servers moving files from one machine to a remote machine.

Yesterday I tried to move over 1.5 TB folder from my old server to a new one. I was advised to use rsync command. I ran the command like this.

First time it was going just fine and after a minute I accidentally stopped the process by ctrl+c . Now whenever I execute the command again, it doesnt work and tells me:

rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1196) [sender=3.1.2]

This is more than likely due to permissions. I have the same issue with my gnupg keys but have not solved it - it just started. I'll see if I can find a solution and post back if I find something that works.

You can see the file(s) that are having issues with and use the source and destination you normally would. It will just show you what wasn't copied.

@sevendogsbsd thanks for taking the time bud, I desperately need to make this work searched the whole web and no one has ever found a solution for it.

I wanted to use SCP but not sure why after a few minutes it slows down so I turned to rsync and this one is playing up wired.

The command you mentioned, I ran it, just some help tips and commands came up, nothing about the files it had issues copying.

No worries, happy to help - in my case, it is refusing to copy a file in my .gnupg directory and I get the exact error message you do. I don't have a solution but was hoping the commands would at least show what wasn't being copied.

Error 23 is "Too many open files in system". That's a system limit, not a per-process limit, and makes very little sense in this situation. rsync just doesn't keep a lot of files open except, perhaps, in the case of an unconscionably deep directory structure.

Interesting - I am getting this error on a workstation for a single file. Could the error also be generated if that one file is open?

Appreciate the message.

The server I am migrating the data from, is a 12 TB server with RAID5 I think. and it is almost full I managed to make 30 gigabytes free so not sure if this is causing issues.

The problem is rsync fails to run on a specific folder with mkv and mp4 files in it but it has no issue transferring another folder with some other video files but with the folder that it goes on with transferring, the transfer speed slows down step by step from 80MB/s to 100KB/s.

The target server is a 16TB and I have set RAID0 to the server.

I am migrating from OVH to Online.net

Probably won't work, but try adding "--delete" option to rsync. Without it, it will NOT delete files which don't exist in the source. Maybe something weird got left over when you interrupted things before.

In my case, this gave me a problem when I had switched a symlink to an actual folder with the same name (or vice versa, I don't remember). With the "--delete" option, this would be no problem. rsync deletes the symlink first, then creates the desired folder...no conflicts. But without the "--delete" option, it leaves the symlink there and then bombs when it tries to create the folder with the same name...or something like that. I don't remember precisely what.

use lsysnc command .. rsync may not help for transferring huge files and more likely auto resume..

I heard exactly the opposite.

Anyways I found the issue, My destination server had RAID0 and it even cause the server some software issues like not rebooting when I executed the reboot command. I reconfigured that server with RAID5 and wallah