Strange disk usage discrepancy between 2 servers

jong105 · 05-08-2021, 04:33 PM

Hi,

I'm copying some files (using rsync/ssh) between 2 servers. The source is a Debian machine using ZFS, and the destination is Fedora on XFS.

When I run du -h -d 0 . on the source directory, I get '124G'. When I run the same command on the destination, I get '175G'... and it's still copying!

Compression is enabled on the ZFS dataset, but I don't believe that should make a difference to the output of 'du'. I really don't understand what's going on here.

Any pointers would be greatly appreciated.

Jon

Edit:
Just a couple of minutes after I posted this, the rsync finished, with the destination directory showing usage of 176G. I'm still not seeing any obvious relationship between those vastly different numbers.

dc.901 · 05-08-2021, 06:18 PM

Quote:

Originally Posted by jong105

Hi,

I'm copying some files (using rsync/ssh) between 2 servers. The source is a Debian machine using ZFS, and the destination is Fedora on XFS.

When I run du -h -d 0 . on the source directory, I get '124G'. When I run the same command on the destination, I get '175G'... and it's still copying!

Compression is enabled on the ZFS dataset, but I don't believe that should make a difference to the output of 'du'. I really don't understand what's going on here.

Any pointers would be greatly appreciated.

Jon

Edit:
Just a couple of minutes after I posted this, the rsync finished, with the destination directory showing usage of 176G. I'm still not seeing any obvious relationship between those vastly different numbers.

You will find that this has been discussed many times over...
Take a look at this page; has some good pointers:
https://unix.stackexchange.com/quest...-the-same-file

MadeInGermany · 05-09-2021, 01:36 AM

How did you copy the files?
Maybe hard-linked or even soft-linked files got separated?
Search for links with

Code:

find startdir \( -type l - o -type f -links +1 \) -ls