[SOLVED] about borg backup deduplication feature

marozsas · 05-20-2020, 05:37 PM

I am using borg backup. Great !
I realize there are duplicated files on my filesystem thanks to "borgmatic info" that says:

Code:

                       Original size      Compressed size    Deduplicated size
All archives:               37.15 GB             34.48 GB             15.78 GB

Nice.
But how can I get a list of duplicated files to fix it in the filesystem once for all ?
Yeah, I can run a time expensive checksum of files by my self, but if borg already founded it, would be a shame to not use it.

syg00 · 05-20-2020, 06:24 PM

Been a while since I looked at it, but borg de-dup is based on chunks, not (entire) files. Having successful de-dup'ing doesn't imply you have duplicate files. But you might - other tools designed to handle that can usually avoid the checksum check for most files.

marozsas · 05-21-2020, 07:48 AM

You're right, borg dedup is not based on entire files.
thanks for point it.