LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 05-20-2020, 05:37 PM   #1
marozsas
Senior Member
 
Registered: Dec 2005
Location: Campinas/SP - Brazil
Distribution: SuSE, RHEL, Fedora, Ubuntu
Posts: 1,455
Blog Entries: 1

Rep: Reputation: 66
Question about borg backup deduplication feature


I am using borg backup. Great !
I realize there are duplicated files on my filesystem thanks to "borgmatic info" that says:
Code:
                       Original size      Compressed size    Deduplicated size
All archives:               37.15 GB             34.48 GB             15.78 GB
Nice.
But how can I get a list of duplicated files to fix it in the filesystem once for all ?
Yeah, I can run a time expensive checksum of files by my self, but if borg already founded it, would be a shame to not use it.
 
Old 05-20-2020, 06:24 PM   #2
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 18,896

Rep: Reputation: 3236Reputation: 3236Reputation: 3236Reputation: 3236Reputation: 3236Reputation: 3236Reputation: 3236Reputation: 3236Reputation: 3236Reputation: 3236Reputation: 3236
Been a while since I looked at it, but borg de-dup is based on chunks, not (entire) files. Having successful de-dup'ing doesn't imply you have duplicate files. But you might - other tools designed to handle that can usually avoid the checksum check for most files.
 
Old 05-21-2020, 07:48 AM   #3
marozsas
Senior Member
 
Registered: Dec 2005
Location: Campinas/SP - Brazil
Distribution: SuSE, RHEL, Fedora, Ubuntu
Posts: 1,455

Original Poster
Blog Entries: 1

Rep: Reputation: 66
SOLVED, borg dedup is not based on entire files

You're right, borg dedup is not based on entire files.
thanks for point it.
 
  


Reply

Tags
borg, deduplication


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Borg backup data integrity error in a CentOS 7 VM Superspeed500 Linux - Server 4 12-13-2019 02:21 AM
LXer: Backup on Fedora Silverblue with Borg LXer Syndicated Linux News 0 03-26-2019 12:13 AM
Deduplication feature support in ext4 file system ravish165 Linux - Kernel 1 04-01-2015 08:05 AM
OpenFiler backup and deduplication belda Linux - Server 0 10-15-2011 06:38 AM
LXer: The borg Are Coming... For Microsoft? LXer Syndicated Linux News 0 12-23-2005 05:01 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 10:23 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration