LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Red Hat
User Name
Password
Red Hat This forum is for the discussion of Red Hat Linux.

Notices


Reply
  Search this Thread
Old 04-12-2016, 07:11 AM   #1
leniviy
Member
 
Registered: Jul 2009
Distribution: Archlinux
Posts: 69

Rep: Reputation: 4
Incremental snapshots of a filesystem with really big files


I have a VM host with image files around 100Gb. It's on `RAID5`, so it has some protection from a hardware failure, but not from accidental `rm -rf /`.

I want to setup periodic snapshot creation on a remote machine, but I think that `rsnapshot` won't do, because even if a small portion of a VM image changes, the backup server would have to store the whole file for each snapshot.

If I use `rsnapshot` with conjunction with `LVM` snapshots, it will solve the above problem, but `rsync` will still have to scan the whole image file for checksum comparison, which is bad for server's performance.

I want to use something similar to Write-intent_bitmap to accumulate dirty blocks and sync them when I feel like creating a snapshot. The solution may still involve LVM thin snaphots on a remote disk.

Is it possible with mdadm or do I need some other software?

I've been using `LVM` thin volumes on some servers for about a year. They're very handy, but they get fragmented and unless you have SSDs, they're a performance killer. This is why I want them on a dedicated backup server.
 
Old 04-12-2016, 07:44 AM   #2
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,120

Rep: Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120
btrfs ?.
Incremental_Backup
 
Old 04-12-2016, 11:59 AM   #3
leniviy
Member
 
Registered: Jul 2009
Distribution: Archlinux
Posts: 69

Original Poster
Rep: Reputation: 4
Quote:
Originally Posted by syg00 View Post
Sounds cool
 
  


Reply

Tags
lvm, lvm2, mdadm, snapshot



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LVM snapshots of ext3 filesystem sammie10 Linux - Newbie 5 09-26-2015 07:00 PM
Does linux offer filesystem snapshots? RedNeck-LQ Linux - General 10 10-09-2011 02:27 AM
ImageMagic and its incremental counter for the output files ivanatora Linux - Software 1 03-12-2010 02:40 PM
Incremental backup of files and directories using dump or tar peddip Linux - Server 2 02-24-2009 05:36 PM
Incremental snapshots of FS DaveQB Linux - General 4 08-05-2008 12:27 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Red Hat

All times are GMT -5. The time now is 12:12 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration