LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 02-13-2015, 09:25 PM   #1
yek
Member
 
Registered: Feb 2015
Location: Yokoahama Kanagawa, Japn.
Distribution: Manjaro Linux, PCLinuxOS, Sabayon Linux, Vine Linux, CentOS
Posts: 41

Rep: Reputation: 0
Btrfs * ZFS * EncFS * Non-HA mirror solution


Hi,

I want to mirror two filesystem.
Master filesystem is btrfs (mirrored.)
Slave filesystem is ZFS (single.)
Each filesystem consist of AoE. So:

[ MASTER btrfs cluster ] --- network mirror --- [ SLAVE ZFS cluster ]

But there's three problems.
  • Master files in EncFS. So any other user cannot access thier files even if root.
  • Servers shutdown at any time.
  • Now over 1,000,000,000 files , over 1,000,000 directories, and over 10TiB.

I think:
  • HA storage (i.e. DRDB, GlusterFS) is difficult to shutdown.
  • GlusterFS Geo Replication needs to access master files as root.
  • lsyncd is not suitable for many files and needs to access master files as root.
  • ownCloud is not suitable for mirror.
  • rsync is less read time and brake one file each shutdown time.

Is it?
 
Old 02-15-2015, 03:57 PM   #2
btmiller
Senior Member
 
Registered: May 2004
Location: In the DC 'burbs
Distribution: Arch, Scientific Linux, Debian, Ubuntu
Posts: 4,284

Rep: Reputation: 371Reputation: 371Reputation: 371Reputation: 371
That's quite the (overly(?))-complex setup you have there. Offhand the best solution I can think of would be to recreate the btrfs file system to ZFS and use ZFS replication to take care of this. At this time, I don't think btrfs is recommended for production use (from what I've read). From what I've seen of Gluster and its documentation, I'm not terribly coonfident in it (esp. now that it's owned by Red Hat). There are other clustered filesystems such as BeeGFS, MooseFS, or even Ceph, but to me this is something where you want in-filesystem replication since you have a master-slave setup.
 
Old 02-16-2015, 04:41 AM   #3
yek
Member
 
Registered: Feb 2015
Location: Yokoahama Kanagawa, Japn.
Distribution: Manjaro Linux, PCLinuxOS, Sabayon Linux, Vine Linux, CentOS
Posts: 41

Original Poster
Rep: Reputation: 0
Thank you for your reply.

I know if I re-construct btrfs + EncFS to dm-crypt + ZFS, I get some way.
But I want to use btrfs for flexible mirror extensibility.
I think ZFS isn't suitable for rolling release distribution.

And my data is too much.
If recreate filesystem for MASTER, it needs long unavailable time.
I want to avoid it if possible.



Correction:
Quote:
rsync is less read time
rsync is less real time
 
Old 02-16-2015, 10:56 AM   #4
btmiller
Senior Member
 
Registered: May 2004
Location: In the DC 'burbs
Distribution: Arch, Scientific Linux, Debian, Ubuntu
Posts: 4,284

Rep: Reputation: 371Reputation: 371Reputation: 371Reputation: 371
You may have to go back to using rsync then. Offhand, I can't think of any other way to do it. It's been pretty reliable inmy experience (at work we use rsnapshot - a wrapper around rsync - to backup over 100 TB of data).

In any sort of cluster filesystem, you'll have to have trust between the individual cluster members (usually root logging in via key based authentication - password authentication for root should always be disabled). So, it is probably not suitable for your requirements.

You never do state which distributions and versions that you're using for all of this. You made no mention of a rolling release in your original post.
 
Old 02-17-2015, 12:13 AM   #5
yek
Member
 
Registered: Feb 2015
Location: Yokoahama Kanagawa, Japn.
Distribution: Manjaro Linux, PCLinuxOS, Sabayon Linux, Vine Linux, CentOS
Posts: 41

Original Poster
Rep: Reputation: 0
I see, I will soft mirror with rsync and at(1).
Thank you very much.

Quote:
You never do state which distributions and versions that you're using for all of this. You made no mention of a rolling release in your original post.
Oh, I missed it. Sorry.

Phase1:
Disks are only in a desktop.
Manjaro Linux is used for the desktop computer.
Terminal laptops access to data via SSHFS.

Now Phase 2:
A storage server is connected with GbE.
[ Desktop(Manjaro)(MASTER)] - [GbE Hub] - [ Server(SLAVE) ]
CentOS 7 is used for a server computer.

To Phase 3:
MASTER and SLAVE will be cluster storage (AoE.)
MASTER key node (as desktop) abd SLAVE key node are added NIC.
[ MASTER storage servers ] - [ GbE Hub ] - [ Desktop ] - [ GbE Hub ] - [ SLAVE key server ] - [ GbE Hub ] - [ SLAVE storage servers ]

Phase 4:
Purge big disks from desktop.

Phase 5:
To use HA-Cluster storage with 10GbE.
Don't use EncFS.
But I want to keep to use btrfs because disks have different size.


Now slave key server and AoE are ready.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: ZFS Still Trying To Compete With EXT4 & Btrfs On Linux LXer Syndicated Linux News 0 08-27-2013 10:50 AM
LXer: Can DragonFly's HAMMER Compete With Btrfs, ZFS? LXer Syndicated Linux News 0 01-07-2011 09:30 AM
LXer: Benchmarks Of ZFS-FUSE On Linux Against EXT4, Btrfs LXer Syndicated Linux News 0 08-30-2010 03:50 PM
LXer: Revisited: ZFS, Btrfs and Oracle. LXer Syndicated Linux News 0 03-20-2010 11:10 AM
LXer: ZFS, Btrfs and Oracle LXer Syndicated Linux News 0 05-18-2009 12:11 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 05:13 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration