Download your favorite Linux distribution at LQ ISO.
Go Back > Forums > Linux Forums > Linux - General
User Name
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.


  Search this Thread
Old 08-02-2012, 04:44 AM   #1
LQ Newbie
Registered: May 2010
Posts: 22

Rep: Reputation: 0
CentOS 6 w/ GlusterFS - Need help w/ setup

I need some help getting a GlusterFS setup completed on an established server and a new one. I'm willing to pay for someone's time if needed.

We're using a CMS for streaming media, the existing server is the encoding and streaming server and has almost 8TB of existing content on a LVM platform.

The new server will be another 8TB storage server to be used to add more content storage with the plan being to continue adding GlusterFS storage servers as the content storage grows. (The project will have somewhere between 50 and 100TB of content eventually and the datacenter is currently limited to 8TB maximum per server).

I've been able to find plenty of tutorials on setting up a new GlusterFS system but none of them go into detail on establishing a Gluster brick on a server w/ existing files that cannot be moved. I basically need to convert an existing folder w/ files in it.

Then, I need to add the second storage server so it providers additional storage space mounted to that same folder on the first server.

Later on, we want to create some striping / replication as more servers are added.

I'm a fairly experienced admin but Gluster is new to me and given the existing server is a production box with a great deal of encoded content which took a lot of time and labor to create I need to eliminate as much risk as possible. It would be great to be able to work on this w/ someone who has the experience / skills needed so I can work out how to best accomplish this and how to continue growing the system, etc.
Old 09-10-2012, 03:53 PM   #2
Registered: Apr 2005
Location: BC
Distribution: Centos
Posts: 34

Rep: Reputation: 16
Did you get it work?
Old 09-10-2012, 04:57 PM   #3
LQ 5k Club
Registered: Jan 2011
Location: Nowhere near you, thank God.
Distribution: OSX Sierra
Posts: 8,568
Blog Entries: 14

Rep: Reputation: Disabled
Here are my notes on CentOS 5.7/x86_64 hosts and gluster v3.2.5, dated 17 March 2012, I hope it can help you out.

We will use 2 identical CentOS servers and create a gluster volume and then test it.
We will write on "nas1" and view it's properties on "nas2"

We will assume a fresh deployment of two 64bit CentOS hosts and that all updates to the system are in place.
Our hosts have 10G "user-volumes" attached at /dev/hdb using an ext3 filesystem.

First step after system is "ready" is to edit the /etc/hosts on BOTH SERVERS and add:

   IP.of.brick1 nas1 nas1
   IP.of.brick2 nas2 nas2

NOTE: /etc/hosts.template needs this too so it will survive reboot.
Install gluster and fuse

# rpm -Uvh
# rpm -Uvh

(on each brick)
# mkdir -pv /mnt/gdata/gdata-queue /mnt/gdata/cloud_c9

Edit the glusterfs.vol file
# vi /etc/glusterfs/glusterfs.vol and verify...

volume raw
   type storage/posix
   option directory /mnt/gdata/cloud_c9

volume brick
   type features/posix-locks
   subvolumes raw

volume server
   type protocol/server
   option transport-type tcp
   subvolumes brick
   option auth.addr.brick.allow *

create the volume:
# gluster volume create cloud_c9 replica 2 nas1:/mnt/gdata/queue-data nas2:/mnt/gdata/queue-data

Start the volume:
# gluster volume start cloud_c9

# vi /etc/fstab (on each brick)    /mnt/gdata/cloud_c9    glusterfs defaults,_netdev 0 0

# vi /etc/rc.local and add:
modprobe fuse
mount -a

Mount them:
# mount -a

echo "c9 kicks ass" > /mnt/gdata/cloud_c9/c9rocks and then head over  to nas2
# cat /mnt/gdata/cloud_c9/c9rocks

c9 kicks ass

Class dismissed!
which I managed to install and setup after reading:

Last edited by Habitual; 09-10-2012 at 05:03 PM.
Old 09-10-2012, 06:48 PM   #4
Registered: Apr 2005
Location: BC
Distribution: Centos
Posts: 34

Rep: Reputation: 16
Thanks its indeed helpful.



Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: Howto setup a glusterfs replicated cluster as webroot LXer Syndicated Linux News 0 07-24-2012 04:10 PM
LXer: How to setup and expand a replicated Glusterfs 3.2.4 volume on Debian 6.x LXer Syndicated Linux News 0 04-18-2012 02:50 AM
LXer: Distributed Replicated Storage Across Four Nodes With GlusterFS (CentOS 5.4) LXer Syndicated Linux News 0 03-24-2010 12:31 AM
LXer: High-Availability Storage With GlusterFS On CentOS 5.4 LXer Syndicated Linux News 0 03-19-2010 01:20 PM
LXer: Creating An NFS-Like Standalone Storage Server With GlusterFS On CentOS 5.4 LXer Syndicated Linux News 0 03-18-2010 02:40 PM > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 01:57 AM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration