LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices



Reply
 
Search this Thread
Old 11-24-2009, 07:51 AM   #1
zQUEz
Member
 
Registered: Jun 2007
Distribution: Fedora, RHEL, Centos
Posts: 294

Rep: Reputation: 53
Use LVM for SAN LUN's or not?


I have an opportunity to redesign how I present SAN LUN's to a Linux Oracle server. Currently our process is to present new LUN's as disk needs grow, roll them under Veritas Volume Manager control, carve them up into volume groups and mount them or extend existing mounts. I have approval to remove the Veritas software primarily because it carries a yearly licensing charge and we just don't need it.

I will be using multipathd for multipathing of the new SAN LUN's.
My first inclination is to use LVM. But I am questioning if that is even needed.
I think it would be more efficient to create a LUN on the SAN for each mount, then, as disk needs grow, extent that LUN. (we don't have any LUN's anywhere close to 2TB which is our SAN limitation). Then use standard fdisk to take those disks and mount up where they are needed.

The only draw back, is I am somewhat "scared" (??) of the method of extending disks under Linux when using just fdisk for the partitioning - that is delete the partition, create a larger partition and then resize2fs the filesystem. It seems dangerous to do with live data (Oracle DB's).

What are others doing in this space?
 
Old 11-24-2009, 09:05 AM   #2
MensaWater
Guru
 
Registered: May 2005
Location: Atlanta Georgia USA
Distribution: Redhat (RHEL), CentOS, Fedora, Debian, FreeBSD, HP-UX, Solaris, SCO
Posts: 6,028
Blog Entries: 5

Rep: Reputation: 791Reputation: 791Reputation: 791Reputation: 791Reputation: 791Reputation: 791Reputation: 791
We use LVM and ext3 filesystem on a Oracle Data Warehouse.

For another Oracle pass through database we're using ASM (on raw devices) so no LVM for the EMC LUNs - just a single partition on each emcpower device.

For an earlier Oracle pass through database we're using OCFS (1) so we same as above - no LVM, single partition on each emcpower device.

LVM gives you a lot of flexibility in how you combine and divide storage so if you're using filesystems I'd recommend it.

VxVM has the benefit that it works on multiple platforms and allows you to do things like add LUNs from a new array to existing disk group and evacuate disks from old array to the ones on new array while Oracle is still running. On our OCFS system we had to move storage from one Clariion CX700 to another and it was a much more complicated process because we weren't using VxVM and sancopy had limitations of which we weren't previously aware.

ext3 reportedly doesn't perform well on extremely large filesystems and it sounds like you're thinking of doing extremely large filesystems so you might want to look at other fstypes such as OCFS2 which was created by Oracle for RAC environments but can be used on stand alone servers as well.
 
Old 11-24-2009, 09:34 AM   #3
zQUEz
Member
 
Registered: Jun 2007
Distribution: Fedora, RHEL, Centos
Posts: 294

Original Poster
Rep: Reputation: 53
thank you for the advice.
For the Oracle servers that I have setup to date at this office I have setup ext3 fs on LVM lv's and simply used LVM to combine the SAN LUN's into a single VG. They work well and I don't have any problems with them, except it is somewhat "messy" as our Oracle DBA's request new storage space in small chunks - 5GB here, 10GB there. So, on the SAN it is getting to be inefficient because I am having a lot of small LUN's presented to the hosts and I can't trace a LUN from Linux mount to SAN LUN.

This morning I found and tested a way to extend a PV under LVM so, maybe that is the best of both worlds for me.

I also use an IBM San Volume Controller (SVC) so invisible disk migrations to different storage frames are handled by that device (which I love!!) - so that is another reason I don't need the VxVM drivers. I also don't have the option of using Oracle raw devices as the app owner doesn't want anything changed in that space.

Short of any other suggestions I think i'll stick with LVM in that case.
 
Old 11-24-2009, 09:43 AM   #4
MensaWater
Guru
 
Registered: May 2005
Location: Atlanta Georgia USA
Distribution: Redhat (RHEL), CentOS, Fedora, Debian, FreeBSD, HP-UX, Solaris, SCO
Posts: 6,028
Blog Entries: 5

Rep: Reputation: 791Reputation: 791Reputation: 791Reputation: 791Reputation: 791Reputation: 791Reputation: 791
The beauty of LVM is you don't have to add 5 GB, 10 GB, 1 GB LUNs to it piecemeal. You can add 100 GB LUN each time then create the 5 GB, 10 GB or 1 GB logical volume (LV) they requested - they don't need to know you have more space pre-allocated to the VG. Then when you get the next request you just create another LV and don't have to muck with the array at all until you've used up that 100 GB LUN.
 
Old 11-24-2009, 09:57 AM   #5
zQUEz
Member
 
Registered: Jun 2007
Distribution: Fedora, RHEL, Centos
Posts: 294

Original Poster
Rep: Reputation: 53
yeah, and I used to do that, but the way we cost allocate back to the business units, it is per GB as reported from the SAN LUNs allocated. So, if the SAN reports 100GB allocated to a server, the business wants to see that 100GB mounted up.

Annoying, I know, but the "bean counters" (accountants) rule the roost around where I work :-)

With my latest code update to the SVC though, it supports thin provisioning of LUN's so that may be my savior.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
lvm ontop of raid10 or combine two raid1 via lvm? okar Linux - Server 3 09-11-2009 03:37 PM
LVM and multiple iSCSI disks performance of LVM xxx_anuj_xxx Linux - Server 4 05-01-2008 01:26 PM
LXer: Managing LVM with the LVM Manager LXer Syndicated Linux News 0 03-16-2008 12:10 PM
using lvm/ocfs2 to configure san storage mn9 Linux - Server 1 06-12-2007 04:35 AM
LXer: Back Up (And Restore) LVM Partitions With LVM Snapshots LXer Syndicated Linux News 0 04-17-2007 12:16 PM


All times are GMT -5. The time now is 09:32 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration