LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices



Reply
 
Search this Thread
Old 07-02-2010, 10:41 AM   #1
aayore
LQ Newbie
 
Registered: Jul 2010
Distribution: RHEL, Ubuntu
Posts: 3

Rep: Reputation: 0
Only seeing one SAN path


I have a server (RHEL 5.5, 2.6.18-92.1.6.el5) connected to two SANs by multiple paths. But the server's only seeing one path at a time. The only exceptions are the controllers from my HP EVA SAN, as you can see below (which indicates correct zoning). Sometimes when I reboot the server, everything will switch to the other path, but it has never (that I know of) switched while the server is up and running.

[root@cobra ~]# lsscsi
[0:0:0:1] disk NETAPP LUN 7320 /dev/sda
[0:0:0:2] disk NETAPP LUN 7320 /dev/sdb
[0:0:2:0] storage HP HSV210 5000 -
[0:0:2:6] disk HP HSV210 5000 /dev/sdc
[0:0:2:7] disk HP HSV210 5000 /dev/sdd
[0:0:2:8] disk HP HSV210 5000 /dev/sde
[0:0:2:9] disk HP HSV210 5000 /dev/sdf
[0:0:3:0] storage HP HSV210 5000 -
[1:0:2:0] storage HP HSV210 6220 -
[1:0:3:0] storage HP HSV210 6220 -
[root@cobra ~]#

I have triple-checked the zoning and masking/presentation, and everything looks correct. I'm working this through a paid support contract, too, but they're proving useless. Any ideas?
 
Old 07-02-2010, 01:56 PM   #2
anomie
Senior Member
 
Registered: Nov 2004
Location: Texas
Distribution: RHEL, Scientific Linux, Debian, Fedora, Lubuntu, FreeBSD
Posts: 3,930
Blog Entries: 5

Rep: Reputation: Disabled
How are you intending for the multipathing to work? Have you configured dm multipath?
 
Old 07-02-2010, 04:01 PM   #3
aayore
LQ Newbie
 
Registered: Jul 2010
Distribution: RHEL, Ubuntu
Posts: 3

Original Poster
Rep: Reputation: 0
My multipath configuration is below, but I think the root problem is at a lower level. I should be seeing more devices on my HBA's. There aren't currently multiple paths for multipathd to multipath.

The following is the multipath.conf that I'm using. It's the one recommended by NetApp and the one that I'm using on most of my other servers (and working fine there).
Code:
[root@cobra ~]# cat /etc/multipath.conf
defaults
{
    user_friendly_names     yes
    max_fds                 4096
    queue_without_daemon    no
}
blacklist
{
    wwid DevId
    devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
    devnode "^hd[a-z]"
    devnode "^cciss!c[0-9]d[0-9]*[p[0-9]*]"
}
devices
{
    device
     {
        vendor                  "NETAPP"
        product                 "LUN"
        getuid_callout          "/sbin/scsi_id -g -u -s /block/%n"
        prio_callout            "/sbin/mpath_prio_ontap /dev/%n"
        features                "1 queue_if_no_path"
        hardware_handler        "0"
        path_grouping_policy    group_by_prio
        failback                immediate
        rr_weight               uniform
        rr_min_io               128
        path_checker            directio
        flush_on_last_del       yes
        }
}
[root@cobra ~]#
Multipath is up and running, but it only sees one path.

Code:
[root@cobra ~]# multipath -ll
mpath9 (360a98000572d5071614a5744742d324d) dm-0 NETAPP,LUN
[size=2.0T][features=1 queue_if_no_path][hwhandler=0][rw]
\_ round-robin 0 [prio=1][active]
 \_ 0:0:0:1 sda 8:0   [active][ready]
mpath8 (3600508b40010881d0001900000350000) dm-5 HP,HSV210
[size=500G][features=1 queue_if_no_path][hwhandler=0][rw]
\_ round-robin 0 [prio=50][active]
 \_ 0:0:2:9 sdf 8:80  [active][ready]
mpath7 (3600508b40010881d0001300003aa0000) dm-4 HP,HSV210
[size=500G][features=1 queue_if_no_path][hwhandler=0][rw]
\_ round-robin 0 [prio=50][active]
 \_ 0:0:2:8 sde 8:64  [active][ready]
mpath6 (3600508b40010881d0001300003790000) dm-3 HP,HSV210
[size=500G][features=1 queue_if_no_path][hwhandler=0][rw]
\_ round-robin 0 [prio=50][active]
 \_ 0:0:2:7 sdd 8:48  [active][ready]
mpath5 (3600508b40010881d0001300003330000) dm-2 HP,HSV210
[size=500G][features=1 queue_if_no_path][hwhandler=0][rw]
\_ round-robin 0 [prio=50][active]
 \_ 0:0:2:6 sdc 8:32  [active][ready]
mpath10 (360a98000572d50514e34583354714539) dm-1 NETAPP,LUN
[size=240G][features=1 queue_if_no_path][hwhandler=0][rw]
\_ round-robin 0 [prio=4][active]
 \_ 0:0:0:2 sdb 8:16  [active][ready]
[root@cobra ~]#

Last edited by aayore; 07-02-2010 at 04:46 PM. Reason: Adding code tags
 
Old 07-02-2010, 04:41 PM   #4
anomie
Senior Member
 
Registered: Nov 2004
Location: Texas
Distribution: RHEL, Scientific Linux, Debian, Fedora, Lubuntu, FreeBSD
Posts: 3,930
Blog Entries: 5

Rep: Reputation: Disabled
Please put configs / code output in code tags. (See my sig.)

Has the multipath.conf you posted above ever worked on the borked host? IOW, were you seeing the correct number of paths at any point, and then things stopped working?

Also, is a Brocade switch connecting host to SAN? (If so, have you run diagnostics there?) How difficult would it be to temporarily "open things up" for zoning?

Given all the details you have supplied, and depending on the answers to the above, this sounds like it could be a physical issue.

Last edited by anomie; 07-02-2010 at 04:42 PM.
 
Old 07-02-2010, 04:53 PM   #5
aayore
LQ Newbie
 
Registered: Jul 2010
Distribution: RHEL, Ubuntu
Posts: 3

Original Poster
Rep: Reputation: 0
This server has never (to my knowledge) seen multiple paths. It's been running for a while (a few months) with single paths, and I'm trying to get multipath set up for the first time.

I have tried different cables, different SFP's, and different ports on the switch (yes - Brocade). I wouldn't rule out a hardware issue completely, but it's weird that both paths work just fine - I just have to reboot to switch from one path to the other. I've tried to open up the zoning as much as possible, but based on the fact that I can get both paths to work without changing any zoning/masking/presentation, I don't know what else to check in that area. I haven't run diagnostics there yet, but if you think it's worthwhile, I can follow that lead.
 
Old 07-02-2010, 10:34 PM   #6
anomie
Senior Member
 
Registered: Nov 2004
Location: Texas
Distribution: RHEL, Scientific Linux, Debian, Fedora, Lubuntu, FreeBSD
Posts: 3,930
Blog Entries: 5

Rep: Reputation: Disabled
Given that multipath(8) is 1) not seeing more than one path; 2) not reporting any errors, I think it would be a good idea to see what you can learn from the switch. I don't have my Brocade documentation handy, but I believe you can view logs and other info using "supportsave" (or some such).

Wish I had a better lead for you. I will say that I've bumped into some rather vexing issues with Brocade switches, where (even after replacing SFPs and fibre cables) the entire unit had to be replaced to resolve the problem. In that case, though, the symptoms were manifesting themselves in obvious ways. There were Brocade switch events in the logs, and the ports would go offline and then mysteriously come back online.
 
  


Reply

Tags
linux, multipath, paths, san, server, storage


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Migrating to new SAN switches. Would like to move 1 path at a time to avoid downtime mistrm2 Linux - Server 1 05-07-2009 10:34 AM
bash script path issue - how to pass a path as a string to a variable PiNPOiNT Programming 5 04-17-2009 06:48 PM
set up java_home path in /home/user/.bashrc but use path in /usr/lib/java vitalstrike82 Slackware 4 01-14-2009 12:25 AM
Fail to mount a path in SAN sunhui Linux - Hardware 3 03-28-2007 11:53 PM
Unable to mount path from SAN sunhui Linux - Software 1 02-28-2007 10:15 AM


All times are GMT -5. The time now is 12:06 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration