LinuxQuestions.org
Review your favorite Linux distribution.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Red Hat
User Name
Password
Red Hat This forum is for the discussion of Red Hat Linux.

Notices


Reply
  Search this Thread
Old 11-07-2019, 02:04 AM   #1
lukaszm
LQ Newbie
 
Registered: Nov 2019
Posts: 3

Rep: Reputation: Disabled
redhat 7.5 multipath problem


Hi I have redhat 7.5 with HP3par connected to it.
It detects all drives ok, and it looks like it detects all paths ok as well. Problem is it is sending data only through one path not through all available ( 4 of them for each of drives) . I have configured it according to HPE recomendations but still nothing works as intended.


below i will post result of multipath -ll

Code:
multipath -ll
mpathr (360002ac0000000000000003c00021340) dm-2 3PARdata,VV
size=2.0T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 1:0:2:6 sde   8:64   active ready running
  |- 2:0:2:6 sdq   65:0   active ready running
  |- 1:0:3:6 sdj   8:144  active ready running
  `- 2:0:3:6 sdv   65:80  active ready running
mpathq (360002ac0000000000000003b00021340) dm-1 3PARdata,VV
size=2.0T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 1:0:2:5 sdd   8:48   active ready running
  |- 2:0:2:5 sdp   8:240  active ready running
  |- 1:0:3:5 sdi   8:128  active ready running
  `- 2:0:3:5 sdu   65:64  active ready running
mpathp (360002ac0000000000000002a0001aa9c) dm-5 3PARdata,VV
size=2.5T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 1:0:0:2 sdb   8:16   active ready running
  |- 2:0:0:2 sdn   8:208  active ready running
  |- 1:0:1:2 sdc   8:32   active ready running
  `- 2:0:1:2 sdo   8:224  active ready running
mpathu (360002ac0000000000000003e00021340) dm-8 3PARdata,VV
size=2.5T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 1:0:2:8 sdg   8:96   active ready running
  |- 2:0:2:8 sds   65:32  active ready running
  |- 1:0:3:8 sdl   8:176  active ready running
  `- 2:0:3:8 sdx   65:112 active ready running
mpatht (360002ac0000000000000003f00021340) dm-4 3PARdata,VV
size=2.5T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 1:0:2:9 sdh   8:112  active ready running
  |- 2:0:2:9 sdt   65:48  active ready running
  |- 1:0:3:9 sdm   8:192  active ready running
  `- 2:0:3:9 sdy   65:128 active ready running
mpaths (360002ac0000000000000003d00021340) dm-0 3PARdata,VV
size=2.0T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 1:0:2:7 sdf   8:80   active ready running
  |- 2:0:2:7 sdr   65:16  active ready running
  |- 1:0:3:7 sdk   8:160  active ready running
  `- 2:0:3:7 sdw   65:96  active ready running
[root@gniprod ~]# multipath -l
mpathr (360002ac0000000000000003c00021340) dm-2 3PARdata,VV
size=2.0T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
  |- 1:0:2:6 sde   8:64   active undef running
  |- 2:0:2:6 sdq   65:0   active undef running
  |- 1:0:3:6 sdj   8:144  active undef running
  `- 2:0:3:6 sdv   65:80  active undef running
mpathq (360002ac0000000000000003b00021340) dm-1 3PARdata,VV
size=2.0T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
  |- 1:0:2:5 sdd   8:48   active undef running
  |- 2:0:2:5 sdp   8:240  active undef running
  |- 1:0:3:5 sdi   8:128  active undef running
  `- 2:0:3:5 sdu   65:64  active undef running
mpathp (360002ac0000000000000002a0001aa9c) dm-5 3PARdata,VV
size=2.5T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
  |- 1:0:0:2 sdb   8:16   active undef running
  |- 2:0:0:2 sdn   8:208  active undef running
  |- 1:0:1:2 sdc   8:32   active undef running
  `- 2:0:1:2 sdo   8:224  active undef running
mpathu (360002ac0000000000000003e00021340) dm-8 3PARdata,VV
size=2.5T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
  |- 1:0:2:8 sdg   8:96   active undef running
  |- 2:0:2:8 sds   65:32  active undef running
  |- 1:0:3:8 sdl   8:176  active undef running
  `- 2:0:3:8 sdx   65:112 active undef running
mpatht (360002ac0000000000000003f00021340) dm-4 3PARdata,VV
size=2.5T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
  |- 1:0:2:9 sdh   8:112  active undef running
  |- 2:0:2:9 sdt   65:48  active undef running
  |- 1:0:3:9 sdm   8:192  active undef running
  `- 2:0:3:9 sdy   65:128 active undef running
mpaths (360002ac0000000000000003d00021340) dm-0 3PARdata,VV
size=2.0T features='0' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
  |- 1:0:2:7 sdf   8:80   active undef running
  |- 2:0:2:7 sdr   65:16  active undef running
  |- 1:0:3:7 sdk   8:160  active undef running
  `- 2:0:3:7 sdw   65:96  active undef running
Below multipath.conf

Code:
# This is a basic configuration file with some examples, for device mapper
# multipath.
#
# For a complete list of the default configuration values, run either
# multipath -t
# or
# multipathd show config
#
# For a list of configuration options with descriptions, see the multipath.conf
# man page

## By default, devices with vendor = "IBM" and product = "S/390.*" are
## blacklisted. To enable mulitpathing on these devies, uncomment the
## following lines.

blacklist_exceptions {
devnode "^(dm-)[0-9]*"

wwid "360002ac000000000000000250001aa9c"
wwid "360002ac000000000000000240001aa9c"
wwid "360002ac000000000000000230001aa9c"
wwid "360002ac000000000000000270001aa9c"
wwid "360002ac000000000000000260001aa9c"
wwid "360002ac0000000000000002800021340"
wwid "360002ac0000000000000002900021340"
wwid "360002ac0000000000000003300021340"
wwid "360002ac0000000000000003400021340"
wwid "360002ac0000000000000002a00021340"
"/etc/multipath.conf" 140L, 3682C

device {
                vendor "3PARdata"
                product "VV"
        }

#       device {
#               vendor  "IBM"
#               product "S/390.*"
#       }
}

## Use user friendly names, instead of using WWIDs as names.
#defaults {
#       polling_interval 10
#       user_friendly_names yes
#       find_multipaths yes
#       path_selector "round-robin 0"
#}
##
## Here is an example of how to configure some standard options.
##
#

defaults {
        polling_interval        10
#       path_selector           "round-robin 0"
#       path_grouping_policy    group_by_prio
#       uid_attribute           ID_SERIAL
#       prio                    alua
#       path_checker            readsector0
#       rr_min_io               100
#       max_fds                 8192
#       rr_weight               priorities
#       failback                immediate
#       no_path_retry           fail
        user_friendly_names     yes

}
##

## The wwid line in the following blacklist section is shown as an example
## of how to blacklist devices by wwid.  The 2 devnode lines are the
## compiled in default blacklist. If you want to blacklist entire types
## of devices, such as all scsi devices, you should use a devnode line.
## However, if you want to blacklist specific devices, you should use
## a wwid line.  Since there is no guarantee that a specific device will
## not change names on reboot (from /dev/sda to /dev/sdb for example)
## devnode lines are not recommended for blacklisting specific devices.
##
blacklist {
#       wwid 26353900f02796769

#       devnode "^(ram|raw|loop|fd|md|sr|scd|st)[0-9]*"
#       devnode "^hd[a-z]"
}
#multipaths {
#       multipath {
#               wwid                    3600508b4000156d700012000000b0000
#               alias                   yellow
#               path_grouping_policy    multibus
#               path_selector           "round-robin 0"
#               failback                manual
#               rr_weight               priorities
#               no_path_retry           5
#       }
#       multipath {
#               wwid                    1DEC_____321816758474
#               alias                   red
#       }
#}

devices {


        device {
                vendor "3PARdata"
                product "VV"
                path_grouping_policy "group_by_prio"
                path_selector "round-robin 0"
                path_checker "tur"
                features "0"
                hardware_handler "1 alua"
                prio "alua"
                failback immediate
                rr_weight "uniform"
                no_path_retry 18
                fast_io_fail_tmo 10
                dev_loss_tmo "infinity"
        }
#       device {

#               vendor                  "COMPAQ  "
#               product                 "MSA1000         "

#               path_grouping_policy    multibus
#       }
}

Any help would be really appreciated.

Last edited by lukaszm; 11-08-2019 at 12:59 AM.
 
Old 11-07-2019, 08:32 PM   #2
berndbausch
LQ Addict
 
Registered: Nov 2013
Location: Tokyo
Distribution: Mostly Ubuntu and Centos
Posts: 6,316

Rep: Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002
Can you format the multipath output and the multipath.conf content so that they become readable? Use [code] as shown in my signature below.

I have a question back. How do you know that only one of the four links is used?

EDIT: If you are certain that all four links in each multipath are equal, you could try path_grouping_policy = multibus rather than group_by_prio.

Last edited by berndbausch; 11-08-2019 at 12:52 AM.
 
1 members found this post helpful.
Old 11-08-2019, 05:00 AM   #3
lukaszm
LQ Newbie
 
Registered: Nov 2019
Posts: 3

Original Poster
Rep: Reputation: Disabled
@berndbausch

Thank you and apologies for formating ( already corrected).

Will try yoiur suggestion on multibus

As to monitoring we have ability to check only on 3par end. Since we have two 3par devices we know our config is ok. As well besides this linux server we have one vmware server connected to the same 3par . Vmaware uses trafic just for couple hours over night and then all ports are utilised . but when redhat is running all traffic goes just to one port. Problem is that now it starts reaching 100% utilisation and causes problems.
 
Old 11-08-2019, 05:32 AM   #4
berndbausch
LQ Addict
 
Registered: Nov 2013
Location: Tokyo
Distribution: Mostly Ubuntu and Centos
Posts: 6,316

Rep: Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002
I don't see a problem in the configuration, but who knows what's happening deep in the multipath brain.

The way I would check device utilization is with iostat on the server; example:
Code:
iostat 5 100 sdd sdp sdi sdu
 
Old 11-08-2019, 06:38 AM   #5
lukaszm
LQ Newbie
 
Registered: Nov 2019
Posts: 3

Original Poster
Rep: Reputation: Disabled
@berndbausch

Really appreciate your help. tried multibus but that did not help.

I found hp documentation from 2016 on how to set it up , but i dont see problems on our side. Will ask support for newest config possible and then we will see. Next year we will get support for redhat, but for now i need to resolve that issue on my own...
 
Old 11-11-2019, 10:26 AM   #6
voleg
Member
 
Registered: Oct 2013
Distribution: RedHat CentOS Fedora SuSE
Posts: 354

Rep: Reputation: 51
Multipath will use the preferred by storage path according to ALUA protocol.
Usually only one storage head is a LUN owner then its paths are preferred, other paths less optimized for IO.
Also usually every storage head is connected by redundant paths to SAN, then you should see at least two paths equally used.
Please check your FC zones settings to achieve full mesh redundant schema.

ALUA is the best option, but you can use round-robin option if you insist.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
does redhat 6 installation format multipath storage? khalid.aboelmagd Linux - Server 6 12-09-2015 07:46 AM
Boot from multipath device on Redhat 5.4 (kernel 2.6.18.308) Zen1988 Linux - Server 0 07-08-2012 09:52 PM
RedHat 5 Multipath using SAN attached disk rchsysdb Linux - Software 1 07-01-2008 06:34 AM
Problem compiling multipath-tools bipins1979 Linux - Software 1 02-24-2006 05:48 PM
multipath routing problem jszmajda Linux - Networking 4 05-05-2004 08:15 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Red Hat

All times are GMT -5. The time now is 05:52 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration