LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Enterprise Linux Forums > Linux - Enterprise
User Name
Password
Linux - Enterprise This forum is for all items relating to using Linux in the Enterprise.

Notices

Reply
 
Search this Thread
Old 03-17-2008, 03:50 PM   #1
rtaheri
LQ Newbie
 
Registered: Mar 2008
Posts: 2

Rep: Reputation: 0
RHEL4 has problems seeing all the LUNs on a cx3-40 array


I am new to Linux, so forgive any obvious missteps or yhr use of incorrect terms. With that , here is my problem:
- HP DL580 G8, four quad-core X7350s, 128GB of ram
- RHEL 4 update 4, 64-bit, installed yesterday
- EMC Clariion cx3-40, f/w revision 3.26.40.5.010, PROM revision 3.58.0
- 16 RAID 0 LUNs, 8 assigned to each controller
- QLA2432 (2462) 4Gb FC card;
- qla2xxx-v8.01.07.15-2 driver, compiled on the system

I cannot access the LUNs on controller B. In dmesg, I see the following for the controller A LUNs:

Attached scsi disk sdk at scsi0, channel 0, id 5, lun 6
Vendor: DGC Model: RAID 0 Rev: 0326
Type: Direct-Access ANSI SCSI revision: 04
qla2400 0000:1c:00.0: scsi(0:0:5:7): Enabled tagged queuing, queue depth 32.
SCSI device sdl: 786432000 512-byte hdwr sectors (402653 MB)
SCSI device sdl: drive cache: write through
SCSI device sdl: 786432000 512-byte hdwr sectors (402653 MB)
SCSI device sdl: drive cache: write through
sdl: sdl1 sdl2 sdl3 sdl4 < sdl5 sdl6 sdl7 sdl8 sdl9 sdl10 sdl11 sdl12 sdl13 sdl14 >
Attached scsi disk sdl at scsi0, channel 0, id 5, lun 7

But for the next LUN, on controller B, I see:

Vendor: DGC Model: RAID 0 Rev: 0326
Type: Direct-Access ANSI SCSI revision: 04
qla2400 0000:1c:00.0: scsi(0:0:5:: Enabled tagged queuing, queue
depth 32.
SCSI device sdm: 838860800 512-byte hdwr sectors (429497 MB)
sdm: asking for cache data failed
sdm: assuming drive cache: write through
SCSI device sdm: 838860800 512-byte hdwr sectors (429497 MB)
sdm: asking for cache data failed
sdm: assuming drive cache: write through
sdm:<6>Device sdm not ready.
end_request: I/O error, dev sdm, sector 0
Buffer I/O error on device sdm, logical block 0
Device sdm not ready.
end_request: I/O error, dev sdm, sector 0
Buffer I/O error on device sdm, logical block 0
Device sdm not ready.
end_request: I/O error, dev sdm, sector 0
Buffer I/O error on device sdm, logical block 0
unable to read partition table
Attached scsi disk sdm at scsi0, channel 0, id 5, lun 8

There is an entry in /proc/partitions for /dev/sdm, and /dev/sdm correctly responds to scsi_id, but there is no sign of its partitions in /proc/partitions, and I cannot dd from /dev/sdm, etc.

8 176 393216000 sdl
8 177 13663282 sdl1
8 178 2739082 sdl2
8 179 2739082 sdl3
8 180 1 sdl4
8 181 2739082 sdl5
8 182 2739082 sdl6
8 183 13229527 sdl7
8 184 4409842 sdl8
8 185 4409842 sdl9
8 186 23470964 sdl10
8 187 29366819 sdl11
8 188 29366819 sdl12
8 189 29366819 sdl13
8 190 29366819 sdl14
8 192 419430400 sdm


If I trespass the LUNs from controller B and move them all to controller A, all is well. Also, if I boot up with RHEL 5 from a different partition, I can split the LUNs between the two controllers.

I installed the multipath package device-mapper-multipath-0.4.5-27.el4_6.3.x86_64.rpm, and that didn't help. I found that no matter what I did, the system never discovered two paths for
any of the LUNs for me to worry about picking the right one.

I installed RHEL5 Update 1 in another partition, and that works fine: i.e., I can move the LUNs between controllers, and as long as I reboot, it comes up and sees all the LUNs and their partitions. (I cannot use RHEL5 because of Oracle )

What am I doing wrong?

Thanks,
Reza Taheri
 
Old 03-17-2008, 05:05 PM   #2
Brian1
Guru
 
Registered: Jan 2003
Location: Seymour, Indiana
Distribution: Distribution: RHEL 5 with Pieces of this and that. Kernel 2.6.23.1, KDE 3.5.8 and KDE 4.0 beta, Plu
Posts: 5,700

Rep: Reputation: 61
Does seem odd. I know in the old days Redhat rpm kernels use to leave the multi lun support off in the kernel. I am not sure of any way of telling other than looking at the config file in /boot for the kernel you have installed. Look for ' CONFIG_SCSI_MULTI_LUN ' in it an see if it is set to no. If so then you will need to recompile the kernel and set to y to be built into the kernel. Does not work as module from what I seemed to read somewhere.

Brian
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
autosense SAN LUNS sg001 Linux - Server 1 07-17-2007 10:10 AM
Luns shads2k5 Linux - Server 3 02-07-2007 05:55 PM
Multiple problems with RHEL4.0 shinobi59 Red Hat 4 05-17-2006 01:59 PM
Multiple problems with RHEL4.0 shinobi59 Red Hat 1 05-10-2006 04:28 PM
Multiple LUNS on Mandrake 10 wihiker Linux - Hardware 0 02-10-2005 05:56 AM


All times are GMT -5. The time now is 11:14 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration