kernel: end_request: I/O error, dev sdb, sector 0

sandeep002gupta · 08-23-2016, 05:30 AM

Hi,

When I reboot Linux "Red Hat Enterprise Linux Server release 6.1 (Santiago)" server then I got error as per below on screen:

buffer I/O error on device /dev/sdg sector 413456

after login server we run any lvm command then received below error:

/dev/sdb: read failed after 0 of 4096 at 0: Input/output error
/dev/sde: read failed after 0 of 4096 at 0: Input/output error
/dev/sdg: read failed after 0 of 4096 at 0: Input/output error
LV VG Attr LSize Origin Snap% Move Log Copy% Convert
LogVol00 VolGroup00 -wi-ao 1.40t
LogVol01 VolGroup01 -wi-ao 1.95t
LogVol00 vg_antdwhp -wi-ao 2.02t
[root@ANTDWHP ~]# cat /proc/partitions
major minor #blocks name

8 48 2335932416 sdd
8 49 102400 sdd1
8 50 204800 sdd2
8 51 102400000 sdd3
8 52 32768000 sdd4
8 53 32768000 sdd5
8 54 2167687168 sdd6
8 32 2096103424 sdc
8 33 2096096908 sdc1
8 16 524288000 sdb
8 0 1069547520 sda
8 64 1069547520 sde
8 80 524288000 sdf
8 81 524281243 sdf1
8 96 2096103424 sdg
253 0 2167685120 dm-0
253 1 2095054848 dm-1
253 2 1503240192 dm-2

the same has checked in LVM partition where these disk is not visible.

/dev/sda VolGroup00 1000G
/dev/sdf1 VolGroup00 499.9G
VolGroup00-LogVol00 mounted on /data1 1.5T

/dev/sdc1 VolGroup01 1.95T
VolGroup01-LogVol01 mounted on /data2 1.95T

/dev/sdd6 vg_antdwhp 2.2T
Vg_antdwhp-LogVol00 mounted on /data 2.2T

let me know can we remove below disk from storage if its not in used.
sdb
sde
sdg

which are given error.

smallpond · 08-23-2016, 06:41 AM

It sounds like you are saying these disks are part of a VG but have been removed from the system without first deleting them from the VG. Hopefully no LVM data was on them at the time. If so then your first concern should be recovering the data. If not then I don't think you will do any more damage by deleting them from the VG.

sandeep002gupta · 08-23-2016, 09:00 AM

May be these are the old configuration.
but we check output for /dev/disk/by-path here is showing these disks

[root@ANTDWHP ~]# ll /dev/disk/by-path/
total 0
lrwxrwxrwx. 1 root root 9 Aug 12 11:38 pci-0000:11:00.0-fc-0x20340080e53f53b0:0 x0001000000000000 -> ../../sda
lrwxrwxrwx. 1 root root 9 Aug 23 10:53 pci-0000:11:00.0-fc-0x20340080e53f53b0:0 x0002000000000000 -> ../../sdb
lrwxrwxrwx. 1 root root 9 Aug 12 12:03 pci-0000:11:00.0-fc-0x20340080e53f53b0:0 x0004000000000000 -> ../../sdc
lrwxrwxrwx. 1 root root 10 Aug 12 11:38 pci-0000:11:00.0-fc-0x20340080e53f53b0:0 x0004000000000000-part1 -> ../../sdc1
lrwxrwxrwx. 1 root root 9 Aug 12 12:06 pci-0000:11:00.1-fc-0x20350080e53f53b0:0 x0001000000000000 -> ../../sde
lrwxrwxrwx. 1 root root 9 Aug 12 11:38 pci-0000:11:00.1-fc-0x20350080e53f53b0:0 x0002000000000000 -> ../../sdf
lrwxrwxrwx. 1 root root 10 Aug 12 11:38 pci-0000:11:00.1-fc-0x20350080e53f53b0:0 x0002000000000000-part1 -> ../../sdf1
lrwxrwxrwx. 1 root root 9 Aug 12 12:06 pci-0000:11:00.1-fc-0x20350080e53f53b0:0 x0004000000000000 -> ../../sdg
lrwxrwxrwx. 1 root root 9 Aug 12 12:03 pci-0000:16:00.0-scsi-0:2:0:0 -> ../../s dd
lrwxrwxrwx. 1 root root 10 Aug 12 11:38 pci-0000:16:00.0-scsi-0:2:0:0-part1 -> . ./../sdd1
lrwxrwxrwx. 1 root root 10 Aug 12 11:42 pci-0000:16:00.0-scsi-0:2:0:0-part2 -> . ./../sdd2
lrwxrwxrwx. 1 root root 10 Aug 12 11:42 pci-0000:16:00.0-scsi-0:2:0:0-part3 -> . ./../sdd3
lrwxrwxrwx. 1 root root 10 Aug 12 11:38 pci-0000:16:00.0-scsi-0:2:0:0-part4 -> . ./../sdd4
lrwxrwxrwx. 1 root root 10 Aug 12 11:42 pci-0000:16:00.0-scsi-0:2:0:0-part5 -> . ./../sdd5
lrwxrwxrwx. 1 root root 10 Aug 12 11:38 pci-0000:16:00.0-scsi-0:2:0:0-part6 -> . ./../sdd6
[root@ANTDWHP ~]# df -T /dev/
Filesystem Type 1K-blocks Used Available Use% Mounted on
- - 66062348 248 66062100 1% /dev

TB0ne · 08-23-2016, 09:22 AM

Quote:

Originally Posted by sandeep002gupta

May be these are the old configuration.
but we check output for /dev/disk/by-path here is showing these disks

Code:

[root@ANTDWHP ~]# ll /dev/disk/by-path/
total 0
lrwxrwxrwx. 1 root root  9 Aug 12 11:38 pci-0000:11:00.0-fc-0x20340080e53f53b0:0x0001000000000000 -> ../../sda
lrwxrwxrwx. 1 root root  9 Aug 23 10:53 pci-0000:11:00.0-fc-0x20340080e53f53b0:0x0002000000000000 -> ../../sdb
lrwxrwxrwx. 1 root root  9 Aug 12 12:03 pci-0000:11:00.0-fc-0x20340080e53f53b0:0x0004000000000000 -> ../../sdc
lrwxrwxrwx. 1 root root 10 Aug 12 11:38 pci-0000:11:00.0-fc-0x20340080e53f53b0:0x0004000000000000-part1 -> ../../sdc1
lrwxrwxrwx. 1 root root  9 Aug 12 12:06 pci-0000:11:00.1-fc-0x20350080e53f53b0:0x0001000000000000 -> ../../sde
lrwxrwxrwx. 1 root root  9 Aug 12 11:38 pci-0000:11:00.1-fc-0x20350080e53f53b0:0x0002000000000000 -> ../../sdf
lrwxrwxrwx. 1 root root 10 Aug 12 11:38 pci-0000:11:00.1-fc-0x20350080e53f53b0:0x0002000000000000-part1 -> ../../sdf1
lrwxrwxrwx. 1 root root  9 Aug 12 12:06 pci-0000:11:00.1-fc-0x20350080e53f53b0:0x0004000000000000 -> ../../sdg
lrwxrwxrwx. 1 root root  9 Aug 12 12:03 pci-0000:16:00.0-scsi-0:2:0:0 -> ../../s                                                                                        dd
lrwxrwxrwx. 1 root root 10 Aug 12 11:38 pci-0000:16:00.0-scsi-0:2:0:0-part1 -> ../../sdd1
lrwxrwxrwx. 1 root root 10 Aug 12 11:42 pci-0000:16:00.0-scsi-0:2:0:0-part2 -> ../../sdd2
lrwxrwxrwx. 1 root root 10 Aug 12 11:42 pci-0000:16:00.0-scsi-0:2:0:0-part3 -> ../../sdd3
lrwxrwxrwx. 1 root root 10 Aug 12 11:38 pci-0000:16:00.0-scsi-0:2:0:0-part4 -> ../../sdd4
lrwxrwxrwx. 1 root root 10 Aug 12 11:42 pci-0000:16:00.0-scsi-0:2:0:0-part5 -> ../../sdd5
lrwxrwxrwx. 1 root root 10 Aug 12 11:38 pci-0000:16:00.0-scsi-0:2:0:0-part6 -> ../../sdd6
[root@ANTDWHP ~]# df -T /dev/
Filesystem    Type   1K-blocks      Used Available Use% Mounted on
-                -    66062348       248  66062100   1% /dev

So again, after being here for FIVE YEARS, and saying that you pay for support from Red Hat...WHY aren't you calling them, or applying anything you've been told over the past five years about such issues????