LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 12-06-2014, 09:52 AM   #1
sharpblade
LQ Newbie
 
Registered: Feb 2005
Posts: 13

Rep: Reputation: 0
Unhappy File system becomes read-only, hardware failure or software problem?


HP server with RADI, file system may become read-only after some time of running. Rebooting the system will recover it, but read-only again after a period of time.

Here's some information:

[zero@HP380 ~]$ uname -a
Linux HP380.xxxx 2.6.32-358.el6.x86_64 #1 SMP Tue Jan 29 11:47:41 EST 2013 x86_64 x86_64 x86_64 GNU/Linux

[zero@HP380 ~]$ mount
/dev/sda3 on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sda1 on /boot type ext4 (rw)
/dev/sdb1 on /home type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)

[zero@HP380 ~]$ mkdir asdf

mkdir: cannot create directory `asdf': Read-only file system

[zero@HP380 ~]$ dmesg|grep error

sd 0:0:0:1: [sdb] Add. Sense: Unrecovered read error

EXT4-fs error (device sdb1) in ext4_reserve_inode_write: Journal has aborted

EXT4-fs error (device sdb1) in ext4_free_blocks: Journal has aborted

EXT4-fs (sdb1): delayed block allocation failed for inode 14550561 at logical offset 0 with max blocks 1573 with error -30

EXT4-fs error (device sdb1) in ext4_da_writepages: Journal has aborted

EXT4-fs error (device sdb1): ext4_journal_start_sb: Detected aborted journal

The HP's server maintaining tools does not detect any problem for the raid.

"Unrecovered read error" - Is it possible a disk hardware failure?
How can I fix it ? of course not a temporary fix by rebooting...
 
Old 12-06-2014, 10:14 AM   #2
metaschima
Senior Member
 
Registered: Dec 2013
Distribution: Slackware
Posts: 1,982

Rep: Reputation: 492Reputation: 492Reputation: 492Reputation: 492Reputation: 492
Run:
Code:
smartctl -a /dev/sdb
and post the output here.
 
Old 12-08-2014, 09:58 AM   #3
sharpblade
LQ Newbie
 
Registered: Feb 2005
Posts: 13

Original Poster
Rep: Reputation: 0
SMART not supported.

Quote:
Originally Posted by metaschima View Post
Run:
Code:
smartctl -a /dev/sdb
and post the output here.
Code:
[zero@HP380 xxx]# smartctl -a /dev/sdb

smartctl 5.43 2012-06-30 r3573 [x86_64-linux-2.6.32-358.el6.x86_64] (local build)

Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net

 

Vendor:               HP     

Product:              LOGICAL VOLUME 

Revision:             3.52

User Capacity:        1,800,280,170,496 bytes [1.80 TB]

Logical block size:   512 bytes

Logical Unit id:      0x600508b1001cc7ff72230ea46040e9a3

Serial number:        5001438009F6B750

Device type:          disk

Local Time is:        Mon Dec  8 12:04:34 2014 CST

Device does not support SMART

 

Error Counter logging not supported

Device does not support Self Test logging
Why SMART is not supported? How to support SMART?
 
Old 12-08-2014, 10:24 AM   #4
metaschima
Senior Member
 
Registered: Dec 2013
Distribution: Slackware
Posts: 1,982

Rep: Reputation: 492Reputation: 492Reputation: 492Reputation: 492Reputation: 492
If the device does not support SMART then you cannot know for sure if it is failing.

If these errors are not caused by power outage then I would assume that disk is failing and replace the drive.
 
Old 12-08-2014, 12:08 PM   #5
DavidMcCann
LQ Veteran
 
Registered: Jul 2006
Location: London
Distribution: PCLinuxOS, Debian
Posts: 6,142

Rep: Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314
The message that SMART is not supported might not be literally true. Enter the BIOS when you switch on the computer and go to the hard-drive section and see if there is an option to activate SMART — it might just be switched off by default.
 
Old 12-08-2014, 01:30 PM   #6
Teufel
Member
 
Registered: Apr 2012
Distribution: Gentoo
Posts: 616

Rep: Reputation: 142Reputation: 142
moreover, after enabling SMART in BIOS, you have to enable it like this as well:
Code:
smartctl -s on /dev/sdb
before trying to retrieve report by
Code:
smartctl -x /dev/sdb

Last edited by Teufel; 12-08-2014 at 01:34 PM.
 
Old 12-08-2014, 05:06 PM   #7
metaschima
Senior Member
 
Registered: Dec 2013
Distribution: Slackware
Posts: 1,982

Rep: Reputation: 492Reputation: 492Reputation: 492Reputation: 492Reputation: 492
From my experience it would say that SMART is not enabled, not that the device doesn't support SMART, but check anyway.
 
Old 12-09-2014, 09:10 AM   #8
sharpblade
LQ Newbie
 
Registered: Feb 2005
Posts: 13

Original Poster
Rep: Reputation: 0
Still cannot find option to enable SMART in BIOS.
But one of the disk's led showed failure state. So it's definitely a disk hardware problem.
Thanks everybody for the advice.
 
Old 12-10-2014, 01:00 AM   #9
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,140

Rep: Reputation: 4122Reputation: 4122Reputation: 4122Reputation: 4122Reputation: 4122Reputation: 4122Reputation: 4122Reputation: 4122Reputation: 4122Reputation: 4122Reputation: 4122
What type of RAID, and what does /etc/fstab have in it.

Last edited by syg00; 12-10-2014 at 02:10 PM. Reason: corrected fstab
 
Old 12-10-2014, 11:23 AM   #10
rknichols
Senior Member
 
Registered: Aug 2009
Distribution: Rocky Linux
Posts: 4,781

Rep: Reputation: 2214Reputation: 2214Reputation: 2214Reputation: 2214Reputation: 2214Reputation: 2214Reputation: 2214Reputation: 2214Reputation: 2214Reputation: 2214Reputation: 2214
Just a couple of points that seem to have been missed:
  • It doesn't surprise me that the composite RAID device does not support SMART. That is something that would apply to the individual drives.
  • Failure of a single drive should not cause any issues for the OS. Continuing on seamlessly in the face of such failures is what RAID is all about.
As there is nothing in the mount output about mdadm devices, this would have to be either hardware RAID or "Fake RAID" in the BIOS. As syg00 requested, more information about the RAID setup is needed.
 
Old 12-11-2014, 01:14 AM   #11
sharpblade
LQ Newbie
 
Registered: Feb 2005
Posts: 13

Original Poster
Rep: Reputation: 0
Quote:
Originally Posted by syg00 View Post
What type of RAID, and what does /etc/fstab have in it.
/dev/sdb is RAID5

#
# /etc/fstab
# Created by anaconda on Fri Jan 24 16:30:02 2014
#
# Accessible filesystems, by reference, are maintained under '/dev/disk'
# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info
#
UUID=40232a79-9578-4221-b8f3-81da15e08f6a / ext4 defaults 1 1
UUID=313b9c70-1664-4f48-8dc1-195fadd29116 /boot ext4 defaults 1 2
UUID=673e35f3-9fd1-489b-b01b-4131f5d84851 /home ext4 defaults 1 2
UUID=462dd42d-9a70-4763-ac10-41e2f81dad1c swap swap defaults 0 0
tmpfs /dev/shm tmpfs defaults 0 0
devpts /dev/pts devpts gid=5,mode=620 0 0
sysfs /sys sysfs defaults 0 0
proc /proc proc defaults 0 0
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Duplicity backup failure involving a read-only file system UbuntuPD65 Linux - Desktop 2 09-30-2014 02:49 AM
'Read-only file system' problem buehler Linux - Newbie 7 05-09-2006 12:13 AM
problem: a read only file system milo36472 Linux - Newbie 3 01-24-2005 09:11 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 10:36 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration