LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices

Reply
 
Search this Thread
Old 01-07-2011, 07:10 PM   #1
slinx
Member
 
Registered: Apr 2008
Location: Cleveland, Ohio
Distribution: SuSE, CentOS, Fedora, Ubuntu
Posts: 106

Rep: Reputation: 23
Unhappy Directories / Files turned into pipes !


Hello, I've had this problem before, and it conked a server tonight. We have Dell PowerEdge servers with PERC controllers and SAS drives. One of the drives will fail, and even after rebuilding the drive, after reboot, the system is corrupted. It fails with the dreaded
Code:
Kernel panic - not syncing: Attempted to kill init!
I usually have to boot the server to a rescue CD ( Scientific Linux 4.7), and copy corrupted files from a working system.

Today I had a server do this, and upon mounting the bad partition, I see that the /lib directory has been turned into a pipe!
Code:
[root@slinux dm-0]# ls -l
total 196
drwxr-xr-x    2 root root       4096 Dec  6 16:44 bin
drwxr-xr-x    2 root root       4096 Feb 24  2010 boot
drwxr-xr-x    4 root root       4096 Feb 24  2010 dev
drwxr-xr-x  102 root root      12288 Jan  7 16:42 etc
-rw-r--r--    1 root root        296 Feb 24  2010 event.log
-rw-r--r--    1 root root          0 Jan  7 23:15 forcefsck
-rw-r--r--    1 root root          0 Jan  7 16:41 halt
drwxr-xr-x    2 root root       4096 Feb 24  2010 home
p-----S---   13  170 root 3624927232 Feb 24  2010 lib
drwx------    2 root root      16384 Feb 24  2010 lost+found
drwxr-xr-x    2 root root       4096 Mar  9  2009 media
drwxr-xr-x    2 root root       4096 Jan 21  2009 misc
drwxr-xr-x    3 root root       4096 Feb 24  2010 mnt
dr-xr-xr-x    2 root root       4096 Feb 24  2010 net
drwxr-xr-x    2 root root       4096 Feb 24  2010 opt
drwxr-xr-x    2 root root       4096 Feb 24  2010 proc
drwxr-x---    8 root root       4096 Jan  7 16:10 root
drwxr-xr-x    2 root root      12288 Dec  6 16:44 sbin
drwxr-xr-x    2 root root       4096 Feb 24  2010 selinux
drwxr-xr-x    2 root root       4096 Mar  9  2009 srv
drwxr-xr-x    2 root root       4096 Feb 24  2010 sys
drwxr-xr-x    2 root root       4096 Feb 24  2010 tmp
drwxr-xr-x    2 root root       4096 Feb 24  2010 usr
drwxr-xr-x    2 root root       4096 Feb 24  2010 var
Right now, I'm copying /lib from a working server. Rebooting now...


What causes this? Is there an easier way to recover from this kind of error?

Thanks!

Edit: I successfully recovered the server, just had to drop to a shell and fsck 3 times, after copying /lib from the other server. If anyone knows an alternate way of recovering a directory from becoming a pipe, please let me know. It looks like all the files were moved into the "pipe" and maybe could have been repaired.

Should I expect better stability if I were to put my system files in ext3 file systems directly on disk partitions, rather than using LVM?

Last edited by slinx; 01-08-2011 at 01:42 PM. Reason: addendum
 
  


Reply

Tags
filesystems, init, kernel panic, pipe


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
gawk copy files (DOS pipes and redirects) scripterJACK General 6 03-02-2010 12:53 PM
problem in handling pipes concept while passing error and output in two files nagendrar Programming 1 11-06-2009 09:11 AM
examples with 2 pipes+fork+handling error,output in different files nagendrar Programming 4 11-06-2009 07:36 AM
example for redirecting stderr,stdout in seperate files using two way pipes concept nagendrar Programming 0 07-06-2009 07:08 AM
samba caching files - need turned off flipperscr83 Linux - Wireless Networking 1 05-18-2005 08:54 AM


All times are GMT -5. The time now is 05:23 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration