LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 12-13-2017, 11:10 PM   #1
rustyz82
Member
 
Registered: May 2004
Posts: 69

Rep: Reputation: 15
Angry dracut disk /dev/disk/by-uuid/blah missing when its not


I have a server setup with 2 1TB Drives using software raid1. 3 partitions total...

I reboot my server after a couple months.. and now it is failing to boot. It drops into a dracut emergency mode shell.

The error indicates that the disk /dev/disk/by-uuid/8046c24a-cf00-4c82-bb34-f8b76cb29 does not exist. However when I boot into the rescue kernel and do blkid I can see that it does exist as the root partition device /dev/md127.

I would paste more details from commands but I can't copy and paste from the Java console application that is the only way I can access the server right now. I'll happily type out anything that would be helpful.. and I can screenshot easy enough as well.

I tried rebuilding the initramfs image with dracut as suggested in several posts I found but I am still getting the same error. I am out of ideas on what to do at this point and welcome any guidance.

The only thing I see that seems odd is when I look at the /run/initramfs/rdsosreport.txt at the very beginning it does ls -l /dev/disk/by* and it gets back a no such file or directory error. This seems like it could cause the disk not being found but I don't know why it would not find it.. when i do the same command in the rescue kernel i get a full list which has all the devices and raid devices.

The section of the log goes like this:

Code:
configfs /sys/kernel/config configfs rw,relatime 0 0
blkid
blkid -o udev
ls -l '/dev/disk/by*'
ls: cannot access /dev/disk/by*: No such file or directory
for _i in '/etc/conf.d/*.conf'
'[' -f /etc/conf.d/systemd.conf ']'
I have spent more hours on this then I care to think about so if it sounds like i'm frustrated.. I am. I am hoping I'm just missing something.. obvious.

Last edited by rustyz82; 12-16-2017 at 12:33 AM.
 
Old 12-14-2017, 03:50 PM   #2
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,119

Rep: Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120
Sounds like a race - are the devices externally connected ?. The devices nodes may be taking a while to get created.
 
Old 12-15-2017, 09:30 AM   #3
rustyz82
Member
 
Registered: May 2004
Posts: 69

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by syg00 View Post
Sounds like a race - are the devices externally connected ?. The devices nodes may be taking a while to get created.
They are not externally connected. They are plugged into the hard drive slots of a C6100 non-removable Blade chassis. And sadly i'm losing the race.. every time.
 
Old 12-15-2017, 11:13 AM   #4
rustyz82
Member
 
Registered: May 2004
Posts: 69

Original Poster
Rep: Reputation: 15
If they are taking a while to get created, is there something I can add to the boot config to create a delay? allowing the nodes to be created? I realize this is more of a workaround but... Id really like to get the server up at least.
 
Old 12-15-2017, 05:22 PM   #5
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,119

Rep: Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120
Maybe try adding "rootdelay=15" (that's seconds) to the kernel parms. Dunno, but easy to try.
 
Old 12-15-2017, 11:47 PM   #6
rustyz82
Member
 
Registered: May 2004
Posts: 69

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by syg00 View Post
Maybe try adding "rootdelay=15" (that's seconds) to the kernel parms. Dunno, but easy to try.
So I can only get into the rescue shell.. and it looks like it doesn't support ext4 so I can't mount the boot partition... in the rescue shell i have a /boot with images but no grub config file..

Suggestions on how I can go about adding kernel parameters?

I am trying to boot from installation media now to see if that will let me access the grub config file now.

Edit: I was able to add a new menu entry including the delay, however that new menu entry did not show up after I ran the grub2-mkconfig command to generate the new grub.cfg file. I verified it was in the .cfg file but it didn't show up when I booted. So I used the grub option to edit an existing entry and added the rootdelay=15 to it... however that doesn't seem to have made any difference. I still see dracut-initqueue timeout messages during boot and end up in the same dracut shell with the same message indicating the disk doesnt exist. I still see the same cannot access /dev/disk/by*: No such file or directory message in the rdsosreport.txt file as well.

I upped the rootdelay to 90 but it doesnt seem like its making a difference in how long the system takes to boot or the results I am getting.

Last edited by rustyz82; 12-16-2017 at 12:32 AM.
 
Old 12-18-2017, 08:16 PM   #7
rustyz82
Member
 
Registered: May 2004
Posts: 69

Original Poster
Rep: Reputation: 15
In case it wasn't clear this is a software raid setup. The supposed missing disk is the root partition in the array. All disks for the array show up in blkid and the drives/volumes show clean and intact according to mdraid. I am still stumped on this and welcome any other ideas or requests for information.
 
Old 12-20-2017, 05:50 PM   #8
rustyz82
Member
 
Registered: May 2004
Posts: 69

Original Poster
Rep: Reputation: 15
In case anyone else encounters this... i solved the issue by changing the IDE mode in the BIOS from AHCI to IDE. Turns out my provider moved my server to a different but identical set of hardware... which had the AHCI option set in BIOS.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] /dev/disk/by-uuid/<uuid here> does not exist and initramfs shell Mitt Green Linux - Kernel 4 08-03-2015 11:56 AM
emachines et1331, boot problems, missing modules, /dev/disk/by-uuid/4b69e9df-e...... islamaro Linux - Newbie 3 03-28-2015 03:18 PM
[SOLVED] How to mount by-uuid if the device won't show in /dev/disk/by-uuid untill after blkid /dev/sd* ? masmddr Linux - General 4 01-10-2011 07:38 PM
Volume has problems including no uuid in /dev/disk/by-uuid abejarano Linux - Hardware 3 12-31-2008 08:41 PM
/dev/disk/by-uuid on install disk? randomsel Slackware 6 06-29-2008 08:54 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 08:05 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration