LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Debian
User Name
Password
Debian This forum is for the discussion of Debian Linux.

Notices

Reply
 
Search this Thread
Old 05-10-2010, 06:00 AM   #1
tkmsr
Member
 
Registered: Oct 2006
Distribution: Ubuntu,Open Suse,Debian,Mac OS X
Posts: 798

Rep: Reputation: 39
'bug no 502849 on Debian amd64 is solved but how do I use it I faced


Today morning I found my xen crashed I was using Debian lenny amd64 bit
2.6.26-2-xen-amd64 and xen-3.2.1

Xen had crashed
even though I try to restart it gave error
[code]
server:~# xm list
Error: Unable to connect to xend: No such file or directory. Is xend running?
server:~# /etc/init.d/xend start
Starting XEN control daemon: xendFATAL: Could not create tdb file
/var/lib/xenstored/tdb: Input/output error
failed!
[/server]
This link http://lists.xensource.com/archives/.../msg00969.html
says it is usual
but I am unable to understand what to do I am using Debian Lenny and xen-3.2


I digged a bit more looked at /var/log/messages and found
an error [ 0.377064] map irq failed
it was repeated at many places in the file.After reboot xen fails to start.


Seems to be a known bug numbered 502849
http://www.mail-archive.com/debian-b...msg586859.html
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=502849
Code:
linux-image-2.6.26-1-xen-amd64: unable to handle kernel paging request
and this problem is only in amd64 kernels.
reading the mailing list archives it appears using sid is the only
solution they mentioned.I am not clear with now.
If what I have found which I most probably seem to be correct but is
there any thing else I need to check before I reach this conclusion?
How can I solve this problem I am using lenny.

Last edited by tkmsr; 05-10-2010 at 06:01 AM.
 
Old 05-10-2010, 08:10 AM   #2
Simon Bridge
Guru
 
Registered: Oct 2003
Location: Waiheke NZ
Distribution: Ubuntu
Posts: 9,211

Rep: Reputation: 197Reputation: 197
This is the problem:

Starting XEN control daemon: xendFATAL: Could not create tdb file

Quote:
This link http://lists.xensource.com/archives/.../msg00969.html
says it is usual
That link is to a forum discussion that says:

> Also, even though /lib/tls was renamed to /lib/tls.disabled, we still
> see the tls performance warning message during boot.

This is normal for certain builds of Linux - it's because "nash" (or
some other component used by the "initrd") are using statically linked
libraries that use TLS.

... why do you believe that discussion has anything to do with your problem?

502849 Mon, 20 Oct 2008 was merged with 508429
It reported Xen failing to run 64 bit kernels with error message

[ 0.721697] ACPI Error (psparse-0530): Method parse/execution failed [\_PR_.CPU2._PDC] (Node ffff88007505c370), AE_NO_MEMORY
[ 0.721697] BUG: unable to handle kernel paging request at ffff88080000fff8

Thu, 11 Dec 2008 the dev confirms that there was a bug in the x64 lenny kernel which prevented it running in the hypervisor - and the fix was "pending". That was years ago - the fix is out.

So... again: what makes you think this bug report has anything to do with your problem?




xend was unable to create the tdb file.

This is the XenStore database.

Something is preventing it from being created - selinux? Damaged HDD? Full partition? Something. Go look.
 
1 members found this post helpful.
Old 05-10-2010, 11:52 AM   #3
tkmsr
Member
 
Registered: Oct 2006
Distribution: Ubuntu,Open Suse,Debian,Mac OS X
Posts: 798

Original Poster
Rep: Reputation: 39
Hi thanks for your reply.I read the link you gave me and it helped me to learn more.I am always welcome to read such nice links.I will appreciate if you can share some more.
Now coming to my problem actually xend daemon is not starting so I have googled those messages.I still do not have any clue as what had happened.
I copy pasted the error messages from log and came across that.My hard disk showed 0 free space so I reached at that conclusion.I saw that /var/xen/lib/save consumed all the space with respective DomU's
yes the disk was full at the time I gave this message.
Code:
Traceback (most recent call last):
  File "/usr/lib/xen-3.2-1/lib/python/xen/xend/XendDomain.py", line 1134, in domain_restore_fd
    return XendCheckpoint.restore(self, fd, paused=paused)
  File "/usr/lib/xen-3.2-1/lib/python/xen/xend/XendCheckpoint.py", line 239, in restore
    forkHelper(cmd, fd, handler.handler, True)
  File "/usr/lib/xen-3.2-1/lib/python/xen/xend/XendCheckpoint.py", line 361, in forkHelper
    raise XendError("%s failed" % string.join(cmd))
XendError: /usr/lib/xen-3.2-1/bin/xc_restore 4 4 1 2 0 0 0 failed
This is exact error I got.I checked above Python scripts but could not diagnose.

Last edited by tkmsr; 05-10-2010 at 12:23 PM.
 
Old 05-10-2010, 12:33 PM   #4
Simon Bridge
Guru
 
Registered: Oct 2003
Location: Waiheke NZ
Distribution: Ubuntu
Posts: 9,211

Rep: Reputation: 197Reputation: 197
Quote:
Now coming to my problem actually xend daemon is not starting so I have googled those messages.I still do not have any clue as what had happened.
The error message tells you the problem - xend could not start because it could not create the xenstore.
Quote:
yes the disk was full at the time I gave this message.
... ergo: there was not enough space to create the xenstore.

Solution: free up some space.
 
Old 05-10-2010, 12:59 PM   #5
tkmsr
Member
 
Registered: Oct 2006
Distribution: Ubuntu,Open Suse,Debian,Mac OS X
Posts: 798

Original Poster
Rep: Reputation: 39
Quote:
Originally Posted by Simon Bridge View Post
The error message tells you the problem - xend could not start because it could not create the xenstore.... ergo: there was not enough space to create the xenstore.

Solution: free up some space.
I did freed it up and 2.3 GB is free but it this message is still there.
 
Old 05-10-2010, 02:10 PM   #6
Simon Bridge
Guru
 
Registered: Oct 2003
Location: Waiheke NZ
Distribution: Ubuntu
Posts: 9,211

Rep: Reputation: 197Reputation: 197
which error message is still there?
Did you go look at the xenstore to see what was in it?
/var/lib/xenstored

Is 2.3GiB enough to run a VM?
Have you checked to make sure that there is nothing else preventing xend from creating a database file?

Did you shut everything down and restart?
 
Old 05-10-2010, 02:21 PM   #7
tkmsr
Member
 
Registered: Oct 2006
Distribution: Ubuntu,Open Suse,Debian,Mac OS X
Posts: 798

Original Poster
Rep: Reputation: 39
Quote:
Originally Posted by Simon Bridge View Post
which error message is still there?
Code:
[2010-04-29 06:38:17 3305] DEBUG (XendDomainInfo:1008) Storing domain details: {'image/entry': '18446744071564165120', 'console/port': '2', 'image/loader': 'generic', 'vm': '/vm/75a4a665-3b0b-d9d8-81f9-f521fe52fe6a', 'control/platform-feature-multiprocessor-suspend': '1', 'image/guest-os': 'linux', 'image/features/writable-descriptor-tables': '1', 'image/virt-base': '18446744071562067968', 'memory/target': '2097152', 'image/guest-version': '2.6', 'image/features/supervisor-mode-kernel': '1', 'console/limit': '1048576', 'image/paddr-offset': '0', 'image/hypercall-page': '18446744071564197888', 'image/suspend-cancel': '1', 'cpu/0/availability': 'online', 'image/features/pae-pgdir-above-4gb': '1', 'image/features/writable-page-tables': '1', 'console/type': 'xenconsoled', 'image/features/auto-translated-physmap': '1', 'name': 'software', 'domid': '4', 'image/xen-version': 'xen-3.0', 'store/port': '1'}
[2010-04-29 06:38:17 3305] DEBUG (XendCheckpoint:218) restore:shadow=0x0, _static_max=0x80000000, _static_min=0x0,
[2010-04-29 06:38:17 3305] DEBUG (balloon:132) Balloon: 2488304 KiB free; need 2097152; done.
[2010-04-29 06:38:17 3305] DEBUG (XendCheckpoint:235) [xc_restore]: /usr/lib/xen-3.2-1/bin/xc_restore 4 4 1 2 0 0 0
[2010-04-29 06:38:17 3305] INFO (XendCheckpoint:373) xc_domain_restore start: p2m_size = 80800
[2010-04-29 06:38:17 3305] INFO (XendCheckpoint:373) Reloading memory pages:   0%
[2010-04-29 06:38:21 3305] INFO (XendCheckpoint:373) ERROR Internal error: Error when reading page (type was 0)
[2010-04-29 06:38:22 3305] INFO (XendCheckpoint:373) Restore exit with rc=1
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:1897) XendDomainInfo.destroy: domid=4
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:1914) XendDomainInfo.destroyDomain(4)
[2010-04-29 06:38:22 3305] ERROR (XendDomainInfo:1926) XendDomainInfo.destroy: xc.domain_destroy failed.
Traceback (most recent call last):
  File "/usr/lib/xen-3.2-1/lib/python/xen/xend/XendDomainInfo.py", line 1921, in destroyDomain
    xc.domain_destroy(self.domid)
Error: (3, 'No such process')
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:1534) No device model
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:1536) Releasing devices
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:1542) Removing vif/0
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:590) XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:1542) Removing vbd/51713
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:590) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51713
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:1542) Removing vbd/51714
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:590) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51714
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:1542) Removing console/0
[2010-04-29 06:38:22 3305] DEBUG (XendDomainInfo:590) XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
[2010-04-29 06:38:22 3305] ERROR (XendDomain:1136) Restore failed
Traceback (most recent call last):
  File "/usr/lib/xen-3.2-1/lib/python/xen/xend/XendDomain.py", line 1134, in domain_restore_fd
    return XendCheckpoint.restore(self, fd, paused=paused)
  File "/usr/lib/xen-3.2-1/lib/python/xen/xend/XendCheckpoint.py", line 239, in restore
    forkHelper(cmd, fd, handler.handler, True)
  File "/usr/lib/xen-3.2-1/lib/python/xen/xend/XendCheckpoint.py", line 361, in forkHelper
    raise XendError("%s failed" % string.join(cmd))
XendError: /usr/lib/xen-3.2-1/bin/xc_restore 4 4 1 2 0 0 0 failed
If I do /etc/init.d/xend start I get error
Code:
Starting XEN control daemon: xend failed!
Above is log from /var/log/xen/xend.log

Quote:
Originally Posted by Simon Bridge View Post
Did you go look at the xenstore to see what was in it?
/var/lib/xenstored
it contains tld I opened it in vi but it was a neol file I could not understand that.
Quote:
Originally Posted by Simon Bridge View Post
Is 2.3GiB enough to run a VM?
I have not reached this stage I have 420 Gb of LVM to run VMs 2.3 Gib is Dom0 Debian I was running VMs before every thing crashed.
Quote:
Originally Posted by Simon Bridge View Post
Have you checked to make sure that there is nothing else preventing xend from creating a database file?
How should I check this ?If you mean strace then I am not very comfortable with it but if you can tell how should I proceed I will.
Quote:
Originally Posted by Simon Bridge View Post
Did you shut everything down and restart?
Yes

Last edited by tkmsr; 05-10-2010 at 02:28 PM.
 
Old 05-11-2010, 03:15 AM   #8
tkmsr
Member
 
Registered: Oct 2006
Distribution: Ubuntu,Open Suse,Debian,Mac OS X
Posts: 798

Original Poster
Rep: Reputation: 39
I was running VMs on a Xen machine until yesterday.Some how the system did not had any memory and all free space was missing.So I free 6 GB.I have 420 GB separate for VMs.
6GB is free on Dom0.

When ever I am trying to start xend after I boot in

from following grub entries
Code:
title           Xen 3.2-1-amd64 / Debian GNU/Linux, kernel 2.6.26-2-xen-amd64
root            (hd0,0)
kernel          /boot/xen-3.2-1-amd64.gz dom0_mem=500Mb
module          /boot/vmlinuz-2.6.26-2-xen-amd64 root=/dev/sda1 ro console=tty0
module          /boot/initrd.img-2.6.26-2-xen-amd64
if I do /etc/init.d/xend start
it gives error
Starting XEN control daemon: xend failed!
What should I look in,
what probably might be reason.
 
Old 05-11-2010, 04:34 AM   #9
Simon Bridge
Guru
 
Registered: Oct 2003
Location: Waiheke NZ
Distribution: Ubuntu
Posts: 9,211

Rep: Reputation: 197Reputation: 197
Quote:
if I do /etc/init.d/xend start
it gives error
Starting XEN control daemon: xend failed!
That is not the whole error message, surely?
Quote:
What should I look in,
what probably might be reason.
Have a look in the xenstore.
Switch selinux off.

Was there an update before this started happening?
 
Old 05-11-2010, 06:59 AM   #10
tkmsr
Member
 
Registered: Oct 2006
Distribution: Ubuntu,Open Suse,Debian,Mac OS X
Posts: 798

Original Poster
Rep: Reputation: 39
Quote:
Originally Posted by Simon Bridge View Post
That is not the whole error message, surely?

Have a look in the xenstore.
Switch selinux off.

Was there an update before this started happening?
I was searching for past 36 hours just before writing this I was
able to solve this.

http://forums.novell.com/novell-prod...nect-xend.html

deleted all xml files in directories /var/lib/xend
as above link says xend was able to start.
So it seems that XML files in directories in /var/lib/xend were creating problem.
I have the backup of the above xml files in some temporary location.
I was able to see xend running xm info is giving output.

But voilla I ran into another problem
Code:
server:~# xm create /etc/xen/domu1.cfg 
Using config file "/etc/xen/domu1.cfg".
Error: Device 0 (vif) could not be connected. Hotplug scripts not working.
 
Old 05-11-2010, 07:38 AM   #11
tkmsr
Member
 
Registered: Oct 2006
Distribution: Ubuntu,Open Suse,Debian,Mac OS X
Posts: 798

Original Poster
Rep: Reputation: 39
I finally have solved the problem I put back the xml files which I had removed from /var/lib/xend directories rebooted and voilla every thing seems to work perfectly fine.
I am very very surprised.I do not have any logica answer to this some one who is reading this thread and has understood please reply.
 
Old 05-11-2010, 08:29 AM   #12
Simon Bridge
Guru
 
Registered: Oct 2003
Location: Waiheke NZ
Distribution: Ubuntu
Posts: 9,211

Rep: Reputation: 197Reputation: 197
Your initial problem seems to have been solved by recreating the VM. This action was next on my list, but I wanted to have the answer to some questions before doing it.

This created another problem because you had previously erased the hotplug scripts, amongst other things, - restoring the deleted files solved that.

Removing them earlier forced a reconfiguration which solved the previous problem but created the one this thread is about when you restarted. Basically, you have reconfigured a big chunk of xen.

As with the fixed bug you thought was important (see thread title) it is very important to read through descriptions when you are looking for solutions. It's hard, but it gets easier with practise and avoids the confusion you have been experiencing.
 
Old 05-11-2010, 09:00 AM   #13
tkmsr
Member
 
Registered: Oct 2006
Distribution: Ubuntu,Open Suse,Debian,Mac OS X
Posts: 798

Original Poster
Rep: Reputation: 39
Quote:
Originally Posted by Simon Bridge View Post
Your initial problem seems to have been solved by recreating the VM.
I did not recreated any VM.
Quote:
Originally Posted by Simon Bridge View Post
This action was next on my list, but I wanted to have the answer to some questions before doing it.
Please do ask it may help some one else and I also want to go to root cause of the problem.
Quote:
Originally Posted by Simon Bridge View Post
This created another problem because you had previously erased the hotplug scripts, amongst other things, - restoring the deleted files solved that.
But even before I got all Doms back I was able to start xend which is where the problem had started.

Quote:
Originally Posted by Simon Bridge View Post
Removing them earlier forced a reconfiguration which solved the previous problem but created the one this thread is about when you restarted.
Basically, you have reconfigured a big chunk of xen.
I got some portion of this not the last line.

Quote:
Originally Posted by Simon Bridge View Post
As with the fixed bug you thought was important (see thread title) it is very important to read through descriptions when you are looking for solutions. It's hard, but it gets easier with practise and avoids the confusion you have been experiencing.
Yes I do understand.It needs practise.
 
Old 05-11-2010, 10:00 AM   #14
tkmsr
Member
 
Registered: Oct 2006
Distribution: Ubuntu,Open Suse,Debian,Mac OS X
Posts: 798

Original Poster
Rep: Reputation: 39
After posting above message I have now checked the folder again /var/lib/xend/state
two files cpu.xml and host.xml are newly created I am seeing.

In the above process I have described when I moved xml files from /var/lib/xend/state to other place and restarted xend both the files cpu.xml and host.xml are created again and I could compare the old files and see that old files were corrupted and they were cause of this entire error.
But why does xend need them and how at the time I was doing /etc/init.d/xend start they were being created or needed ?Where can I read that?

Last edited by tkmsr; 05-11-2010 at 10:05 AM.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
How to report and verify that a kernel bug was solved. cricballa Linux - Software 14 10-01-2009 05:02 PM
reduced testcase?? solved bug in gcc but what now? PB0711 Programming 2 06-27-2008 01:35 PM
LXer: Memory Corruption Bug Solved, 2.6.25 Expected Today LXer Syndicated Linux News 0 04-16-2008 10:20 PM
Gentoo AMD64 Kernel 2.6.xx Adaptec aacraid hanging solved!!! PriceComparison Linux - Hardware 1 04-12-2005 05:05 AM
LAMP with OpenLdap-Support; Bug//Funny error // SOLVED Trucker Linux - Software 0 02-27-2003 11:27 AM


All times are GMT -5. The time now is 11:05 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration