Linux - Virtualization and CloudThis forum is for the discussion of all topics relating to Linux Virtualization and Linux Cloud platforms. Xen, KVM, OpenVZ, VirtualBox, VMware, Linux-VServer and all other Linux Virtualization platforms are welcome. OpenStack, CloudStack, ownCloud, Cloud Foundry, Eucalyptus, Nimbus, OpenNebula and all other Linux Cloud platforms are welcome. Note that questions relating solely to non-Linux OS's should be asked in the General forum.
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
I get the following error when trying to add NFS storage to my oVirt Cluster
Quote:
Error while executing action RemoveStorageServerConnection: Unexpected exception
Now I went on the oVirt Server; and found this in the logs (/var/log/ovirt/engine.log)
Code:
2012-04-14 09:37:24,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (http--0.0.0.0-8443-4) [2473641b] START, ValidateStorageServerConnectionVDSCommand(vdsId = 14a2f814-85bf-11e1-822d-0016367ecdf0, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.ovirt.4over.com:/vol/webresources/ovirt };]), log id: 41df1751
2012-04-14 09:37:24,745 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (http--0.0.0.0-8443-4) [2473641b] Failed in ValidateStorageServerConnectionVDS method
2012-04-14 09:37:24,745 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (http--0.0.0.0-8443-4) [2473641b] Error code unexpected and error message VDSGenericException: VDSErrorException: Failed to ValidateStorageServerConnectionVDS, error = Unexpected exception
2012-04-14 09:37:24,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (http--0.0.0.0-8443-4) [2473641b] Command org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand return value
Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.ServerConnectionStatusReturnForXmlRpc
mStatusList Null
mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc
mCode 16
mMessage Unexpected exception
2012-04-14 09:37:24,747 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (http--0.0.0.0-8443-4) [2473641b] Vds: bluejay
2012-04-14 09:37:24,747 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (http--0.0.0.0-8443-4) [2473641b] Command ValidateStorageServerConnectionVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to ValidateStorageServerConnectionVDS, error = Unexpected exception
2012-04-14 09:37:24,747 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (http--0.0.0.0-8443-4) [2473641b] FINISH, ValidateStorageServerConnectionVDSCommand, log id: 41df1751
2012-04-14 09:37:24,748 ERROR [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (http--0.0.0.0-8443-4) [2473641b] Error during CanDoActionFailure.: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to ValidateStorageServerConnectionVDS, error = Unexpected exception
at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:53) [engine-bll.jar:]
at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:38) [engine-bll.jar:]
at org.ovirt.engine.core.bll.storage.BaseFsStorageHelper.ValidateStoragePoolConnectionsInHost(BaseFsStorageHelper.java:44) [engine-bll.jar:]
at org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand.canDoAction(AddStorageServerConnectionCommand.java:85) [engine-bll.jar:]
at org.ovirt.engine.core.bll.CommandBase.InternalCanDoAction(CommandBase.java:478) [engine-bll.jar:]
at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:253) [engine-bll.jar:]
at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:327) [engine-bll.jar:]
at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:287) [engine-bll.jar:]
at sun.reflect.GeneratedMethodAccessor125.invoke(Unknown Source) [:1.6.0_22]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [:1.6.0_22]
at java.lang.reflect.Method.invoke(Method.java:616) [:1.6.0_22]
at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.0.Beta1b.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:]
at org.ovirt.engine.core.utils.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:11) [engine-utils.jar:]
at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) [:1.6.0_22]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [:1.6.0_22]
at java.lang.reflect.Method.invoke(Method.java:616) [:1.6.0_22]
at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.1.0.Beta1b.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.0.Beta1b.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.0.Beta1b.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3-7.1.0.Beta1b.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:221) [jboss-as-ejb3-7.1.0.Beta1b.jar:]
at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:367) [jboss-as-ejb3-7.1.0.Beta1b.jar:]
at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:205) [jboss-as-ejb3-7.1.0.Beta1b.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.0.Beta1b.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:44) [jboss-as-ee-7.1.0.Beta1b.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:55) [jboss-as-ejb3-7.1.0.Beta1b.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.0.Beta1b.jar:]
at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.0.Beta1b.jar:]
at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:]
at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.0.Beta1b.jar:]
at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view9.RunAction(Unknown Source) [engine-common.jar:]
at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:120)
at sun.reflect.GeneratedMethodAccessor124.invoke(Unknown Source) [:1.6.0_22]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [:1.6.0_22]
at java.lang.reflect.Method.invoke(Method.java:616) [:1.6.0_22]
at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196)
at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:161)
at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:222)
at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec-1.0.0.Final.jar:]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec-1.0.0.Final.jar:]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161)
at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:151)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:362)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:877)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:671)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:930)
at java.lang.Thread.run(Thread.java:679) [:1.6.0_22]
2012-04-14 09:37:24,901 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (http--0.0.0.0-8443-4) [59f5ac21] Running command: RemoveStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System
2012-04-14 09:37:24,907 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (http--0.0.0.0-8443-4) [59f5ac21] START, DisconnectStorageServerVDSCommand(vdsId = 14a2f814-85bf-11e1-822d-0016367ecdf0, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.ovirt.4over.com:/vol/webresources/ovirt };]), log id: 4dad8f68
2012-04-14 09:37:24,922 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (http--0.0.0.0-8443-4) [59f5ac21] Failed in DisconnectStorageServerVDS method
2012-04-14 09:37:24,922 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (http--0.0.0.0-8443-4) [59f5ac21] Error code unexpected and error message VDSGenericException: VDSErrorException: Failed to DisconnectStorageServerVDS, error = Unexpected exception
2012-04-14 09:37:24,923 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (http--0.0.0.0-8443-4) [59f5ac21] Command org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand return value
Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.ServerConnectionStatusReturnForXmlRpc
mStatusList Null
mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc
mCode 16
mMessage Unexpected exception
2012-04-14 09:37:24,924 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (http--0.0.0.0-8443-4) [59f5ac21] Vds: bluejay
2012-04-14 09:37:24,924 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (http--0.0.0.0-8443-4) [59f5ac21] Command DisconnectStorageServerVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to DisconnectStorageServerVDS, error = Unexpected exception
2012-04-14 09:37:24,924 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (http--0.0.0.0-8443-4) [59f5ac21] FINISH, DisconnectStorageServerVDSCommand, log id: 4dad8f68
2012-04-14 09:37:24,925 ERROR [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (http--0.0.0.0-8443-4) [59f5ac21] Command org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DisconnectStorageServerVDS, error = Unexpected exception
2012-04-14 09:37:24,929 ERROR [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (http--0.0.0.0-8443-4) [59f5ac21] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand.
Now on the host this is what's in the /var/log/vdsm/vdsm.log file...
Code:
Thread-34801::DEBUG::2012-04-14 09:42:06,896::BindingXMLRPC::167::vds::(wrapper) [192.168.11.236]
Thread-34801::ERROR::2012-04-14 09:42:06,896::BindingXMLRPC::171::vds::(wrapper) Unexpected exception
Traceback (most recent call last):
File "/usr/share/vdsm/BindingXMLRPC.py", line 169, in wrapper
return f(*args, **kwargs)
File "/usr/share/vdsm/BindingXMLRPC.py", line 571, in poolValidateStorageServerConnection
return pool.validateStorageServerConnection(domType, conList)
File "/usr/share/vdsm/API.py", line 897, in validateStorageServerConnection
return self._irs.validateStorageServerConnection(domainType,
AttributeError: 'NoneType' object has no attribute 'validateStorageServerConnection'
Thread-34802::DEBUG::2012-04-14 09:42:07,072::BindingXMLRPC::167::vds::(wrapper) [192.168.11.236]
Thread-34802::ERROR::2012-04-14 09:42:07,073::BindingXMLRPC::171::vds::(wrapper) Unexpected exception
Traceback (most recent call last):
File "/usr/share/vdsm/BindingXMLRPC.py", line 169, in wrapper
return f(*args, **kwargs)
File "/usr/share/vdsm/BindingXMLRPC.py", line 491, in poolDisconnectStorageServer
return pool.disconnectStorageServer(domType, conList)
File "/usr/share/vdsm/API.py", line 823, in disconnectStorageServer
return self._irs.disconnectStorageServer(domainType, self._UUID,
AttributeError: 'NoneType' object has no attribute 'disconnectStorageServer'
I don't know any python so trying to read that is like reading Greek (unfortunately); so that log didn't help me much.
Now on the host I CAN manually mount the NFS share no problem using the "mount.nfs nfs.ovirt.example.com:/vol/ovirt /mnt" command (no problem). And I've even tried making the directory 777 (owned by vdsm:kvm ...still didn't work).
Where can I look/try next? What could be the issue?
can you post the entire vdsm.log output, starting where Thread-34801 started? Pastebin would probably be better than directly in here.
BTW, what do you use for exporting NFS? another RHEL box?
can you post the entire vdsm.log output, starting where Thread-34801 started? Pastebin would probably be better than directly in here.
BTW, what do you use for exporting NFS? another RHEL box?
To answer your second question first. I am using a NetApp filer to export my NFS.
Also not sure EXACTLY where to start in my logs...so (sorry there is a lot here) I've attached the entire log.
Please excuse the other errors (I had other issues as well trying to add the server). But the most recent NFS issue is (obviously) towards the bottom
According to the log, it seems like things never reach the actual NFS connection part, failing way before that. Can you provide some details on the host - how you installed it, what OS it is running etc
According to the log, it seems like things never reach the actual NFS connection part, failing way before that. Can you provide some details on the host - how you installed it, what OS it is running etc
Currently using CentOS 6.2 64bit on both oVirt server and nodes.
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.
