LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 11-07-2012, 06:24 AM   #1
sisir.ghosh
LQ Newbie
 
Registered: Nov 2012
Posts: 1

Rep: Reputation: Disabled
Cluster problem RHEL 6.1/Error in fenced.log


We are having a two node cluster.

Now and then one node fence the other.
The /var/log/messages displays

Nov 7 09:12:08 drintra2 corosync[3577]: [TOTEM ] A processor failed, forming new configuration.
Nov 7 09:12:10 drintra2 corosync[3577]: [QUORUM] Members[1]: 2
Nov 7 09:12:10 drintra2 corosync[3577]: [TOTEM ] A processor joined or left the membership and a new membership was formed.
Nov 7 09:12:10 drintra2 corosync[3577]: [CPG ] downlist received left_list: 1
Nov 7 09:12:10 drintra2 corosync[3577]: [CPG ] chosen downlist from node r(0) ip(10.50.2.24)
Nov 7 09:12:10 drintra2 corosync[3577]: [MAIN ] Completed service synchronization, ready to provide service.
Nov 7 09:12:10 drintra2 rgmanager[3786]: State change: drintra1.cesc.co.in DOWN
Nov 7 09:12:10 drintra2 fenced[3633]: fencing node drintra1.cesc.co.in
Nov 7 09:12:10 drintra2 kernel: dlm: closing connection to node 1
Nov 7 09:12:13 drintra2 fenced[3633]: fence drintra1.cesc.co.in dev 0.0 agent fence_drac5 result: error from agent
Nov 7 09:12:13 drintra2 fenced[3633]: fence drintra1.cesc.co.in failed
Nov 7 09:12:13 drintra2 fenced[3633]: failed to get dbus connection
Nov 7 09:12:16 drintra2 fenced[3633]: fencing node drintra1.cesc.co.in
Nov 7 09:12:18 drintra2 corosync[3577]: [TOTEM ] A processor joined or left the membership and a new membership was formed.
Nov 7 09:12:18 drintra2 corosync[3577]: [QUORUM] Members[2]: 1 2
Nov 7 09:12:18 drintra2 corosync[3577]: [QUORUM] Members[2]: 1 2
Nov 7 09:12:18 drintra2 rgmanager[3786]: State change: drintra1.cesc.co.in UP
Nov 7 09:12:21 drintra2 corosync[3577]: [CPG ] downlist received left_list: 0
Nov 7 09:12:21 drintra2 corosync[3577]: [CPG ] downlist received left_list: 1
Nov 7 09:12:21 drintra2 corosync[3577]: [CPG ] chosen downlist from node r(0) ip(10.50.2.19)
Nov 7 09:12:21 drintra2 corosync[3577]: [MAIN ] Completed service synchronization, ready to provide service.



The fenced.log displays like this

Nov 02 09:50:06 fenced fencing node drintra1.cesc.co.in
Nov 02 09:50:12 fenced fence drintra1.cesc.co.in dev 0.0 agent fence_drac5 result: error from agent
Nov 02 09:50:12 fenced fence drintra1.cesc.co.in failed
Nov 02 09:50:12 fenced failed to get dbus connection
Nov 02 09:50:15 fenced fencing node drintra1.cesc.co.in
Nov 02 09:50:21 fenced fence drintra1.cesc.co.in dev 0.0 agent fence_drac5 result: error from agent
Nov 02 09:50:21 fenced fence drintra1.cesc.co.in failed
Nov 02 09:50:21 fenced failed to get dbus connection
Nov 02 09:50:24 fenced fencing node drintra1.cesc.co.in
Nov 02 09:50:40 fenced fence drintra1.cesc.co.in success
Nov 02 09:50:40 fenced failed to get dbus connection
Nov 02 09:50:40 fenced cpg_mcast_joined error 12 handle 2443a85800000001 victim_done
Nov 02 09:50:40 fenced cpg_mcast_joined error 12 handle 2443a85800000001 complete
Nov 02 09:50:40 fenced cpg_mcast_joined error 12 handle 2443a85800000001 start
Nov 02 09:50:40 fenced fencing deferred to unknown

I have googled a lot and many are saying that it is a problem with multicast. How could I check multicast between the servers.

If any further configuration file is required to solve the problem please feel free to ask for it and I will post them accordingly.

Please help, this is becoming a nightmare for us.

Last edited by sisir.ghosh; 11-07-2012 at 06:27 AM.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Problem with RHEL 5.7 booting up on a cluster storage server ganesh_k Linux - Server 2 06-07-2012 10:46 PM
Error 500 in RHEL 6 Cluster chandhokshashank Linux - Enterprise 1 09-04-2011 02:29 AM
rhel 6.1 cluster - strange problem mkiler Red Hat 0 06-01-2011 09:30 AM
Need assistence in seting up of RHEL cluster on RHEL 5.0 cj_cheema Linux - Server 3 06-16-2009 10:09 AM
RHEL Server error log johnbeskie Linux - Server 1 04-28-2008 04:02 AM


All times are GMT -5. The time now is 02:44 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration