LinuxQuestions.org
Visit Jeremy's Blog.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 10-25-2010, 04:16 AM   #1
JATA01
Member
 
Registered: Nov 2007
Posts: 207

Rep: Reputation: 15
Exclamation Redhat Cluster is not moving on second node!!


Hello Friends,

I have two node redhat cluster for mysql database.
The problem is that after updating the packages on both of the nodes after and previously the sevices was not able to relocated on second one , even rebooting the server the problem occurs.

While starting the service on second node it started on the first one.
Other services are running fine on both nodes.

I have checked the /etc/hosts, bonding and many more files and seems to good.

Plz find the log for reference.

<notice> Starting stopped service service:hell
Oct 22 14:35:51 indls0040 kernel: kjournald starting. Commit interval 5 seconds
Oct 22 14:35:51 indls0040 kernel: EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
Oct 22 14:35:51 indls0040 kernel: EXT3 FS on dm-10, internal journal
Oct 22 14:35:51 indls0040 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 22 14:35:51 indls0040 clurgmgrd: [7131]: <err> quotaon not found in /bin:/sbin:/usr/bin:/usr/sbin
Oct 22 14:35:53 indls0040 avahi-daemon[6145]: Registering new address record for 10.48.64.82 on eth6.
Oct 22 14:36:25 indls0040 clurgmgrd: [7131]: <err> Starting Service mysql:mysql > Failed - Timeout Error
Oct 22 14:36:25 indls0040 clurgmgrd[7131]: <notice> start on mysql "mysql" returned 1 (generic error)
Oct 22 14:36:25 indls0040 clurgmgrd[7131]: <warning> #68: Failed to start service:hell; return value: 1
Oct 22 14:36:25 indls0040 clurgmgrd[7131]: <notice> Stopping service service:hell
Oct 22 14:36:25 indls0040 clurgmgrd: [7131]: <err> Checking Existence Of File /var/run/cluster/mysql/mysql:mysql.pid [mysql:mysql] > Failed - File Doesn't Exist
Oct 22 14:36:25 indls0040 avahi-daemon[6145]: Withdrawing address record for 10.48.64.82 on eth6.
Oct 22 14:36:35 indls0040 multipathd: dm-10: umount map (uevent)
Oct 22 14:36:35 indls0040 clurgmgrd[7131]: <notice> Service service:hell is recovering
Oct 22 14:40:12 indls0040 kernel: opcmona[12015]: segfault at 0000001000000008 rip 000000000044e3ee rsp 000000004207f9a0 error 6


Thanks-
 
Old 10-25-2010, 07:55 AM   #2
TB0ne
LQ Guru
 
Registered: Jul 2003
Location: Birmingham, Alabama
Distribution: SuSE, RedHat, Slack,CentOS
Posts: 26,634

Rep: Reputation: 7965Reputation: 7965Reputation: 7965Reputation: 7965Reputation: 7965Reputation: 7965Reputation: 7965Reputation: 7965Reputation: 7965Reputation: 7965Reputation: 7965
Quote:
Originally Posted by JATA01 View Post
Hello Friends,
I have two node redhat cluster for mysql database.
The problem is that after updating the packages on both of the nodes after and previously the sevices was not able to relocated on second one , even rebooting the server the problem occurs.

While starting the service on second node it started on the first one.
Other services are running fine on both nodes. I have checked the /etc/hosts, bonding and many more files and seems to good.

Plz find the log for reference.

<notice> Starting stopped service service:hell
Oct 22 14:35:51 indls0040 kernel: kjournald starting. Commit interval 5 seconds
Oct 22 14:35:51 indls0040 kernel: EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
Oct 22 14:35:51 indls0040 kernel: EXT3 FS on dm-10, internal journal
Oct 22 14:35:51 indls0040 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 22 14:35:51 indls0040 clurgmgrd: [7131]: <err> quotaon not found in /bin:/sbin:/usr/bin:/usr/sbin
Oct 22 14:35:53 indls0040 avahi-daemon[6145]: Registering new address record for 10.48.64.82 on eth6.
Oct 22 14:36:25 indls0040 clurgmgrd: [7131]: <err> Starting Service mysql:mysql > Failed - Timeout Error
Oct 22 14:36:25 indls0040 clurgmgrd[7131]: <notice> start on mysql "mysql" returned 1 (generic error)
Oct 22 14:36:25 indls0040 clurgmgrd[7131]: <warning> #68: Failed to start service:hell; return value: 1
Oct 22 14:36:25 indls0040 clurgmgrd[7131]: <notice> Stopping service service:hell
Oct 22 14:36:25 indls0040 clurgmgrd: [7131]: <err> Checking Existence Of File /var/run/cluster/mysql/mysql:mysql.pid [mysql:mysql] > Failed - File Doesn't Exist
Oct 22 14:36:25 indls0040 avahi-daemon[6145]: Withdrawing address record for 10.48.64.82 on eth6.
Oct 22 14:36:35 indls0040 multipathd: dm-10: umount map (uevent)
Oct 22 14:36:35 indls0040 clurgmgrd[7131]: <notice> Service service:hell is recovering
Oct 22 14:40:12 indls0040 kernel: opcmona[12015]: segfault at 0000001000000008 rip 000000000044e3ee rsp 000000004207f9a0 error 6
Spell out your words. And did you read the messages?? Specifically:
Quote:
Originally Posted by JATA01
Oct 22 14:35:51 indls0040 kernel: EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
Oct 22 14:36:25 indls0040 clurgmgrd: [7131]: <err> Checking Existence Of File /var/run/cluster/mysql/mysql:mysql.pid [mysql:mysql] > Failed - File Doesn't Exist
It's telling you that the drive needs to be checked/fsck'ed, and that the MySQL pid file can't be found...probably because it can't be created and/or that drive can't be mounted. And have you called RedHat support, since you're paying for it with your RHEL subscription?
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
mysqld node of mysql cluster system not connecting to management node coal-fire-ice Linux - Server 1 07-27-2015 08:33 AM
Two node cluster, start CMAN fence the other node DevinXu Linux - Enterprise 1 06-21-2010 12:37 PM
[SOLVED] Rocks Cluster node asking for rolls upon node install Shouraku ROCK 1 04-15-2010 10:28 AM
How to mount NFS/local partitions on RedHat cluster depending on node type? Myroslav Linux - Enterprise 0 01-05-2010 12:12 PM
unable to create 2nd node in Redhat 5 cluster fosiul Linux - Server 1 09-20-2009 11:25 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 06:02 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration