I've screwed up my Lamp server

southpointingchariot · 09-03-2012, 09:25 PM

Quote:

Originally Posted by sag47

Also, forgot to mention but might want to try,

Code:

chown -R mysql\: /var/lib/mysql

No luck. Running "chown -R mysql\: /var/lib/mysql" returns nothing, and running "sudo service mysql start" afterwards returned "start: Job failed to start". Time for the nuclear option...

southpointingchariot · 09-03-2012, 09:28 PM

Quote:

Originally Posted by sag47

The only thing I can think of left is maybe removing the /var/lib/mysql directory entirely.

Code:

#double check the path!  And double check it's not important!
sudo rm -rf /var/lib/mysql

Then try to start the mysql server again. Not unless you can give us more log information from dmesg or other mysql related log files.

The directory has been totally removed (I checked var/lib). I still get "start: Job failed to start". Should I run "sudo apt-get install mysql" again?

sag47 · 09-03-2012, 09:30 PM

Wait before you do. I think I found some log files for us to investigate.

Code:

root@farcry:/var/log# cd /var/log/
root@farcry:/var/log# grep -ri mysql * | cut -d: -f1 | sort -u
dmesg
dmesg.0
dpkg.log.1
kern.log
syslog
upstart/mysql.log

Investigate /var/log/upstart/mysql.log. What does it say at the bottom?

Alternatively you could show me the log by doing the following,

Code:

sudo apt-get install pastebinit
pastebinit /var/log/upstart/mysql.log

southpointingchariot · 09-03-2012, 09:32 PM

Quote:

Originally Posted by sag47

Wait before you do. I think I found some log files for us to investigate.

Code:

root@farcry:/var/log# cd /var/log/
root@farcry:/var/log# grep -ri mysql * | cut -d: -f1 | sort -u
dmesg
dmesg.0
dpkg.log.1
kern.log
syslog
upstart/mysql.log

Investigate /var/log/upstart/mysql.log. What does it say at the bottom?

Alternatively you could show me the log by doing the following,

Code:

sudo apt-get install pastebinit
pastebinit /var/log/upstart/mysql.log

Have at it! http://paste.ubuntu.com/1184884/

sag47 · 09-03-2012, 09:38 PM

Do you have a /etc/my.cnf file? By default there is none but I'm wondering if you created it as part of some tutorial. If so then pastebinit.

southpointingchariot · 09-03-2012, 09:41 PM

Quote:

Originally Posted by sag47

Do you have a /etc/my.cnf file? By default there is none but I'm wondering if you created it as part of some tutorial. If so then pastebinit.

I don't have that, but I do have a /etc/mysql/my.cnf file. http://paste.ubuntu.com/1184895/

sag47 · 09-03-2012, 09:43 PM

Run this command, what happens?

Code:

ls /var/run/mysqld/mysqld.sock

southpointingchariot · 09-03-2012, 09:44 PM

Quote:

Originally Posted by sag47

Run this command, what happens?

Code:

ls /var/run/mysqld/mysqld.sock

ls: cannot access /var/run/mysqld/mysqld.sock: No such file or directory

/var/run/mysqld is empty.

sag47 · 09-03-2012, 09:49 PM

Okay so mysql service is definitely not running.

Can you pastebinit all of the log files you find within /var/log/? Here's a giant one liner to do it.

Code:

grep -ri mysql /var/log/* | cut -d: -f1 | sort -u | while read filename;do pastebinit $filename;done

SAM

southpointingchariot · 09-03-2012, 09:56 PM

Quote:

Originally Posted by sag47

Okay so mysql service is definitely not running.

Can you pastebinit all of the log files you find within /var/log/? Here's a giant one liner to do it.

Code:

grep -ri mysql /var/log/* | cut -d: -f1 | sort -u | while read filename;do pastebinit $filename;done

SAM

Just how I like 'em:

http://paste.ubuntu.com/1184925/
http://paste.ubuntu.com/1184926/
http://paste.ubuntu.com/1184927/
http://paste.ubuntu.com/1184928/
http://paste.ubuntu.com/1184929/
http://paste.ubuntu.com/1184930/
http://paste.ubuntu.com/1184933/
http://paste.ubuntu.com/1184935/
http://paste.ubuntu.com/1184940/
http://paste.ubuntu.com/1184941/
http://paste.ubuntu.com/1184942/
http://paste.ubuntu.com/1184944/
http://paste.ubuntu.com/1184945/

sag47 · 09-03-2012, 09:57 PM

Quote:

Originally Posted by southpointingchariot

Just how I like 'em:

http://paste.ubuntu.com/1184925/
http://paste.ubuntu.com/1184926/
http://paste.ubuntu.com/1184927/
http://paste.ubuntu.com/1184928/
http://paste.ubuntu.com/1184929/
http://paste.ubuntu.com/1184930/
http://paste.ubuntu.com/1184933/
http://paste.ubuntu.com/1184935/
http://paste.ubuntu.com/1184940/
http://paste.ubuntu.com/1184941/
http://paste.ubuntu.com/1184942/
http://paste.ubuntu.com/1184944/
http://paste.ubuntu.com/1184945/

Even better, can you associate names with them. Here's another one liner but this time it lets me know which log is which. In the mean time I'll search through what you provided.

Code:

grep -ri mysql /var/log/* | cut -d: -f1 | sort -u | while read filename;do echo -n "${filename}: "; pastebinit $filename;done

southpointingchariot · 09-03-2012, 10:03 PM

Quote:

Originally Posted by sag47

Even better, can you associate names with them. Here's another one liner but this time it lets me know which log is which. In the mean time I'll search through what you provided.

Code:

grep -ri mysql /var/log/* | cut -d: -f1 | sort -u | while read filename;do echo -n "${filename}: "; pastebinit $filename;done

sag47 · 09-03-2012, 10:05 PM

I think I found something in this log file: http://paste.ubuntu.com/1184935/ this is likely your kern.log

I google searched for "mysql respawning too fast, stopped" and found an article.
http://askubuntu.com/questions/12726...o-fast-stopped

It's not clear that is your problem as I didn't find those values specified within your previously pasted /etc/mysql/my.cnf. It may also be something specified in /etc/mysql/conf.d/. I'll keep looking to see if I can find something.

Do you have files within /etc/mysql/conf.d/?

southpointingchariot · 09-03-2012, 10:07 PM

Quote:

Originally Posted by sag47

I think I found something in this log file: http://paste.ubuntu.com/1184935/ this is likely your kern.log

I google searched for "mysql respawning too fast, stopped" and found an article.
http://askubuntu.com/questions/12726...o-fast-stopped

It's not clear that is your problem as I didn't find those values specified within your previously pasted /etc/mysql/my.cnf. It may also be something specified in /etc/mysql/conf.d/. I'll keep looking to see if I can find something.

Do you have files within /etc/mysql/conf.d/?

I have a "mysqld_safe_syslog.cnf": http://paste.ubuntu.com/1184981/

sag47 · 09-03-2012, 10:16 PM

With all the logs I look at it appears the root of the problem is with apparmor terminating it with "mysql respawning too fast" errors. I think we should tackle the problem from that angle.

Try some of the solutions outlined in this article, except everywhere you see "/media/asimov/mysql" just do "/var/lib/mysql" in your case.
http://languor.us/mysql-respawning-t...nated-status-1

It's late in my timezone so I'm going to go to bed. But I'll be up again tomorrow and continue looking into this.

SAM