Originally Posted by phpdba
You could try looking at any of the other logs in that directory to see what was running and for how long. As an example, you can look at the httpd logs to see if they were running during that time or were they seized up as well. I am wondering if a process went out of control and locked up the server (similar to what I have seen on some Oracle boxes) to the point of preventing the logs from writing. What puzzles me is your statement in regards to openvpn and squid. They are not in your init.d scripts or have you done a chkconfig --list squid to see what runlevels they run? Is it possible some other process starts them as a dependent process so they won't show up in the scripts (assuming they aren't there). The other place I would check is the rc.d directories just to make sure. My thinking is that if we can find the logs to the last process running, it is probably the process that caused the problem. This is no guarantee of what it might be, but it should help.
[root ~]# chkconfig --list squid
squid 0 off 1 off 2 off 3 on 4 on 5 on 6 off
[root ~]# chkconfig --list openvpn
openvpn 0 off 1 off 2 off 3 on 4 on 5 on 6 off
I found both squid and openvpn in the rc.d/init/d folder so I'm guessing that they must start up on server reboot.
Does the last line in the fstab seem ok? squid would not be able to start without that so I guess it must have.
LABEL=/ / ext3 defaults 1 1
LABEL=/var /var ext3 defaults 1 2
LABEL=/boot /boot ext3 defaults 1 2
tmpfs /dev/shm tmpfs defaults 0 0
devpts /dev/pts devpts gid=5,mode=620 0 0
sysfs /sys sysfs defaults 0 0
proc /proc proc defaults 0 0
LABEL=SWAP-sda6 swap swap defaults 0 0
/dev/sda2 /var/spool/squid reiserfs defaults,notail,noatime 1 2
I don't have the webserver running on the server most of the time.
These are all the startup programs, I could check each individual log?