server hangs at starting domino services during booting up.
 

Hi guys,

I am very novice to Linux. I joined a company as an IT staff 2 months plus back. I now encounters a problem that the booting up hangs at the time when it is starting domino services. I have no clue where to look at and duno where to start checking.

A little description of the server. :
It's a lotus notes domino server for employees webmail service. -> Now it is down.
it's an external dns server: recently high volumes of query cache denied surfaces.
it's also our proxy server.

The only way to get it up and running is to turn off domino service. The system is running still with high volumes of queries I last checked.

Althrough it can boot up now and DNS & proxy are running, I couldn't access the system anymore. It will hang when I attempt to log in from the command prompt. Below is an illustration:

iasaix login: root -> I attempt to log in using root user
password: xxxxxxxx -> I keyed in my password
_ -> The cursor comes down and just keeps blinking and nothing happens.

Remote access is not possible as it has sshd disabled by default.
I would really appreciate if anyone can advise me. Our employees cannot access their webmail now, which is a major issue. Any help is great. Thanks.

Hi guys,

I got help and had discovered that due to audit in the system:

Feb 10 13:16:20 iasaix audbin[3792]: threshold 20.00 exceeded for filesystem /var/log/audit.d/. - free blocks down to 17.07%
Feb 10 13:16:20 iasaix auditd[3790]: Notify command /usr/sbin/audbin -S /var/log/audit.d/save.%u -C -T 20% exited with status 1

/var becomes less than the 20% threshold, the system goes to suspend mode.
checking the chkconfig / df output

$ grep var df
/dev/sda3 10080520 8270560 1297892 87% /var

I believe the /var is quickly approching to 100% as the system gets tons of "query (cache) denied" from named(DNS).

By disabling the audit service, the system seems to functioning properly now.

Now I have another question if there is anything I should take note of after disabling the audit service? Any advise is appreciated. Thanks. :-)

Regards,
Cher Kian