LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 09-16-2009, 04:10 AM   #1
dmrossi
LQ Newbie
 
Registered: Sep 2009
Posts: 19

Rep: Reputation: 0
Apache and SSH seem to restart intermittently


I'm hosting my own site and I recently switched from Windows Server to Ubuntu as my hosting OS. I signed up for a free account from pingdom.com to monitor my site uptime. As I soon noticed, my server seemed to be going offline quite frequently and for varying amounts of time. (i.e. down for 12 minutes, up for 30 minutes, down for 42 minutes, ect.) When I received notice from pingdom that my website was offline, I attempted to connect to my site from a remote location and it was indeed, unreachable. Not only was my server not responding to remote connections on port 80, but it also failed to respond to my remote SSH attempts. However, when my site was up according to pingdom, I was able to connect via both ports from a remote location.

I've been making a point of specifying remote location for a reason. It was just today that I noticed that if my site was down remotely, accessing it locally "woke it up." After I accessed it locally, I was then able to access it remotely, via ports 80 and 22. Of course, after a while, my remote connections timed out again, as the services on my server seemed to have gone asleep again. When the services are non-responsive from remote locations, the server itself seems fine and responsive.

It's also important to mention that my router, ISP, and DNS servers are all not issues since I was able to host my site using Windows Server without this issue.

Any help would be greatly appreciated. I apologize in advance if I have omitted some very obvious and vital information as I am new to Linux. I also have searched Google and these forums, however I find it hard to phrase my problem in searchable terms. Thank you.
 
Old 09-16-2009, 10:45 AM   #2
Meson
Member
 
Registered: Oct 2007
Distribution: Arch x86_64
Posts: 606

Rep: Reputation: 67
It sounds like too big of a coincidence that httpd and sshd are restarting randomaly, at the exact same time. I think you should be trying to diagnose some sort of networking issue. You should check out your log files (like daemon.log) to convince yourself that these services are not actually going down.
 
Old 09-16-2009, 11:58 AM   #3
dmrossi
LQ Newbie
 
Registered: Sep 2009
Posts: 19

Original Poster
Rep: Reputation: 0
Daemon.log:
Code:
Sep 16 06:12:58 Server dhclient: DHCPREQUEST of 192.168.1.104 on eth0 to 192.168.1.1 port 67
Sep 16 06:12:58 Server dhclient: DHCPACK of 192.168.1.104 from 192.168.1.1
Sep 16 06:12:58 Server dhclient: bound to 192.168.1.104 -- renewal in 35579 seconds.
Networking issue? I had the same setup with Windows Server. Maybe I'm not sure what you mean by this.
 
Old 09-16-2009, 08:38 PM   #4
chrism01
LQ Guru
 
Registered: Aug 2004
Location: Sydney
Distribution: Centos 6.9, Centos 7.3
Posts: 17,417

Rep: Reputation: 2397Reputation: 2397Reputation: 2397Reputation: 2397Reputation: 2397Reputation: 2397Reputation: 2397Reputation: 2397Reputation: 2397Reputation: 2397Reputation: 2397
Try /var/log/messages, /var/log/secure
 
Old 09-16-2009, 11:54 PM   #5
Wim Sturkenboom
Senior Member
 
Registered: Jan 2005
Location: Roodepoort, South Africa
Distribution: Slackware 10.1/10.2/12, Ubuntu 12.04, Crunchbang Statler
Posts: 3,786

Rep: Reputation: 282Reputation: 282Reputation: 282
When apache restarts, it will write a message in a log file; on my Slackware 10.1 this is var/log/apache/error_log. So you can find there if it's actually restarted.
 
Old 09-17-2009, 01:07 AM   #6
dmrossi
LQ Newbie
 
Registered: Sep 2009
Posts: 19

Original Poster
Rep: Reputation: 0
Messages (/var/log/messages):
Code:
Sep 14 12:32:42 Server -- MARK --
Sep 14 12:52:42 Server -- MARK --
Sep 14 13:12:42 Server -- MARK --
Sep 14 13:32:42 Server -- MARK --
Sep 14 13:52:42 Server -- MARK --
Sep 14 14:12:42 Server -- MARK --
Sep 14 14:32:42 Server -- MARK --
Sep 14 14:52:42 Server -- MARK --
Sep 14 15:12:42 Server -- MARK --
I do not have a secure log.

Apache Log:
Code:
[Sun Sep 13 07:59:23 2009] [notice] Apache/2.2.11 (Ubuntu) PHP/5.2.6-3ubuntu4.2 with Suhosin-Patch configured -- resuming normal operations
[Sun Sep 13 10:38:29 2009] [error] [client 205.209.161.42] Invalid URI in request GET HTTP/1.1 HTTP/1.1
[Tue Sep 15 00:23:40 2009] [error] [client 212.241.213.73] client denied by server configuration: /var/www/.htpasswd
[Tue Sep 15 00:26:55 2009] [error] [client 212.241.213.73] client denied by server configuration: /var/www/.htpasswd
[Tue Sep 15 21:30:57 2009] [error] [client 77.92.68.146] Invalid URI in request GET HTTP/1.1 HTTP/1.1
[Wed Sep 16 10:34:00 2009] [notice] caught SIGTERM, shutting down
[Wed Sep 16 10:34:45 2009] [notice] Apache/2.2.11 (Ubuntu) PHP/5.2.6-3ubuntu4.2 with Suhosin-Patch configured -- resuming normal operations
 
Old 09-17-2009, 02:09 AM   #7
Wim Sturkenboom
Senior Member
 
Registered: Jan 2005
Location: Roodepoort, South Africa
Distribution: Slackware 10.1/10.2/12, Ubuntu 12.04, Crunchbang Statler
Posts: 3,786

Rep: Reputation: 282Reputation: 282Reputation: 282
Below my simulation where I manually stop apache.
Code:
[Thu Sep 17 08:06:03 2009] [notice] Apache/1.3.33 (Unix) mod_ssl/2.8.22 OpenSSL/0.9.7d PHP/4.3.10 configured -- resuming normal operations
[Thu Sep 17 08:06:03 2009] [notice] Accept mutex: sysvsem (Default: sysvsem)
[Thu Sep 17 08:06:27 2009] [notice] caught SIGTERM, shutting down
[Thu Sep 17 08:06:36 2009] [notice] Apache/1.3.33 (Unix) mod_ssl/2.8.22 OpenSSL/0.9.7d PHP/4.3.10 configured -- resuming normal operations
[Thu Sep 17 08:06:36 2009] [notice] Accept mutex: sysvsem (Default: sysvsem)
You have the same message in your apache log. Something/somebody is restarting your apache.

Last edited by Wim Sturkenboom; 09-17-2009 at 02:27 AM.
 
Old 09-17-2009, 02:41 AM   #8
dmrossi
LQ Newbie
 
Registered: Sep 2009
Posts: 19

Original Poster
Rep: Reputation: 0
But doesn't the line after it indicate that it is going back up again after 9 seconds in your case, 45 in mine?

Apache Log:
Code:
[Sun Sep 13 07:59:23 2009] [notice] Apache/2.2.11 (Ubuntu) PHP/5.2.6-3ubuntu4.2 with Suhosin-Patch configured -- resuming normal operations
[Sun Sep 13 10:38:29 2009] [error] [client 205.209.161.42] Invalid URI in request GET HTTP/1.1 HTTP/1.1
[Tue Sep 15 00:23:40 2009] [error] [client 212.241.213.73] client denied by server configuration: /var/www/.htpasswd
[Tue Sep 15 00:26:55 2009] [error] [client 212.241.213.73] client denied by server configuration: /var/www/.htpasswd
[Tue Sep 15 21:30:57 2009] [error] [client 77.92.68.146] Invalid URI in request GET HTTP/1.1 HTTP/1.1
[Wed Sep 16 10:34:00 2009] [notice] caught SIGTERM, shutting down
[Wed Sep 16 10:34:45 2009] [notice] Apache/2.2.11 (Ubuntu) PHP/5.2.6-3ubuntu4.2 with Suhosin-Patch configured -- resuming normal operations
SSH and Apache are definitely down for more than a minute at a time. Or does this next line not necessarily mean it is starting back up 45 seconds later?
 
Old 09-17-2009, 03:13 AM   #9
Wim Sturkenboom
Senior Member
 
Registered: Jan 2005
Location: Roodepoort, South Africa
Distribution: Slackware 10.1/10.2/12, Ubuntu 12.04, Crunchbang Statler
Posts: 3,786

Rep: Reputation: 282Reputation: 282Reputation: 282
Yep, it indicates that. But check the full log and see if it's always like that.

The only valid reason for a sigterm that I can think of is if you use logrotate.
 
Old 09-17-2009, 03:26 AM   #10
dmrossi
LQ Newbie
 
Registered: Sep 2009
Posts: 19

Original Poster
Rep: Reputation: 0
That was a full log, but here's another log in the same directory:
Code:
[Mon Sep 07 17:30:39 2009] [notice] Apache/2.2.11 (Ubuntu) PHP/5.2.6-3ubuntu4.2 with Suhosin-Patch configured -- resuming normal operations
[Mon Sep 07 17:43:13 2009] [notice] caught SIGTERM, shutting down
[Mon Sep 07 17:43:14 2009] [notice] Apache/2.2.11 (Ubuntu) PHP/5.2.6-3ubuntu4.2 with Suhosin-Patch configured -- resuming normal operations
[Mon Sep 07 17:46:13 2009] [notice] caught SIGTERM, shutting down
[Mon Sep 07 17:46:13 2009] [notice] Apache/2.2.11 (Ubuntu) PHP/5.2.6-3ubuntu4.2 with Suhosin-Patch configured -- resuming normal operations
[Tue Sep 08 11:08:00 2009] [notice] caught SIGTERM, shutting down
[Tue Sep 08 11:08:01 2009] [notice] Apache/2.2.11 (Ubuntu) PHP/5.2.6-3ubuntu4.2 with Suhosin-Patch configured -- resuming normal operations
I am curious as to the significance of being able to "wake up" SSH and Apache on local connections. It seems that I am always able to access my site from my local network, since if it is down, accessing it from my local network "wakes up" the services. Is there some setting that would cause these services to go to sleep after a certain amount of time, say 5 minutes, but then wake up on local (but not remote) connections?
 
Old 09-17-2009, 04:58 AM   #11
Wim Sturkenboom
Senior Member
 
Registered: Jan 2005
Location: Roodepoort, South Africa
Distribution: Slackware 10.1/10.2/12, Ubuntu 12.04, Crunchbang Statler
Posts: 3,786

Rep: Reputation: 282Reputation: 282Reputation: 282
To be honest, I'm at a loss from an apache perspective. The random restarts are very funny. And I can not think of something that will cause a wakeup.
 
Old 09-17-2009, 07:10 AM   #12
r3sistance
Senior Member
 
Registered: Mar 2004
Location: UK
Distribution: CentOS 6/7
Posts: 1,375

Rep: Reputation: 217Reputation: 217Reputation: 217
When your server goes down, after it comes back up what is the uptime like? Could it be possible the entire server may be going down?

Check if their are any alternative /var/log/messages logs like perhaps messages.1 or messages.2 preferrably checking the main log file itself right after a "down event". If you are just tailing the results to 10 try doing greps for the following three things (seperately) httpd, sshd and init
 
Old 09-17-2009, 03:54 PM   #13
dmrossi
LQ Newbie
 
Registered: Sep 2009
Posts: 19

Original Poster
Rep: Reputation: 0
The uptime is brief, I believe around 5 minutes. In the past I've been SSH'd into my server and after about 5 minutes the prompt just freezes up. Ctrl+C doesn't unfreeze it, and the only thing that seems to unfreeze the terminal window is quitting the terminal application and reopening it. Upon reopening and attempting to SSH back into my server, I find that the host is now unreachable. So the server has no problem letting it's services "go to sleep" even if I'm accessing them.

I'm not exactly sure what you mean by the whole server going down. During these outages, the screen on my server is blank, but that is simply because I have the screen set to go off after 10 minutes of inactivity, but other than that, it is completely responsive. Local connections are able to get through, which temporarily enable remote connections, so I don't think the entire server is going down.

I performed grep httpd, grep sshd, and grep init, all of which produced nothing. I let the commands run for a few minutes, and then canceled them after I saw nothing happen, although I'm not sure what was supposed to happen, so my apologies if I was supposed to let the commands run longer.

The other message logs contain nothing but:
Code:
Server -- MARK --
 
Old 09-18-2009, 09:05 AM   #14
r3sistance
Senior Member
 
Registered: Mar 2004
Location: UK
Distribution: CentOS 6/7
Posts: 1,375

Rep: Reputation: 217Reputation: 217Reputation: 217
I meant the uptime from the command uptime

What run level are you running the server in? the screen should go blank after a while in the normal multiuser run level but I suspect your running your server in a multiuser with x run level what is less ideal from servers.
 
Old 09-18-2009, 12:23 PM   #15
dmrossi
LQ Newbie
 
Registered: Sep 2009
Posts: 19

Original Poster
Rep: Reputation: 0
I hope this is correct:
Code:
who -r
         run-level 2  2009-09-16 10:34                   last=
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Restart X Server over SSH? skibud2 Linux - General 2 09-15-2008 01:31 AM
SSH Refuses Connections Intermittently Noido Linux - Software 6 09-12-2006 01:59 PM
How to restart dhcpd on another server using SSH? hueofwind Linux - Newbie 17 11-23-2005 07:07 AM
Can't SSH until restart service Da Puff Mandriva 4 09-14-2005 09:51 PM
restart linux from SSH connection? deWin Linux - Newbie 6 09-28-2004 11:22 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 06:28 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration