LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 05-13-2011, 11:41 AM   #1
kitek
Member
 
Registered: Apr 2005
Posts: 252

Rep: Reputation: 15
Centos 5.5 box troubleshooting - Needing help


The server is booting up properly and the system is running. When browsing web sites on the sever and they seem to run fine. But when you make requests to it, it seems to take a long time to process stuff. Such as large mysql request. Even to the point it freezes. It seems that if you make a request of some sort it just over loads. I have checked the logs and the most I can get from it that one of my wiki sites that seem to be getting nailed with spam bots trying to getting which is one of the databaes that where repaired could be slowing it down A LOT. Now I did find a couple databases that where marked as crashed and they have been repaired. I am not really sure what is causes the errors since the HD space is fine, ram is fine, internet connection is fine...So I am not familiar with diagnoses linux as much as I am with a windows pc. I am not real shell friendly. I am not good with the basic troubleshooting commands to try and identify the source of the problem to correct it. Could anyone point me the way...

Thanks in advance and I apologize for being a ra-tard on these. I should know this stuff more than I do running a server like this. It was created in 2006 and has been problem free since. Another thing, mass emailing isnt working either. It may be mysqld related. Sorry for the fragments and such. It also seems the SMTP isn't working properly as well suddenly.

Another error I been seeing

PHP Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 16 bytesPHP Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 16 bytes some times I see this as a 32 or 64 bytes as well.

FTP Connection
It is also slow when making ftp connects. It is extremly slow but they finally do complete. It can be just a simple connection to display content. Slow.

Last edited by kitek; 05-13-2011 at 12:21 PM. Reason: Adding another error
 
Old 05-14-2011, 03:51 AM   #2
EricTRA
LQ Guru
 
Registered: May 2009
Location: Gibraltar, Gibraltar
Distribution: Fedora 20 with Awesome WM
Posts: 6,805
Blog Entries: 1

Rep: Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297
Hello,

Not much to go on here. You need to provide more information, snippets from log files indicating your problem, what software are you running and how do you have it configured, stuff like that. Did you for example just set up an Apache webserver with a MySQL backend or did you do some extra configuring, like putting your websites in a chroot environment so that they cannot bring your system to its knees that drastically? Troubleshooting needs to be done step by step, looking at log files, analyzing information and so on. So provide us with as much information as you can. Too bad you're not 'shell friendly' because you'll need to get down in there and tell us what's needed to help you solve the problem.

Kind regards,

Eric
 
Old 05-14-2011, 07:36 AM   #3
kitek
Member
 
Registered: Apr 2005
Posts: 252

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by EricTRA View Post
Hello,

Not much to go on here. You need to provide more information, snippets from log files indicating your problem, what software are you running and how do you have it configured, stuff like that. Did you for example just set up an Apache webserver with a MySQL backend or did you do some extra configuring, like putting your websites in a chroot environment so that they cannot bring your system to its knees that drastically? Troubleshooting needs to be done step by step, looking at log files, analyzing information and so on. So provide us with as much information as you can. Too bad you're not 'shell friendly' because you'll need to get down in there and tell us what's needed to help you solve the problem.

Kind regards,

Eric
That's what's weird the logs don't seem to be showing much. When I say not shell friendly, I mean I just don't know a lot of the commands. Much more intense than DOS was. In old dos we had utilities like chkdks and such. I wonder if some of these standard tools on linux might fix it up. My log files just aren't abnormal. I think that is more what I was looking for was commands such as those to to what happens and post the results. I just have been using web mine mainly to get around on the box smoothly. Or at least it has worked for me. It acts like I just need to clean the registry, defrag, it, check for disk errors and stuff like you would on a windows machine type stuff.
 
Old 05-14-2011, 08:38 AM   #4
EricTRA
LQ Guru
 
Registered: May 2009
Location: Gibraltar, Gibraltar
Distribution: Fedora 20 with Awesome WM
Posts: 6,805
Blog Entries: 1

Rep: Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297
Hi,

You cannot compare Linux to Windows, they're too different. Linux doesn't have a registry and doesn't suffer from fragmentation the way Windows does. If you want to check your file systems for errors you could use fsck, have a look at the man page:
Code:
fsck
But you still fail to describe in detail what is going wrong in your opinion so you can imagine it's pretty hard for us to try to help you. What have you installed and how did you configure it? Where is your server failing?

Kind regards,

Eric

Last edited by EricTRA; 05-14-2011 at 09:00 AM.
 
Old 05-14-2011, 09:13 AM   #5
kitek
Member
 
Registered: Apr 2005
Posts: 252

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by EricTRA View Post
Hi,

You cannot compare Linux to Windows, they're too different. Linux doesn't have a registry and doesn't suffer from fragmentation the way Windows does. If you want to check your file systems for errors you could use fsck, have a look at the man page:
Code:
fsck
But you still fail to describe in detail what is going wrong in your opinion so you can imagine it's pretty hard for us to try to help you. What have you installed and how did you configure it? Where is your server failing?

Kind regards,

Eric
The main problems are just delays in response. Like FTP file transfers over the same network of the internet. You tell it to upload or download something, it sites for like 1-2 mins before sending or sometimes even fails on files and you have to re-Q these files to wait another couple of minutes to get them to upload. For example. I went to a very small site on the server. I was going to send a mass email. There is 13 users. After 10 mins+ it finally acted like it sent the email. But nothing really did happen. The logs don't suggest there is a problem. Browsing any of the sites on the server are very smooth. when those files do start to upload they are very quick. I have monitored the processor and ram during these times, they are fine. I can't seem to find something that is delaying things to happen. That's why I really don't have much to share. If there is a particular log you want to see I will get it for you to examine. Now I have also noticed when using service mysqld restart is a lot slower to restart than unusual. But by doing that, it doesn't seem to increase in performance in ftp while sql is turned off. I am kinda lost as you are on know what to show since I can't even get it down to what service or what not would be causing these kind of delays. The Apache log is full of tons of PHP Notices but there not unusual than normal. I am not completely dumb with it but Unless I yank every log and post them, I am not sure what any of them would tell you. I have seen them myself and there isn't anything alarming. Unless there is a log file I don't know about. Slow response to somethings is all I know to explain.

Hope that helps or maybe you can help me show you something as to try and identify what's going on.

Btw, can fsck be ran while the drive is mounted? It says it could damage the file system. It is the only drive in the machine.
 
Old 05-14-2011, 10:34 AM   #6
kitek
Member
 
Registered: Apr 2005
Posts: 252

Original Poster
Rep: Reputation: 15
Errors/Delays These are the things going on right now. Using webmin to administrate the server.

SMTP has backed up mail not sending. So I told it to flush the Q. Here are the results.

Been 10 mins.
Flush Queue

Forcing the attempted delivery of all messages with the command /usr/sbin/sendmail -v -q -C/etc/mail/sendmail.cf ..

Running /var/spool/mqueue/p4DFx0Bx013794 (sequence 1 of 25)
p4DFx0Bx013794: locked

Running /var/spool/mqueue/p4DFtCqf013521 (sequence 2 of 25)
<address@hotmail.com>... Connecting to mx2.hotmail.com. via esmtp...

vsftp

I am trying to upload files to the servers web directory. 1-2 mins to start. from time to time files are being placed in the failed transfer under FZ.

Status: Connecting to xxx.xxx.xxx.xxx:21...
Status: Connection established, waiting for welcome message...
Response: 220 (vsFTPd 2.0.5)
Command: USER username
Response: 331 Please specify the password.
Command: PASS *****
Error: Connection timed out
Error: Could not connect to server
Status: Delaying connection for 5 seconds due to previously failed connection attempt...
Error: Connection timed out
Error: Could not connect to server
Status: Delaying connection for 5 seconds due to previously failed connection attempt...
Status: Delaying connection for 1 second due to previously failed connection attempt...
Status: Resolving address of ftp.domain.net
Status: Connecting to xxx.xxx.xxx.xxx:21...
Status: Connection established, waiting for welcome message...
Response: 220 (vsFTPd 2.0.5)
Command: USER username
Response: 331 Please specify the password.
Command: PASS ******
Status: Resolving address of ftp.domain.net
Status: Connecting to xxx.xxx.xxx.xxx:21...

Eventually it will go through
Can we start there?

Last edited by kitek; 05-14-2011 at 10:37 AM.
 
Old 05-14-2011, 10:44 AM   #7
EricTRA
LQ Guru
 
Registered: May 2009
Location: Gibraltar, Gibraltar
Distribution: Fedora 20 with Awesome WM
Posts: 6,805
Blog Entries: 1

Rep: Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297
Hi,

I think that's a good place to start yes. Is the server in the same LAN as you are with your computer or do you connect remotely? One question, do you have your server's IP hostname combination in your /etc/hosts file? If not, include it to avoid DNS resolve issues. Next log on to your server and open a tail -f on the ftp log file(s) and then try to connect again, watching the log files for anything specific.

Kind regards,

Eric
 
Old 05-14-2011, 11:11 AM   #8
kitek
Member
 
Registered: Apr 2005
Posts: 252

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by EricTRA View Post
Hi,

I think that's a good place to start yes. Is the server in the same LAN as you are with your computer or do you connect remotely? One question, do you have your server's IP hostname combination in your /etc/hosts file? If not, include it to avoid DNS resolve issues. Next log on to your server and open a tail -f on the ftp log file(s) and then try to connect again, watching the log files for anything specific.

Kind regards,

Eric
The server is actually on the same gateway as I am. I have 16 Public IPs. The Internet gateway goes directly to the web server with a static IP. Then another one of those public IP's just connects to the WAN port of a simple Linksys router from the same gateway then that supplies the windows network that I am on. So it only has to make a single jump to it.

/etc/hosts
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
xxx.xxx.xxx.xxx host1.domain.com host1.domain.com

that is exactly what is says with the exception of the correct public IP and domain name. I don't know where it is getting the localhost6 from however.I have the log file. With the -f what command goes in front of it? I am assuming that will show what the file is logging live?
 
Old 05-14-2011, 11:22 AM   #9
EricTRA
LQ Guru
 
Registered: May 2009
Location: Gibraltar, Gibraltar
Distribution: Fedora 20 with Awesome WM
Posts: 6,805
Blog Entries: 1

Rep: Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297
Hi,

The command I referred to is:
Code:
tail -f /var/log/yourlogfile
that keeps the log file open and you can view everything that gets added to it when you're trying to connect from your client or as you stated 'live'.

I would disable IPv6 for the time being. To do so edit /etc/sysconfig/network and set "NETWORKING_IPV6" to "no" (that's for RHEL 5.4 and older, not sure if it's the same on CentOS) or for 5.4 and later, replace in /etc/modprobe.conf
Code:
alias ipv6 off
with
Code:
options ipv6 disable=1
To activate after the changes, restart networking if you've changed the /etc/sysconfig/network file or remove the ipv6 module with rmmod to avoid rebooting.

Kind regards,

Eric
 
Old 05-14-2011, 11:38 AM   #10
kitek
Member
 
Registered: Apr 2005
Posts: 252

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by EricTRA View Post
Hi,

The command I referred to is:
Code:
tail -f /var/log/yourlogfile
that keeps the log file open and you can view everything that gets added to it when you're trying to connect from your client or as you stated 'live'.

I would disable IPv6 for the time being. To do so edit /etc/sysconfig/network and set "NETWORKING_IPV6" to "no" (that's for RHEL 5.4 and older, not sure if it's the same on CentOS) or for 5.4 and later, replace in /etc/modprobe.conf
Code:
alias ipv6 off
with
Code:
options ipv6 disable=1
To activate after the changes, restart networking if you've changed the /etc/sysconfig/network file or remove the ipv6 module with rmmod to avoid rebooting.

Kind regards,

Eric
I have disabled IPv6 and restarted networking. there were a few xferlog's there was xferlog xferlog.1 - xferlog.4 They all had logs in them so I renamed them to .old files and created a blank xferlog. I used tail -f xferlog and when I connect to the ftp server nothing appears in the log at all. Just a very long delay to make the connection?
 
Old 05-14-2011, 11:59 AM   #11
EricTRA
LQ Guru
 
Registered: May 2009
Location: Gibraltar, Gibraltar
Distribution: Fedora 20 with Awesome WM
Posts: 6,805
Blog Entries: 1

Rep: Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297Reputation: 1297
Hi,

OK, that's one small step, IPv6 had nothing to do with it. Can you execute a traceroute to your FTP server and a 10 count ping to see if the network connections are good:
Code:
ping -c10 yourftpserver
traceroute yourftpserver
and post the output.

Kind regards,

Eric
 
Old 05-14-2011, 12:06 PM   #12
kitek
Member
 
Registered: Apr 2005
Posts: 252

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by EricTRA View Post
Hi,

OK, that's one small step, IPv6 had nothing to do with it. Can you execute a traceroute to your FTP server and a 10 count ping to see if the network connections are good:
Code:
ping -c10 yourftpserver
traceroute yourftpserver
and post the output.

Kind regards,

Eric
From my windows machine in which I a, connecting from:
ping -t host1.domain.com

Pinging host1.domain.com [xxx.xxx.xxx.xxx] with 32 bytes of data:
Reply from xxx.xxx.xxx.xxx: bytes=32 time=1ms TTL=63
Reply from xxx.xxx.xxx.xxx: bytes=32 time=1ms TTL=63
Reply from xxx.xxx.xxx.xxx: bytes=32 time=1ms TTL=63
Reply from xxx.xxx.xxx.xxx: bytes=32 time=1ms TTL=63
Reply from xxx.xxx.xxx.xxx: bytes=32 time<1ms TTL=63
Reply from xxx.xxx.xxx.xxx: bytes=32 time=1ms TTL=63
Reply from xxx.xxx.xxx.xxx: bytes=32 time=1ms TTL=63
Reply from xxx.xxx.xxx.xxx: bytes=32 time=1ms TTL=63
Reply from xxx.xxx.xxx.xxx: bytes=32 time<1ms TTL=63
Reply from xxx.xxx.xxx.xxx: bytes=32 time=1ms TTL=63

Ping statistics for xxx.xxx.xxx.xxx:
Packets: Sent = 10, Received = 10, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 0ms, Maximum = 1ms, Average = 0ms

tracert host1.domain.com

Tracing route to host1.domain.com [xxx.xxx.xxx.xxx]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms 172.16.1.1 **(This is my gateway to my windows network.)**
2 1 ms <1 ms <1 ms host1.domain.com [xxx.xxx.xxx.xxx]

Trace complete.

I rebuilt the sendmail.cf and it's still just holding emails in the Q saying "deferred: connection timed out"
I have also looked into the servers dns. It is all setup correctly. It may seem that it can't resolved hostnames that are mail servers. such as mx3.hotmail.com or gmail.com. But you can ping yahoo.com hotmail.com gmail.com. Kinda weird. I can ping all of those from my windows machine just fine

Last edited by kitek; 05-14-2011 at 12:16 PM.
 
Old 05-14-2011, 07:02 PM   #13
kitek
Member
 
Registered: Apr 2005
Posts: 252

Original Poster
Rep: Reputation: 15
Fixed sendmail. Now I know why it just delayed email and not report why. A few weeks ago I changed to fiber optics business service and the ISP morons were block port 25. After pulling all my hair out, I finally called them to double check. They were block port 25. Flushed the Q, BAM! But I still have the FTP error and slow response issues.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
centos troubleshooting marene Linux - Software 1 01-18-2011 02:17 AM
How does one convert a Fedora Core 4 box into CentOs 5 box in a live environment? 242 Linux - Newbie 3 01-17-2011 10:25 PM
Troubleshooting mail with CentOS/ Webmin: first steps? jsp_1983 Linux - Newbie 4 01-11-2011 10:15 PM
Troubleshooting Slow Transfer Speed Between Linux Box and Windows Box timswim78 Linux - General 1 10-23-2005 11:45 AM
Troubleshooting RH9 box behind PT-3812 Mr_Minh Linux - Networking 1 02-07-2004 06:24 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 02:43 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration