[SOLVED] one of the website takes a very long time to load

tkmsr · 05-27-2010, 01:17 AM

Hi,
I am using KVM and created four guest Operating systems on it.
The server host is Ubuntu 10.04.I am using 4 websites in a reverse proxy environment.
One of our website is running on CentOS VM.
Right now there is no traffic on the website static HTML pages.
I do not have any clue as why it was taking longer time to be accessed.
Any suggestions as what might have happened ?

There was a problem when I opened this thread and that problem got mixed in this thread
if some one wants to read directly please check reply number 16 the actual problem is from there.
http://www.linuxquestions.org/questi...ml#post3988551
you can skip in between.

unSpawn · 05-27-2010, 03:05 AM

Please remember that when you write your OP that we know absolutely nothing. Sure we could read back all of your previous threads but that's rather inefficient. So please fill in the technical details:
- do all 4 websites run their own reverse proxy?
- What kind of web stack components (software, versions, configuration) do these 4 websites run?
- "Longer" in comparison to what?
- What statistics go with that to prove it takes "longer"?
- What website web stack daemon log excerpts prove it takes "longer"?
- If the behaviour was OK before what software or configuration changes have happened?

business_kid · 05-27-2010, 03:07 AM

If there's no traffic on it, it won't be in the cache. But give a few statistics to show why you are worried.

tkmsr · 05-27-2010, 05:13 AM

Quote:

Originally Posted by unSpawn

Please remember that when you write your OP that we know absolutely nothing.

Sorry my mistake.I did not explained my self clear.

The configuration is like this

Code:

                                |--------------192.168.1.1
                                |            (site1.abc.com)(Ubuntu 10.04 JeOS)
                                |
                                |--------------192.168.1.2
                                |            (site2.abc.com)(Ubuntu 10.04 JeOS)
                                |
                                |
                                |
                                |
                                |--------------192.168.1.3
                                |            (site3.abc.com)(Ubuntu 10.04 JeOS)
                                | 
                                |
                                |
                                |
                                |--------------192.168.1.4
                                |            (site4.abc.com)(Ubuntu 10.04 JeOS)
  (Public IP )     (KVM)        |
            A-------------------|
(reverse proxy server)          |
  (192.168.1.25)                |
(Ubuntu 10.04 JeOS)             |--------------192.168.1.5
                                |            (site5.abc.com)(CentOS 5.5 JeOS)
                                |
                                |
                                |
                                |
                                |
                                |
                                |--------------192.168.1.19
                                |             (My Laptop) (Ubuntu 9.04)

JeOS == Just Enough Operating System

Quote:

Originally Posted by unSpawn

- do all 4 websites run their own reverse proxy?

No there is only one proxy.

Quote:

Originally Posted by unSpawn

- What kind of web stack components (software, versions, configuration) do these 4 websites run?

Those websites run Ubuntu server no GUI and a Drupal basic install i.e. first time installation of Drupal nothing more than that.No traffic from web still under development so just a template.

Quote:

Originally Posted by unSpawn

- "Longer" in comparison to what?

In comparison to any other other websites hosted on Ubuntu server.

Quote:

Originally Posted by unSpawn

- What statistics go with that to prove it takes "longer"?

User experience even I noticed today that in typing in browser only one site (site5.abc.com) did not opened for at least 5 minutes.

Quote:

Originally Posted by unSpawn

- What website web stack daemon log excerpts prove it takes "longer"?

I could not understand this are saying about /var/log/httpd
logs or some thing else.

Quote:

Originally Posted by unSpawn

- If the behaviour was OK before what software or configuration changes have happened?

Yes the behaviour was Ok when I installed eduCommons package on a site which I am referring to.
eduCommons-3.2.1-1.x86_64.rpm
on CentOS 5.5 in above diagram it refers to site5.
Basically this eduCommons should be visible to world outside.
Yesterday it was loading today morning when I opened this thread I came to know that it was taking longer time and by the time I am posting this message I noticed it (site5.abc.com)
no longer runs.

The eduCommon suite has probably installed Plone.
I am new to Plone Zope.

I looked in /var/log/httpd/
I see a file it says site5.abc.com-error_log

Code:

[Thu May 27 11:23:20 2010] [error] (111)Connection refused: proxy:
HTTP: attempt to connect to 127.0.0.1:8080 (*) failed

Also on Reverse Proxy server

Code:

I see this

[Thu May 27 11:17:54 2010] [error] (111)Connection refused: proxy:
HTTP: attempt to connect to 192.168.1.5:8080 (192.168.1.5)
failed
[Thu May 27 11:17:54 2010] [error] ap_proxy_connect_backend disabling
worker for (192.168.1.5)

Some one suggested me that in the software eduCommons some thing is wrong
and said it is not starting the Plone webserver.

I found in
/opt/eduCommons-3.2.1/var/log/
some logs I have put them here

http://pastebin.com/KAe6dMVL
and here
http://pastebin.com/uGdLA82g
I have no clue as what went wrong I am just guessing.

unSpawn · 05-27-2010, 05:17 PM

It's not that I don't appreciate your verbose reply but looking at your log excerpts, wouldn't you agree that fixing your proxy errors would be the first thing to try?

tkmsr · 05-28-2010, 01:01 AM

Actually the time I posted the thread and by now the problem completely changed my site is right now not at all accessible on even LAN.
So the situation right now is even worse than for which I posted the problem.
I will tell I am using a software eduCommons-3.2.1-1.x86_64.rpm
on CentOS 5.5 which I am referring in the above diagram as site5.abc.com which is nothing but when some one hits in browser
http://site5.abc.com reaches to my server A which in backend is redirecting to
192.168.1.5:8080/eduCommons
on LAN before I posted the problem of slow access of the website I could browse http://192.168.1.5:8080/eduCommons
we were designing templates and GUI for the site.So no where we messed with any settings internally.

Code:

/etc/init.d/educommons restart

That is how eduCommons server starts.
This page http://educommons.com/documentation/...hat-5-x-centos says nothing much about installation which perfectly went fine and I was able to browse the site on LAN by

Code:

192.168.1.5:8080/eduCommons

After installation we did not do any thing on the site for 24 hours.
In morning we thought of starting our work one of my team mates reported that site is loading slow.
By the time I posted this message the site was very slow.We were not clear of the problem.
But after that I rebooted server.Now nothing is there even on LAN.So the original problem has actually changed.
I came across /opt/eduCommons-3.2.1/var/log
where /opt/eduCommons-3.2.1 is the installation directory.
Some one told me the error from Apache is because it can't access the eduCommons server.
I tried killing all eduCommons processes and starting it again did not helped much.
Some one suggested me that it is running a plone server and eduCommons is not able to connect to it.
I do not know whether it is right or wrong.
I googled and came across Zope.I am not able to confirm from my search if eduCommons is using that.
This is one more file zeorserver.log
I noticed things not working from 27th May but it might have gone wrong from 26th itself so see if in this file which is zeoserver.log I am not able to get which line should I focus on to be able to understand if some thing is wrong.I installed it on 25th May and it was working fine at that time

Code:

2009-10-20T20:09:33 daemonizing the process 
2009-10-20T20:09:33 set current directory: '/home/brent/rpms/SOURCES/eduCommons-3.2.1-final/parts/zeoserver' 
2009-10-20T20:09:33 daemon manager started 
2009-10-20T20:09:33 spawned process pid=17397 
2009-10-20T20:09:33 (17397) created PID file '/home/brent/rpms/SOURCES/eduCommons-3.2.1-final/var/zeoserver.pid' 
2009-10-20T20:09:33 (17397) opening storage '1' using FileStorage 
2009-10-20T20:09:33 (17397) StorageServer created RW with storages: 1:RW:/home/brent/rpms/SOURCES/eduCommons-3.2.1-final/var/filestorage/Data.fs 
2009-10-20T20:09:33 (17397) listening on ('127.0.0.1', 8100) 
2009-10-20T20:09:52 (17397) new connection ('127.0.0.1', 50127): <ManagedServerConnection ('127.0.0.1', 50127)> 
2009-10-20T20:09:52 (127.0.0.1:50127) received handshake 'Z303' 
2009-10-20T20:09:52 (127.0.0.1:50127) loadEx() raised exception: 0x00 
Traceback (most recent call last): 
  File "/home/brent/rpms/SOURCES/eduCommons-3.2.1-final/parts/zope2/lib/python/ZEO/zrpc/connection.py", line 535, in handle_request 
    ret = meth(*args) 
  File "/home/brent/rpms/SOURCES/eduCommons-3.2.1-final/parts/zope2/lib/python/ZEO/StorageServer.py", line 254, in loadEx 
    return self.storage.loadEx(oid, version) 
  File "/home/brent/rpms/SOURCES/eduCommons-3.2.1-final/parts/zope2/lib/python/ZODB/FileStorage/FileStorage.py", line 523, in loadEx 
    pos = self._lookup_pos(oid) 
  File "/home/brent/rpms/SOURCES/eduCommons-3.2.1-final/parts/zope2/lib/python/ZODB/FileStorage/FileStorage.py", line 514, in _lookup_pos 
    raise POSKeyError(oid) 
POSKeyError: 0x00 
2009-10-20T20:11:47 (17397/127.0.0.1:50127) disconnected 
2009-10-20T20:11:48 (17397) terminated by SIGTERM 
2009-10-20T20:11:48 (17397) closing storage '1' 
2009-10-20T20:11:48 (17397) removed PID file '/home/brent/rpms/SOURCES/eduCommons-3.2.1-final/var/zeoserver.pid' 
2009-10-20T20:11:48 pid 17397: exit status 0 
2009-10-20T20:11:48 Exiting 
2010-05-25T19:27:22 daemonizing the process 
2010-05-25T19:27:22 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-25T19:27:22 daemon manager started 
2010-05-25T19:27:22 spawned process pid=2542 
2010-05-25T19:27:22 (2542) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-25T19:27:22 (2542) opening storage '1' using FileStorage 
2010-05-25T19:27:22 (2542) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-25T19:27:22 (2542) listening on ('127.0.0.1', 8100) 
2010-05-25T19:27:32 (2542) new connection ('127.0.0.1', 46505): <ManagedServerConnection ('127.0.0.1', 46505)> 
2010-05-25T19:27:32 (127.0.0.1:46505) received handshake 'Z303' 
2010-05-25T19:34:03 daemon manager killed by SIGTERM 
2010-05-25T19:34:03 (2542) terminated by SIGTERM 
2010-05-25T19:34:03 (2542) closing storage '1' 
2010-05-25T19:34:03 (2542) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-25T19:35:09 daemonizing the process 
2010-05-25T19:35:09 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-25T19:35:09 daemon manager started 
2010-05-25T19:35:09 spawned process pid=2145 
2010-05-25T19:35:09 (2145) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-25T19:35:09 (2145) opening storage '1' using FileStorage 
2010-05-25T19:35:09 (2145) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-25T19:35:09 (2145) listening on ('127.0.0.1', 8100) 
2010-05-25T19:35:19 (2145) new connection ('127.0.0.1', 51546): <ManagedServerConnection ('127.0.0.1', 51546)> 
2010-05-25T19:35:19 (127.0.0.1:51546) received handshake 'Z303' 
2010-05-27T11:16:55 Unlinking stale socket /opt/eduCommons-3.2.1/var/zeo.zdsock; sleep 1 
2010-05-27T11:16:56 daemonizing the process 
2010-05-27T11:16:56 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T11:16:56 daemon manager started 
2010-05-27T11:16:56 spawned process pid=2171 
2010-05-27T11:16:56 (2171) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:16:56 (2171) opening storage '1' using FileStorage 
2010-05-27T11:16:56 (2171) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T11:16:56 (2171) listening on ('127.0.0.1', 8100) 
2010-05-27T11:21:42 (2171) terminated by SIGTERM 
2010-05-27T11:21:42 (2171) closing storage '1' 
2010-05-27T11:21:42 (2171) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:21:42 pid 2171: exit status 0 
2010-05-27T11:21:42 Exiting 
2010-05-27T11:21:43 daemonizing the process 
2010-05-27T11:21:43 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T11:21:43 daemon manager started 
2010-05-27T11:21:43 spawned process pid=2336 
2010-05-27T11:21:44 (2336) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:21:44 (2336) opening storage '1' using FileStorage 
2010-05-27T11:21:44 (2336) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T11:21:44 (2336) listening on ('127.0.0.1', 8100) 
2010-05-27T11:22:21 (2336) terminated by SIGTERM 
2010-05-27T11:22:21 (2336) closing storage '1' 
2010-05-27T11:22:21 (2336) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:22:21 pid 2336: exit status 0 
2010-05-27T11:22:21 Exiting 
2010-05-27T11:22:22 daemonizing the process 
2010-05-27T11:22:22 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T11:22:22 daemon manager started 
2010-05-27T11:22:22 spawned process pid=2349 
2010-05-27T11:22:22 (2349) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:22:22 (2349) opening storage '1' using FileStorage 
2010-05-27T11:22:22 (2349) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T11:22:22 (2349) listening on ('127.0.0.1', 8100) 
2010-05-27T11:22:43 (2349) terminated by SIGTERM 
2010-05-27T11:22:43 (2349) closing storage '1' 
2010-05-27T11:22:43 (2349) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:22:43 pid 2349: exit status 0 
2010-05-27T11:22:43 Exiting 
2010-05-27T11:22:50 daemonizing the process 
2010-05-27T11:22:50 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T11:22:50 daemon manager started 
2010-05-27T11:22:50 spawned process pid=2363 
2010-05-27T11:22:50 (2363) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:22:50 (2363) opening storage '1' using FileStorage 
2010-05-27T11:22:50 (2363) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T11:22:50 (2363) listening on ('127.0.0.1', 8100) 
2010-05-27T11:23:44 daemon manager killed by SIGTERM 
2010-05-27T11:23:44 (2363) terminated by SIGTERM 
2010-05-27T11:23:44 (2363) closing storage '1' 
2010-05-27T11:23:44 (2363) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:24:47 daemonizing the process 
2010-05-27T11:24:47 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T11:24:47 daemon manager started 
2010-05-27T11:24:47 spawned process pid=2116 
2010-05-27T11:24:47 (2116) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:24:47 (2116) opening storage '1' using FileStorage 
2010-05-27T11:24:48 (2116) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T11:24:48 (2116) listening on ('127.0.0.1', 8100) 
2010-05-27T11:27:52 (2116) terminated by SIGTERM 
2010-05-27T11:27:52 (2116) closing storage '1' 
2010-05-27T11:27:52 (2116) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:27:52 pid 2116: exit status 0 
2010-05-27T11:27:52 Exiting 
2010-05-27T11:27:52 daemonizing the process 
2010-05-27T11:27:52 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T11:27:52 daemon manager started 
2010-05-27T11:27:52 spawned process pid=2292 
2010-05-27T11:27:52 (2292) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:27:52 (2292) opening storage '1' using FileStorage 
2010-05-27T11:27:52 (2292) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T11:27:52 (2292) listening on ('127.0.0.1', 8100) 
2010-05-27T11:28:27 pid 2292: terminated by SIGKILL 
2010-05-27T11:28:27 spawned process pid=2299 
2010-05-27T11:28:27 (2299) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:28:27 (2299) opening storage '1' using FileStorage 
2010-05-27T11:28:27 (2299) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T11:28:27 (2299) listening on ('127.0.0.1', 8100) 
2010-05-27T11:28:32 (2299) terminated by SIGTERM 
2010-05-27T11:28:32 (2299) closing storage '1' 
2010-05-27T11:28:32 (2299) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:28:32 pid 2299: exit status 0 
2010-05-27T11:28:32 Exiting 
2010-05-27T11:28:32 daemonizing the process 
2010-05-27T11:28:32 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T11:28:32 daemon manager started 
2010-05-27T11:28:32 spawned process pid=2309 
2010-05-27T11:28:32 (2309) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:28:32 (2309) opening storage '1' using FileStorage 
2010-05-27T11:28:32 (2309) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T11:28:32 (2309) listening on ('127.0.0.1', 8100) 
2010-05-27T11:31:23 (2309) terminated by SIGTERM 
2010-05-27T11:31:23 (2309) closing storage '1' 
2010-05-27T11:31:23 (2309) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:31:23 pid 2309: exit status 0 
2010-05-27T11:31:23 Exiting 
2010-05-27T11:31:23 daemonizing the process 
2010-05-27T11:31:23 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T11:31:23 daemon manager started 
2010-05-27T11:31:23 spawned process pid=2330 
2010-05-27T11:31:23 (2330) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:31:23 (2330) opening storage '1' using FileStorage 
2010-05-27T11:31:23 (2330) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T11:31:23 (2330) listening on ('127.0.0.1', 8100) 
2010-05-27T11:55:57 (2330) terminated by SIGTERM 
2010-05-27T11:55:57 (2330) closing storage '1' 
2010-05-27T11:55:57 (2330) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:55:57 pid 2330: exit status 0 
2010-05-27T11:55:57 Exiting 
2010-05-27T11:55:57 daemonizing the process 
2010-05-27T11:55:57 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T11:55:57 daemon manager started 
2010-05-27T11:55:57 spawned process pid=2438 
2010-05-27T11:55:57 (2438) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T11:55:57 (2438) opening storage '1' using FileStorage 
2010-05-27T11:55:57 (2438) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T11:55:57 (2438) listening on ('127.0.0.1', 8100) 
2010-05-27T12:00:56 (2438) terminated by SIGTERM 
2010-05-27T12:00:56 (2438) closing storage '1' 
2010-05-27T12:00:56 (2438) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T12:00:56 pid 2438: exit status 0 
2010-05-27T12:00:56 Exiting 
2010-05-27T12:00:56 daemonizing the process 
2010-05-27T12:00:56 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T12:00:56 daemon manager started 
2010-05-27T12:00:56 spawned process pid=2474 
2010-05-27T12:00:56 (2474) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T12:00:56 (2474) opening storage '1' using FileStorage 
2010-05-27T12:00:56 (2474) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T12:00:56 (2474) listening on ('127.0.0.1', 8100) 
2010-05-27T12:05:32 (2474) terminated by SIGTERM 
2010-05-27T12:05:32 (2474) closing storage '1' 
2010-05-27T12:05:32 (2474) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T12:05:32 pid 2474: exit status 0 
2010-05-27T12:05:32 Exiting 
2010-05-27T12:05:32 daemonizing the process 
2010-05-27T12:05:32 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T12:05:32 daemon manager started 
2010-05-27T12:05:32 spawned process pid=2514 
2010-05-27T12:05:32 (2514) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T12:05:32 (2514) opening storage '1' using FileStorage 
2010-05-27T12:05:32 (2514) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T12:05:32 (2514) listening on ('127.0.0.1', 8100) 
2010-05-27T12:24:58 (2514) terminated by SIGTERM 
2010-05-27T12:24:58 (2514) closing storage '1' 
2010-05-27T12:24:58 (2514) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T12:24:58 pid 2514: exit status 0 
2010-05-27T12:24:58 Exiting 
2010-05-27T12:24:58 daemonizing the process 
2010-05-27T12:24:58 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T12:24:58 daemon manager started 
2010-05-27T12:24:58 spawned process pid=2709 
2010-05-27T12:24:58 (2709) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T12:24:58 (2709) opening storage '1' using FileStorage 
2010-05-27T12:24:58 (2709) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T12:24:58 (2709) listening on ('127.0.0.1', 8100) 
2010-05-27T12:41:16 (2709) terminated by SIGTERM 
2010-05-27T12:41:16 (2709) closing storage '1' 
2010-05-27T12:41:16 (2709) removed PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T12:41:16 pid 2709: exit status 0 
2010-05-27T12:41:16 Exiting 
2010-05-27T12:41:19 daemonizing the process 
2010-05-27T12:41:19 set current directory: '/opt/eduCommons-3.2.1/parts/zeoserver' 
2010-05-27T12:41:19 daemon manager started 
2010-05-27T12:41:19 spawned process pid=2766 
2010-05-27T12:41:19 (2766) created PID file '/opt/eduCommons-3.2.1/var/zeoserver.pid' 
2010-05-27T12:41:19 (2766) opening storage '1' using FileStorage 
2010-05-27T12:41:19 (2766) StorageServer created RW with storages: 1:RW:/opt/eduCommons-3.2.1/var/filestorage/Data.fs 
2010-05-27T12:41:19 (2766) listening on ('127.0.0.1', 8100)

I have posted the complete log file here.

tkmsr · 05-28-2010, 01:28 AM

Hi got my problem solved partially here by help of a friend of mine.
I will tell here is what he discovered but the original part from where discussion started is still there please read my next post.

This post I have done so that if some one by chance comes across and faces similar thing should help them.
There was a stale PID file that the educommons
script seems to keep complaining about. He removed that file and Zope/Plone
started up just fine.

This is what he got when he started educommons:

Code:

[root@o run]# /etc/init.d/educommons start 
Starting eduCommons Production Server: 
. daemon process started, pid=5079 
Client1 already running: 2153

Then he opened the startup script using vi and found the path for the PID file.
And removed it. Then he started the services and it worked just fine:

Code:

root@ var]# /etc/init.d/educommons start 
Starting eduCommons Production Server: 
. daemon process started, pid=5193 
. Unlinking stale socket /opt/eduCommons-3.2.1/var/instance1/zopectlsock; 
sleep 1 
No handlers could be found for logger "root" 
. daemon process started, pid=5198

Well I myself never came across this problem before today.

This is what he told me about stale pid

" Most startup scripts on Linux use PID files for two purpose: 1) to keep track
of services already running, and 2) to get the pid of the running service.

Whenever we use an initscript to start a service, it will generally check for
the existence of a PID file (as an indication of whether a service is running
or not). When you shut down a service cleanly (ie. the service is stopped
using an init script and does not crash or is not killed), the PID file is
removed.

So in cases when you DO NOT stop a service using an init script, the PID files
get left over and become "stale". When the init script reported that "Client1"
was already running, I checked the process list to see if the pid reported
existed. It did not. So I gathered that this is a simple case of a stale PID
file. The next few steps were about finding the PID file and removing it.

... after which the service started happily.

As you can see, this can be a MAJOR irritant on any GNU/Linux system.
There is service management system which he uses called 'runit' which "supervises" services.
'runit' is inspired by 'daemontools' (which DJB wrote for qmail). With 'runit'
each service is supervised and a service superviser runs for each service. So
we don't need to depend upon PID files to see if a service is running or not.

Check out: http://smarden.org/runit/ for more information on this. "

tkmsr · 05-28-2010, 09:28 AM

I have shared above message if some one by chance comes across this thread should help him.This problem occured in between now coming back to original problem of site loading slow.

I just used chromium to analyse why its taking so much time.
(Not sure though) The problem has
something to do with incorrect paths for the CSS & images inside the
eduCommons web server.
Though the page loads up very fast, the images don't
load up at all.
Here is a snapshot http://farm5.static.flickr.com/4071/...229bc3cb_o.png
I have checked the web page from Google Developer tools and found some CSS missing.I myself have not developed eduCommons so can not understand how to analyse as what is making site slow.Assuming that CSS can not be a hurdle for site to be slow.
So any guesses now?

unSpawn · 05-29-2010, 07:39 AM

Quote:

Originally Posted by tkmsr

The problem has something to do with incorrect paths for the CSS & images inside the eduCommons web server. Though the page loads up very fast, the images don't load up at all.

If you look at the HTML source code in your web browser what path is expected for CSS and images?
What path do they reside in on the server?
Were paths for CSS and images changed inside the eduCommons web server?
Or did you by any chance change the eduCommons skin or other administration panel defaults?
And there's no chance this has to do with your rewrite rules in the other thread, right?

tkmsr · 05-29-2010, 07:57 AM

Quote:

Originally Posted by unSpawn

If you look at the HTML source code in your web browser what path is expected for CSS and images?
What path do they reside in on the server?
Were paths for CSS and images changed inside the eduCommons web server?
Or did you by any chance change the eduCommons skin or other administration panel defaults?

Actually I have not made any changes to any thing just installed the rpm and left it.Next day came and found this STALE PID problem before this also this slow loading problem was there.No changes made by me at all.No admin configuration etc.
No one knows about the site so no user also.

eduCommons is hosted on CentOS Virtual Machine running as a Guest OS on Ubuntu 10.04 KVM hypervisor.

To this server I have one more observation if I do a SSH from LAN it takes more than longer in comparison to other KVM hosts running on the top of same Ubuntu server.
The networking is bridged networking.

All this is a part of a LAN.All the KVM hosts can be pinged and SSHed but this (CentOS virtual machine) on which I am telling this site (eduCommons) is hosted
is accessible on SSH also after a delay which is noticeable.
All of this is running as Virtual Machines on a KVM hypervisor on Ubuntu 10.04

Quote:

Originally Posted by unSpawn

And there's no chance this has to do with your rewrite rules in the other thread, right?

No that is a different problem all together.I have right now temporarily stopped that thing since I first want to get rid of this one.

tkmsr · 06-01-2010, 01:04 AM

Quote:

Originally Posted by business_kid

If there's no traffic on it, it won't be in the cache. But give a few statistics to show why you are worried.

Here are a few statistics as you asked I watched developer tools video
Chrome developer tools
http://www.youtube.com/watch?v=RhaWY...ayer_embedded#!
http://www.youtube.com/watch?v=OxW1d...layer_embedded

read one more blog about what makes a website slow
http://www.snaphow.com/why-is-my-web...e-blog-faster/
I recorded the website loading time in the Chrome time line section and
based on what I observed

following page elements take more than 100 ms on the website
jquery checks
113 ms http://192.168.1.5:8080/eduCommons/p...achekey0517.js

244ms http://192.168.1.5:8080/eduCommons/p...achekey1443.js
247ms http://192.168.1.5:8080/eduCommons/p...chekey5402.css

like this there are some more css and page elements which have taken
100ms or 200ms in their GET request from server.

on this link
http://www.chicagostyleseo.com/2010/...-site-is-slow/
they mentioned what Google has defined as a slow website following
words are mentioned.

"Google has made it clear that any process that takes more than 100
milliseconds (1/10 of a second) is too long"

So that means my website is slow on the definition that Google gave above.
I have attached a snapshot
http://farm5.static.flickr.com/4048/...87025551_b.jpg
you can see results of page elements loading slow.

Also I checked LAN speed on Server A on above diagram.
ethtool eth2 | less

Code:

Settings for eth2:
       Supported ports: [ TP ]
       Supported link modes:   10baseT/Half 10baseT/Full
                               100baseT/Half 100baseT/Full
                               1000baseT/Full
       Supports auto-negotiation: Yes
       Advertised link modes:  10baseT/Half 10baseT/Full
                               100baseT/Half 100baseT/Full
                               1000baseT/Full
       Advertised pause frame use: No
       Advertised auto-negotiation: Yes
       Link partner advertised link modes:  Not reported
       Link partner advertised pause frame use: No
       Link partner advertised auto-negotiation: No
       Speed: 100Mb/s
       Duplex: Full
       Port: Twisted Pair
       PHYAD: 1
       Transceiver: internal
       Auto-negotiation: on
       MDI-X: Unknown
       Supports Wake-on: g
       Wake-on: g
       Link detected: yes

and speed of LAN here shows to be 100Mbps

Code:

ethtool eth2 | grep -i speed
       Speed: 100Mb/s

and the webserver (192.168.1.5 in above diagram)where the site has been hosted

Code:

ethtool eth0 
Settings for eth0:
No data available

and
ethtool eth0 | grep -i speed
did not gave any output you can see above it is clear.
Now what should I check? Or if any more statistics are needed?

business_kid · 06-01-2010, 02:59 AM

I take your point. 244ms is slow.
Accessing a site as 192.168.1.5(an internal ip) can have it's own issues and you should try and find which part of the access is causing a delay. Dns is out of it. If you go to the box in question, and type
http://127.0.0.1/website
http://localhost/website

Do you still have the same delays? Does traceroute 192.168.1.5 throw up anything?

tkmsr · 06-01-2010, 03:44 AM

Quote:

Originally Posted by business_kid

I take your point. 244ms is slow.
Accessing a site as 192.168.1.5(an internal ip) can have it's own issues and you should try and find which part of the access is causing a delay. Dns is out of it. If you go to the box in question, and type
http://127.0.0.1/website
http://localhost/website

Do you still have the same delays? Does traceroute 192.168.1.5 throw up anything?

To be able to do so I did following as the server on which we are doing all this does not have a GUI.

This step is one step further to resolve this problem.

I was trying to run this from my local machine:

Code:

   ssh -L8080:localhost:8080 192.168.1.5

and then connecting to http://localhost:8080/eduCommons in my local browser.

Quote:

Originally Posted by business_kid

Do you still have the same delays? Does traceroute 192.168.1.5 throw up anything?

Yes I got the same slow response 411 ms for an html element.
The snapshot for this is here.

To be able to
try ssh -X 192.168.1.5 and then launch firefox/chrome and connect to http://localhost:8080/eduCommons

so that I connect directly to eduCommons webserver which is running on Plone and bypass apache altogether.

I was trying to install Chrome on CentOS VM (So that ssh educommons -X ;I can have
a display of chrome running on CentOS server forwarded
on my laptop )
by a method mentioned here

http://www.if-not-true-then-false.co...-red-hat-rhel/

after getting an error like this

Code:

http://dl.google.com/linux/rpm/stable/x86_64/repodata/repomd.xml:
[Errno 12] Timeout: <urlopen error timed out>
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for
repository: google64. Please verify its path and try again

came across a few steps here

http://forums.fedoraforum.org/archiv.../t-207223.html
which suggest to do

Code:

yum clean all
yum makecache
rpm --rebuilddb

yum update ( program name)

CentOS server is taking unusually longer time to contact internet.

As you can see in bottom right hand corner of snapshot the speed with which CentOS VM is connecting to internet is 2.7 Kbps.

Can this be a cause of my problem where as rest of the KVM hosts are having good internet speed.

Another snapshot is here which shows a 37 Kbps speed for internet
connectivity for a Ubuntu host.

Notice the third last line of second snapshot which says

Code:

Fetched 340kB in 9s (34.8kB/s)
Reading package lists... Done
root@ubuntu:~#

So right now trying to install Chrome on CentOS remote server.
But have given snapshots for network connectivity.
I could not understand the traceroute what exactly do you want me to test or execute in traceroute?

tkmsr · 06-01-2010, 06:22 AM

This step is one step further to resolve this problem.

I was trying to run this from my local machine:

Code:

   ssh -L8080:localhost:8080 192.168.1.5

and then connecting to http://localhost:8080/eduCommons in my local browser.
I got the same slow response 411 ms for an html element.
The snapshot for this is here.

To be able to
try ssh -X 192.168.1.5 and then launch firefox/chrome and connect to http://localhost:8080/eduCommons

so that I connect directly to eduCommons webserver which is running on Plone and bypass apache altogether.

I was trying to install Chrome on CentOS VM (So that ssh educommons -X ;I can have
a display of chrome running on CentOS server forwarded
on my laptop )
by a method mentioned here

http://www.if-not-true-then-false.co...-red-hat-rhel/

after getting an error like this

Code:

http://dl.google.com/linux/rpm/stable/x86_64/repodata/repomd.xml:
[Errno 12] Timeout: <urlopen error timed out>
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for
repository: google64. Please verify its path and try again

came across a few steps here

http://forums.fedoraforum.org/archiv.../t-207223.html
which suggest to do

Code:

yum clean all
yum makecache
rpm --rebuilddb

yum update ( program name)

CentOS server is taking unusually longer time to contact internet.

As you can see in bottom right hand corner of snapshot the speed with which CentOS VM is connecting to internet is 2.7 Kbps.

Can this be a cause of my problem where as rest of the KVM hosts are having good internet speed.

Another snapshot is here which shows a 37 Kbps speed for internet
connectivity for a Ubuntu host.

Notice the third last line of second snapshot which says

Code:

Fetched 340kB in 9s (34.8kB/s)
Reading package lists... Done
root@ubuntu:~#

tkmsr · 06-01-2010, 07:00 AM

Ok after some failed attempts to install Chrome on CentOS here is what I found
on a centOS forum that Google does not support
Chrome as in most of the cases CentOS or RHEL runs on
a headless server which does not have GUI

Here is a link
https://www.centos.org/modules/newbb...topic_id=23746
this is where they discussed it originally
http://www.google.com/support/forum/...5896c968&hl=en
http://code.google.com/p/chromium/is...etail?id=26809

I was trying to install CentOS on the said server so that

Code:

ssh -X root@192.168.1.5
./chrome

and check if the page loads slow on the server itself.
Those who have been reading this thread if have some thing to try please let me know.