Webserver Log Rotation, Stats and Archiving.

graq · 02-23-2006, 10:12 AM

Hi

This is my first post, I searched on 'log rotation', 'webalizer', 'cronolog' and got a mixture of forums - so apologies if this is the wrong place.

I am running Apache 2 on RH ES (no load balancing or clustering), running multiple virtual hosts (each with their own log files). I am rotating these log files weekly using Cronolog (%Y_<vitrtualhostname>_access.log.%W) and have setup Webalizer conf files for each of these.

How I was planning to do it was to use Cronolog's -S and -P switches to have a '.thisweek' and '.lastweek' access files with Webalizer's config set to read .lastweek. I can then archive older log files later in the week.

However, Apache does go through any number of graceful restarts during the week (mainly because mod_perl2's object reload doesn't seem to be working 100% as desired). I think that the Apache restart causes
.lastweek to link the same file as .thisweek (Cronolog seems to get confused).

The restarts are, realistically, unavoidable.

Any suggestions on a different way to achieve my goal (or a way to fix the above)?

The aim is to produce stats weekly, rotate regularly (preferably weekly) and archive at least monthly (or 4 weekly, whatever). I'm finding it difficult to come up with a good strategy across the 3 requirements (rotate, analyse, archive) that is reliable.

Many Thanks.

gilead · 02-24-2006, 06:57 PM

I'm not sure that it meets all of your requirements, but when I had a similar problem with links to Apache's log files I switched to Apache's rotatelogs program. I usually use something like:

Code:

ErrorLog "|/usr/local/apache2/bin/rotatelogs /var/log/httpd/error.log 604800"
SetEnvIf Remote_Addr "127\.0\.0\.1" dontloginf
SetEnvIf Remote_Addr "192\.168\.1\.10" dontloginf
CustomLog "|/usr/local/apache2/bin/rotatelogs /var/log/httpd/access.log 604800" combined env=!dontloginf

The 604800 can be tweaked to rotate the logs on whatever interval you need.