LinuxQuestions.org
Register a domain and help support LQ
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 07-24-2009, 12:14 PM   #1
wademac
Member
 
Registered: Apr 2008
Posts: 40

Rep: Reputation: 15
Archive of Web Logs for Urchin.


Hello All,

We use Urchin 6.6 for our stats from our 3 web servers Urchin runs on a dedicated SUSE 10.3 box and I have the live logs mounted to this box using NFS so it can read the live logs off the servers local to the Urchin Application.

for example NFS mounts to Urchin Server:
/mnt/live_wwwlogs
/mnt/live_www2logs
/mnt/live_www3logs

now those servers can only hold some much storage of those logs but I need to keep a archive of all web logs so I have setup a archive on the Urchin box which is on a SAN connection .

/Data is a LVM from a SAN

/data/logs/wwwlogs
/data/logs/www2logs
/data/logs/www3logs

each website has a directory

/data/logs/wwwlogs/website1

for example website1-combined_log-20080203.gz, website1-combined_log-20080204.gz etc.. going back over many years...

I would like to move anything older than 15 days to the /data/logs/@server/$website and cron it to run after midnight log roll.
 
Old 07-24-2009, 12:27 PM   #2
emetib
Member
 
Registered: Feb 2003
Posts: 482

Rep: Reputation: 33
how often do you have your logs rotating?

i know on mine it's every week.

it sounds like you should set up an rsync cron job.
take a look at the man for rsync, it's pretty straight forward.
 
Old 07-24-2009, 01:37 PM   #3
wademac
Member
 
Registered: Apr 2008
Posts: 40

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by emetib View Post
how often do you have your logs rotating?

i know on mine it's every week.

it sounds like you should set up an rsync cron job.
take a look at the man for rsync, it's pretty straight forward.
it is mixed some are done daily some are never rolled and just build as they are small I want to automate the process I am thinking of taking the logs that dont roll and roll them monthly.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
logs in web(Browser) Ammad Linux - General 4 11-08-2006 06:07 AM
urchin problem - please help chadi Linux - General 0 11-09-2004 05:28 PM
FTP archive logs madunix Programming 0 04-01-2004 12:58 AM
archive system logs? ANU Linux - General 3 12-01-2003 12:48 PM
Apache Web Logs jnovak_it Linux - Software 0 10-30-2003 01:27 PM


All times are GMT -5. The time now is 10:42 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration