LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 12-22-2014, 03:29 AM   #1
detekto
LQ Newbie
 
Registered: Dec 2014
Posts: 1

Rep: Reputation: Disabled
Need advice on managing files properly


Hi there!
I am a junior linux admin seeking for advice.

I have been given a task to find a solution on how to manage specific files.

Suppose there are several different applications installed on different servers.
There is a requirement to store some files of each application (mostly logfiles) for some time period.

E.g.

Server_A/bin/app/log - every generated log needs to be kept for 2 years, then deleted
Server_B/var/log/app - every generated log needs to be kept for 5 years, then deleted
Server_C/bin/app/files - every generated file needs to be kept for 3 years, then deleted

And so on...
Different systems - different policies

A lot of files on different servers.

Is there any tool, that I can use for such purposes? Define policies etc.
Scripting solution must be hell, I guess

Platform is RHEL 5,6,7
Any tool, that works with Windows as well? (that requirement not necessary)

Most probably files must be moved to centralized location, don't know.

Tried to google, but must have asked wrong questions...

Really hope to be pointed where to look...
Thanks in advance!
 
Old 12-22-2014, 04:38 AM   #2
unSpawn
Moderator
 
Registered: May 2001
Posts: 29,415
Blog Entries: 55

Rep: Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600
Quote:
Originally Posted by detekto View Post
Hi there!
Welcome to LQ, hope you like it here.


Quote:
Originally Posted by detekto View Post
I am a junior linux admin seeking for advice.
Then brace yourself for much reading and testing things in a safe (virtual?) environment.


Quote:
Originally Posted by detekto View Post
(..) several different applications installed on different servers. (..) store some files of each application (mostly logfiles) for some time period. (..) Different systems - different policies (..) A lot of files on different servers. (..) Most probably files must be moved to centralized location, don't know.
One of the first aspects of a project is getting the requirements right. In your case you make a list of applications, which files must be stored and for how long, how they write their (log) files (I mean if it is configurable). This provides overview, can be used as a checklist / basis for reporting back, is the efficient way of working and allows you to spot hiatus / pitfalls from a mile away.


Quote:
Originally Posted by detekto View Post
Is there any tool, that I can use for such purposes? Define policies etc.
For local rotation of log files, unless an application provides its own tools, that'll generally be 'logrotate'. See 'man logrotate' for details.
If you backup logs to a backup server or write logs to a central syslog server then you'll rotate there. This is obviously efficient as you'll have all policies in a central location and don't require local storage for say 2 years worth of logs you won't be doing anything with anyway.


Quote:
Originally Posted by detekto View Post
Scripting solution must be hell, I guess
There's quite a few people here who do scripting quite well. The reason is they do is they didn't operate on a presumption back then but read up on things and persevered writing scripts. Today those help out others a lot here on LQ. So I suggest you ditch the presumption and see where that gets you.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Help with managing/calculating user files alankru Linux - Newbie 6 03-12-2012 02:58 PM
managing duplicated files Completely Clueless Linux - Software 13 09-12-2010 03:04 PM
TechTips: Advice for managing the kernel sundialsvcs Linux - Kernel 4 04-19-2006 01:16 AM
Managing Music Files. liguorir Linux - Software 2 06-14-2003 11:03 PM
newbie seeking advice on properly configuring server marvc Linux - General 3 03-29-2003 03:45 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 02:38 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration