Shell script or scripts which can do some functions

Amerika · 12-18-2010, 02:46 PM

Hi i am not very good in shell scripting, but my goal is to zip or rar files which are made every 25-30 minutes and after that send them to an remote server threw ftp. Adding to that i need that it removes the files which are zipped or rarred older then hour.
What i have edited now is this:

Code:

#!/bin/sh
USERNAME="user"
PASSWORD="password"
SERVER="www.server.com"
 
# local directory to pickup *.tar.gz file
FILE="/home/coom/test"
 
# remote server directory to upload backup
BACKUPDIR="/web/testingupload"
 
# login to remote server
ftp -n -i $SERVER <<EOF
user $USERNAME $PASSWORD
cd $BACKUPDIR
lcd $FILE
mput testfile.txt
quit
EOF

it works as its suppose to, to send files to an location on the remote server, but i need to edit it or make a new script which does the requirements i have mentioned above.

Tinkster · 12-18-2010, 04:14 PM

Hi, welcome to LQ!

That will be two scripts, I guess, one for the zip & move, one
for deletion. Use cron in conjunctions w/ 'find', e.g.,

Code:

find $FILE -type f -mmin -35 -exec gzip {} \;

and to delete older files

Code:

find $FILE -type f -mmin +60 -exec rm {} \;

Cheers,
Tink

Amerika · 12-19-2010, 04:26 AM

Code:

find $FILE -type f -mmin -35 -exec gzip {} \;

-mmin -35 means what exactly?

catkin · 12-19-2010, 05:07 AM

Quote:

Originally Posted by Amerika

Code:

find $FILE -type f -mmin -35 -exec gzip {} \;

-mmin -35 means what exactly?

From the find man page:

Code:

       -mmin n
              File's data was last modified n minutes ago.

devnull10 · 12-19-2010, 05:08 AM

The above finds all files in $FILE with a modification time within 35 mins and gzips them.

Just as a side-note, it is possible to use sFTP? Not only is it more secure, it doesn't need you to store the username/password as you can use ssh keys.

[edit] ^^ beat to it!

druuna · 12-19-2010, 05:12 AM

Hi,

-mmin X -> File's data was last modified X minutes ago.

-X -> less then X (-mmin -35 would be 35 minutes or less)
+X -> greater then X (-mmin +60 would be 60 minutes or more)
X -> exactly X (-mmin 15 would be exactly 15 minutes)

Hope this clears things up.

EDIT:
Way to slow......

/EDIT

catkin · 12-19-2010, 06:57 AM

Quote:

Originally Posted by druuna

EDIT:
Way to slow......

/EDIT

But the most complete explanation

Amerika · 08-11-2011, 06:40 AM

The last script in this forum was excellent!
What i wanted to do now is to make a script which removes files older then 7 days threw FTP. I keep having problems coding something because it seems you can't use find in ftp

Could anyone post a shellscript type code which can remove files older then 7 days?

schneidz · 08-11-2011, 08:05 AM

^ what type of server are you connecting to ?

your life will be so much easier if you could use ssh, scp, sshfs, nfs, ... instead of ftp.

however what do the filenames look like on the ftp server ?
if they have date stamps like /var/log/messages-20110807 then you can do something like:
ftp <server>
prompt
mdelete *201107*

Amerika · 08-12-2011, 11:23 AM

i can use ssh, but can i automate the script so it works occasionally?

TB0ne · 08-12-2011, 11:38 AM

Quote:

Originally Posted by Amerika

The last script in this forum was excellent! What i wanted to do now is to make a script which removes files older then 7 days threw FTP. I keep having problems coding something because it seems you can't use find in ftp. Could anyone post a shellscript type code which can remove files older then 7 days?

Again, read the man page on the "find" command, and use the script you already have. All you have to modify is the find criteria.

Quote:

Originally Posted by Amerika

i can use ssh, but can i automate the script so it works occasionally?

Yes. Put the script into CRON, and have it execute whenever you'd like.

schneidz · 08-12-2011, 12:25 PM

Quote:

Originally Posted by Amerika

i can use ssh, but can i automate the script so it works occasionally?

my advice to you would be to mount the directory on the server using something like sshfs and running the find command from cron.

i.e.- try to use the insecure, deprecated, featureless ftp as least as possible.

Amerika · 08-13-2011, 05:00 PM

Quote:

Originally Posted by TB0ne

Again, read the man page on the "find" command, and use the script you already have. All you have to modify is the find criteria.

Yes. Put the script into CRON, and have it execute whenever you'd like.

what would i need to write so i could delete any files older then 7 days? The manual is a bit confusing..

TB0ne · 08-13-2011, 05:10 PM

Quote:

Originally Posted by Amerika

what would i need to write so i could delete any files older then 7 days? The manual is a bit confusing..

No, it really isn't.

Read the man page on the find command....pay attention to the "atime", "ctime", and "mtime" switches. One of them has an EXAMPLE that tells you how to find something two days old. From the man page:

Code:

-atime n
    File  was  last  accessed n*24 hours ago.  When find figures out how many 24-hour periods ago the file was last accessed, 
    any fractional part is ignored, so to match -atime +1, a file has to have been accessed at least two days ago.

Now, if a +1 would be 2 days ago, what do you think would be SEVEN days? You are going to have to put some effort into things, rather than asking people to spoon-feed you answers and write scripts for you. Not meaning to sound nasty, but you could have tested this for yourself, quicker than you could have posted the question here.

catkin · 08-13-2011, 09:31 PM

Quote:

Originally Posted by Amerika

The manual is a bit confusing..

It is less confusing when you realise that the find command line is made up of OPTIONS followed by EXPRESSIONS and that EXPRESSIONS are made up of OPTIONS, TESTS, ACTIONS and OPERATORS. With that picture clearly in mind, the layout of the find man page is less confusing.