[bash] Copy files, move files but not added ones

errgrdgds · 05-24-2013, 05:02 AM

Hello,
I have to write a bash script to take XML files in directory x, copy them to directory y and then move the same set of files to directory z.

The script itself isn't a problem, except that there will be users uploading XML files into directory x constantly. So I need to in effect take a 'snapshot' of the files that are in there when the script is run.. copy them to y and then move them to z, ignoring any that are added between the time the cp is effected, and the mv.

I'm guessing that this involves doing a find, firing the result into a file, and then reading from that file, but this is something I've never done before.

Can someone advise? Oh, and no- this isn't a 'homework' exercise. It's for my work. Thanks.

NevemTeve · 05-24-2013, 05:13 AM

That's what rsync does. Yes, it works on local files too:

Code:

rsync /path/    /topath1/
rsync /topath1/ /topath2/

Oops, sorry, I missed the move (=delete) part...

errgrdgds · 05-24-2013, 05:23 AM

Quote:

Originally Posted by NevemTeve

That's what rsync does. Yes, it works on local files too:

Code:

rsync /path/    /topath1/
rsync /topath1/ /topath2/

Oops, sorry, I missed the move (=delete) part...

Ah, yes... rsync, I hadn't thought of that! That *would* work, but how do I stop the subsequent mv from treating files that weren't there when the rsync ran?

I go to check the manpage...

errgrdgds · 05-24-2013, 06:36 AM

Quote:

Originally Posted by NevemTeve

That's what rsync does. Yes, it works on local files too:

Code:

rsync /path/    /topath1/
rsync /topath1/ /topath2/

Oops, sorry, I missed the move (=delete) part...

Now, here's something intriguing..

Code:

/bin/ls $startDir/*.xml | sed 's!.*/!!' > $listOfFiles

$rsyncExec -ax --files-from $listOfFiles $startDir $endDir0

$rsyncExec -ax --files-from $listOfFiles $startDir $endDir1

The first rsync works perfectly: I inserted a temporary `exit 0` in there, and checked $endDir0.

When it comes time to run the second rsync, I get..

Code:

rsync: mkstemp "/path_to_file/.1.xml.5yz6bY" failed: No such file or directory (2)
rsync: mkstemp "/path_to_file/.2.xml.Z8gDGe" failed: No such file or directory (2)
rsync: mkstemp "/path_to_file/3.xml.5Dnabv" failed: No such file or directory (2)
rsync: mkstemp "/path_to_file/.4.xml.62AHFL" failed: No such file or directory (2)
rsync: mkstemp "/path_to_file/.5.xml.vjXea2" failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1039) [sender=3.0.6]

Any idea what I've done wrong?

Thanks.

errgrdgds · 05-24-2013, 06:46 AM

I think the second one is failing because it's trying to copy to a directory which in fact is mounted from an NFS server. The first directory isn't.

Looks like I have to use ol' `mv` or even `cp` followed by `rm`..