Selecting files in regular intervals from a folder

rpd25 · 01-29-2012, 11:59 PM

Hi,

I need your expertise in selecting files from a folder.

I have files named with convention: filename.i.j
where j is an interger from 1 to 16, for each i which is an integer from 1 to 2000.

I would like to select the files with i in regular interval of 50 like
filename.1.j, filename.50.j, filename.100.j,...

How to write a script to select files in regular intervals and copy them in other directory?

Thanks,
Rakesh

firstfire · 01-30-2012, 12:15 AM

Hi.

Code:

for i in 1 `seq 50 50 1000`; do echo cp filename.$i.* target; done

Remove `echo' to actually copy files.

Or, if you use recent bash, try

Code:

$ echo cp  filename.{1,{50..2000..50}}.* target

rpd25 · 01-30-2012, 12:52 AM

Thank you for the quick reply.

I used the command to transfer files in different clusters using scp command

scp -rp username@remotehost.edu:/DirectoryLocation/udisp.{0,{100..10000..100}}.* .

The files are transferred, however after every 100'th files, it asks me the password to transfer files.
This is very irritating. Is there any option to grant transfer permission once?

One more thing, how to transfer multiple files udisp.i.j and vdisp.i.j (in interval of 100's) at once using scp?

Thanks,
Rakesh

firstfire · 01-30-2012, 02:13 AM

Hi.

I can not reproduce the multiple authentication issue yet. In my tests authentication takes place ony once, then scp copies multiple files.
Man page mentions the `-B' flag to scp

Quote:

-B Selects batch mode (prevents asking for passwords or passphrases).

but I don't think it will help.

So, can you provide some more info, e.g. run scp in verbose mode (-v) and post the log here?

To transfer udisp and vdisp try something like

Code:

scp -rp username@remotehost.edu:/DirectoryLocation/[udisp,vdisp].{0,{100..10000..100}}.* .

Cedrik · 01-30-2012, 04:39 AM

What about using tar

Code:

ssh username@remotehost.edu \
"cd /DirectoryLocation; tar cf - [udisp,vdisp].{0,{100..10000..100}}.*" |\
tar xvf -