Script Help

bloodclot · 07-17-2019, 05:57 PM

Hello,

I am downloading a bunch of files via sftp, the files look like -

AKE_US_INVENTORY_20190717041517.csv
AKE_US_INVENTORY_20190716041518.csv
AKE_US_INVENTORY_ADJ_20190717041517.csv
AKE_US_INVENTORY_ADJ_20190716041518.csv
AKE_US_PREVDAY_SHIP_20190717041518.csv
AKE_US_REFUSAL_RECEIPTS_20190717041519.csv

I want to remove the files that are not from current day...

So _20190717* is the current date...

Thanks in advance!

scasey · 07-17-2019, 06:08 PM

Quote:

Originally Posted by bloodclot

Hello,

I am downloading a bunch of files via sftp, the files look like -

AKE_US_INVENTORY_20190717041517.csv
AKE_US_INVENTORY_20190716041518.csv
AKE_US_INVENTORY_ADJ_20190717041517.csv
AKE_US_INVENTORY_ADJ_20190716041518.csv
AKE_US_PREVDAY_SHIP_20190717041518.csv
AKE_US_REFUSAL_RECEIPTS_20190717041519.csv

I want to remove the files that are not from current day...

So _20190717* is the current date...

Thanks in advance!

You have the answer already: _20190717* or _20190717*csv in your sftp command.

bloodclot · 07-17-2019, 06:19 PM

Well, the date changes.. I will download the files nightly..

I am using sshpass and scp and mget * to download all the files..

Then planned to use another script to parse the files and rm the non current date..

scasey · 07-17-2019, 06:28 PM

Quote:

Originally Posted by bloodclot

Well, the date changes.. I will download the files nightly..

I am using sshpass and scp and mget * to download all the files..

Then planned to use another script to parse the files and rm the non current date..

just don't pull the non-current date each day

Code:

mget AKE_US_INVENTORY_20190717*

The transfer will be quicker, and the logic is simpler...

You can script formatting the current date to match the format in the filename.
See man date

grail · 07-18-2019, 02:52 AM

Just to confirm, when asking for script help, it is generally expected that we will see your script so we may assist

FlinchX · 07-19-2019, 11:38 PM

Since you are going to do some scripting, why not filter files before downloading?

pan64 · 07-20-2019, 08:45 AM

additionally you used find in your other thread. This can be solved easily using find, see man page (about time related options)