Waiting for multiple files to have the same string

klmcguire · 04-07-2022, 11:59 PM

I am running multiple files with sbatch and multiple log files are output. I want my program to wait until all of the log files have a certain string. This is what I have, but it's not quite working.

while ! grep "DONE" minimization*.log
do
sleep 2
done

The asterisk represents numbers (i.e. minimization1.log, minimization2.log, etc). I need this to check all of the log files for the string DONE and then continue when all of them have it. When I run this, it will finish and continue even if all of the log files aren't finished and don't have DONE in them.

Turbocapitalist · 04-08-2022, 12:23 AM

I'm not familiar with sbatch but as for waiting for multiple log files, you can do it something like this:

Code:

for log in minimization*.log; do
      tail -F ${log} | grep -q "DONE" &
done

echo "Waiting"

wait

echo "Done waiting

If you need to catch errors from the loop or to pay attention to specific log files, then a slightly more complex approach is needed.

Edit: Or maybe the exit code from squeue -u might be of use, but as mentioned I'm not familiar with sbatch.

klmcguire · 04-08-2022, 12:54 AM

Turbocapitalist, thanks for the reply. I tested it on 3 log files with DONE on the first line, but it just keeps waiting. What am I doing wrong? Thanks!

pan64 · 04-08-2022, 01:16 AM

without telling us the details I can only tell you the problem is in line 32.

klmcguire · 04-08-2022, 01:21 AM

pan64 line 32?

Turbocapitalist · 04-08-2022, 01:22 AM

Yes. Very clearly. Please post the full script within [code] tags for more details.

klmcguire · 04-08-2022, 03:21 PM

Ok, that command does what I need. However, is there a way to stop it from printing in the terminal "tail: file has appeared ... following file"? Also stop it from printing the trigger text after the log file writes it?

One more, can the tail command be killed without using Ctrl+C? Maybe in a shell script...

teckk · 04-08-2022, 04:00 PM

Simulation:

In 1st terminal

Code:

touch mylog.log
( tail -f -n0 mylog.log & ) | grep -q "DONE"

In second teminal

Code:

for i in dog cat fish cow pig DONE bird deer; do
    echo "$i" >> mylog.log
    echo "$i"
    sleep 1
done

Turbocapitalist · 04-09-2022, 12:16 AM

Quote:

Originally Posted by klmcguire

Ok, that command does what I need. However, is there a way to stop it from printing in the terminal "tail: file has appeared ... following file"?

Yes with a redirect to /dev/null for stderr.

Quote:

Originally Posted by klmcguire

Also stop it from printing the trigger text after the log file writes it?

Yes, with -q as shown above.

Quote:

Originally Posted by klmcguire

One more, can the tail command be killed without using Ctrl+C? Maybe in a shell script...

That is more complicated. Untested:

Code:

#!/bin/sh

zap() {
        for p in ${pids}; do
                kill ${p}
        done
        exit
}

trap "zap" TERM INT

unset pids
for log in minimization*.log; do
        tail -F ${log} 2>/dev/null | grep -q "DONE" &
        pids="${pids} $!"
done

echo "Waiting"

wait

echo "Done waiting

trap - TERM INT

exit 0

See "man 7 signal" for more about signals.