List missing files

laki47 · 03-30-2009, 07:08 AM

Hello!

In my log directory there are a lot of files:

log000001.txt
log000002.txt
...
log000123.txt
log000124.txt
log000130.txt
log000131.txt
...
log000600.txt

Notice that files between log000124.txt and log000130.txt are missing (5 files).

Now, I want to write a script that shows me the missing files (or just numbers...). It is very hard to check manually.

Thank you

eco · 03-30-2009, 08:10 AM

Try somethin in the lines of:

reviewed (messy but works).

Code:

#!/bin/bash

total=`ls -t log0000*.txt|tail -n1|cut -d. -f1|cut -dg -f2`

for i in `seq -w 1 ${total}`; do
   [ ! -f log*${i}.txt ] && echo "Missing: ${i}"
done
done

I have no access to a shell right now so this is theoretical. I'll test it with a shell in a few minutes if it doesn't work.

john test · 03-30-2009, 08:35 AM

Are the upper and lower boundries always the same? (001 and 600)?

laki47 · 03-30-2009, 08:55 AM

Quote:

Originally Posted by john test

Are the upper and lower boundries always the same? (001 and 600)?

I'm afraid not...

eco · 03-30-2009, 08:59 AM

Have you had a chance to try my script? It's basic but it should do the job as a quick fix.

laki47 · 03-30-2009, 09:04 AM

Quote:

Originally Posted by eco

Have you had a chance to try my script? It's basic but it should do the job as a quick fix.

I will be able to try it later...

Thank you

...

It is working great!

Thanks!

john test · 03-30-2009, 12:11 PM

What process triggers the writing of the log file?
Pmce you know what that process is then you can determine what causes it to either write or not write the Lov file.
Then you can make that process increment a counter no matter what the descision was and that will give you the end point.
you need an endpoint so you can deal with the case where the process failed to write a log file for the last N instances after the last log file was written. e.g. 601, 602 etc.

schneidz · 03-30-2009, 12:58 PM

this mite work
[untested]

Code:

for i in `seq 1 999999`
do
 zero-pad-2.x $i
done > list.num

ls -1 log*.txt | cut -b 4-9 > log.lst

grep -v -f list.num log.lst
# diff list.num log.lst

source to zero-pad-2.c:

Code:

#include "stdio.h"
#include "string.h"
 
 
char *strrev(char *s){
    char *p=s;
    char *q =s;
    char swap;
    if (*s)
    {
        q=strchr(q,'\0');
        while (--q > p)
        {
            swap = *q;
            *q = *p;
            *p = swap;
            ++p;
        }
    }
    return s;
}
 
 
main(int argc, char *argv[])
{
        char col1[255], col2[255];
        int c;
 
         while(strlen(argv[1]) < 2)
         {
          strcpy(argv[1], strrev(argv[1]));
          strcat(argv[1], "0");
          strcpy(argv[1], strrev(argv[1]));
         }
         printf("%s\n", argv[1]);
}