File splitting script

stephencassidy · 03-23-2007, 10:31 AM

Hi,

I have got a text file which contains lots of information about PDF files that are stored in a directory on our server.

The format of the file is like this

Filename:
ABC123.PDF
InfoKey: Author
InfoValue: JOAN
InfoKey: Series
InfoValue: 1A07
InfoKey: Spec
InfoValue: 8650
InfoKey: Producer
InfoValue: Acrobat Distiller 6.0.1 (Windows)
InfoKey: ModDate
InfoValue: D:20070307085652Z
InfoKey: Keywords
InfoValue: This is a Sample file, testing keywords.
InfoKey: Comp
InfoValue: TT05

I need to read the file and extract the filename and the keywords from the file and put them into another file seperate the values with a comma, this other file will then be used to populate a database. How can I achieve this?

Thanks

Stephen

cfaj · 03-23-2007, 11:28 AM

Quote:

Originally Posted by stephencassidy

Hi,

I have got a text file which contains lots of information about PDF files that are stored in a directory on our server.

The format of the file is like this

Filename:
ABC123.PDF
InfoKey: Author
InfoValue: JOAN
InfoKey: Series
InfoValue: 1A07
InfoKey: Spec
InfoValue: 8650
InfoKey: Producer
InfoValue: Acrobat Distiller 6.0.1 (Windows)
InfoKey: ModDate
InfoValue: D:20070307085652Z
InfoKey: Keywords
InfoValue: This is a Sample file, testing keywords.
InfoKey: Comp
InfoValue: TT05

I need to read the file and extract the filename and the keywords from the file and put them into another file seperate the values with a comma, this other file will then be used to populate a database. How can I achieve this?

Code:

awk '
/^Filename:/ { if ( record ) print record
               record = ""
               new=1
             }
new == 1 { record = $0; new = 0 }

sub( /^InfoValue: */, "" ) {
               ## Escape commas in field values
               gsub( ",", "\\,")
               record = record "," $0
              }

END { if ( record ) print record }' "$FILE"

Or, quoting field values:

Code:

awk '
/^Filename:/ { if ( record ) print record
               record = ""
               new=1
             }

new == 1 { record = $0; new = 0 }

sub( /^InfoValue: */, "" ) { record = record "," "\"" $0 "\"" }

END { if ( record ) print record }' "$FILE"

stephencassidy · 03-23-2007, 11:49 AM

Chris, thank you so much, I will give it a try.

Stephen

ghostdog74 · 03-23-2007, 12:09 PM

if you have Python, here's an alternative

Code:

#!/usr/bin/python

val=[]
key=[]
f = open("file")
f.readline()
filename = f.readline().strip()
for line in f:
    line = line.strip()
    if "InfoKey" in line:
        key.append(line.split(":")[1].strip())
    elif "InfoValue" in line:
        val.append(line.split(":")[1].strip())

print filename  , ' '.join(val)

output:

Code:

# ./test.py 
ABC123.PDF JOAN 1A07 8650 Acrobat Distiller 6.0.1 (Windows) D This is a Sample file, testing keywords. TT05