awk delimeter

fantasy1215 · 03-14-2012, 08:59 PM

I have such data file. | 's ascii is 0x7C.
$cat mydatafile
0001|NameOne|60|70
I have to get the NameOne field. I use

Code:

while read line
do
	nameField=`echo $line| awk -F"|" '{print $2}'`;
	mathscore=`echo $line| awk -F"|" '{print $3}'`;
done < mydatafile

I thought it's easy. But I encounter UNICODE problem.
when the name(UNICODE) field have 0x7C, it goes wrong.
Is there any solution for this? I hope I make the problem clear. Thanks in advance!

adixon · 03-14-2012, 09:57 PM

I don't think the problem is with unicode, your code is working for me - added some output to see

Code:

#bin/sh
while read line
do
	nameField=`echo $line| awk -F"|" '{print $2}'`;
	mathscore=`echo $line| awk -F"|" '{print $3}'`;
	echo nameField is `echo $nameField`
done < test_in.txt

I get

Quote:

nameField is NameOne

If you want though, can always do

Code:

cat test_in.txt | tr -s '|' ' '

now the | chars are normal whitespace..

grail · 03-15-2012, 02:52 AM

How about just let bash do it:

Code:

#!/bin/bash

while IFS="|" read -r _ nameField mathscore _
do
    echo $nameField
    echo $mathscore
done<mydatafile