[SOLVED] Remove white space, +, and -, by awk

dhodho · 05-18-2011, 01:36 AM

Hi, everyone

I have some data whose no certain pattern. Below is as an example.

20110101 1+1-0 1-1 1+1-2 8- 5 3 0 3 4 5 3 7 4
20110102 1+2-0+1-1-1+2-1+ 9 5 6 2 3 3 5 6 5 4
20110103 1-1-0+1 1 2 2 2+10 3 3 2 4 4 7 7 9 5
20110104 1+3-1 1 1+2-2-1-11+ 5 12 4 4 5 6 6 3 6
20110105 0 0 0 1-1-1-1+1 4+ 0 0 0 3 3 3 5 4 2
20110106 1+0+0 0+0+1 2 4+10- 5 2 0 2 2 4 7 32 7

I want to remove space, + and - mark so that I can get the below such data :

20110101 1 1 0 1 1 1 1 2 8 5 3 0 3 4 5 3 7 4
20110102 1 2 0 1 1 1 2 1 9 5 6 2 3 3 5 6 5 4
20110103 1 1 0 1 1 2 2 2 10 3 3 2 4 4 7 7 9 5
20110104 1 3 1 1 1 2 2 1 11 5 12 4 4 5 6 6 3 6
20110105 0 0 0 1 1 1 1 1 4 0 0 0 3 3 3 5 4 2
20110106 1 0 0 0 0 1 2 4 10 5 2 0 2 2 4 7 32 7

Is it possible by using awk? Thanks very much for advance.

Regards,
dhodho

EricTRA · 05-18-2011, 01:44 AM

Hello,

I'm sure it's possible using awk, sed and lots of other tools. This one is by far the simplest I think:

Code:

cat yourfile | tr "+,-" " "

which will print the contents of yourfile to your screen. If you want it in a file then redirect the output.

Kind regards,

Eric

Telengard · 05-18-2011, 01:48 AM

You say you want to remove spaces, but your output data contains spaces. I'm not sure I understand.

Code:

foo$ cat input-file.txt
20110101 1+1-0 1-1 1+1-2 8- 5 3 0 3 4 5 3 7 4
20110102 1+2-0+1-1-1+2-1+ 9 5 6 2 3 3 5 6 5 4
20110103 1-1-0+1 1 2 2 2+10 3 3 2 4 4 7 7 9 5
20110104 1+3-1 1 1+2-2-1-11+ 5 12 4 4 5 6 6 3 6
20110105 0 0 0 1-1-1-1+1 4+ 0 0 0 3 3 3 5 4 2
20110106 1+0+0 0+0+1 2 4+10- 5 2 0 2 2 4 7 32 7

foo$ awk '{gsub(/ +|[+-]/," ");print}' input-file.txt
20110101 1 1 0 1 1 1 1 2 8  5 3 0 3 4 5 3 7 4
20110102 1 2 0 1 1 1 2 1  9 5 6 2 3 3 5 6 5 4
20110103 1 1 0 1 1 2 2 2 10 3 3 2 4 4 7 7 9 5
20110104 1 3 1 1 1 2 2 1 11  5 12 4 4 5 6 6 3 6
20110105 0 0 0 1 1 1 1 1 4  0 0 0 3 3 3 5 4 2
20110106 1 0 0 0 0 1 2 4 10  5 2 0 2 2 4 7 32 7

The output data block exactly matches your example output data block.

HTH

dhodho · 05-18-2011, 03:04 AM

Quote:

Originally Posted by Telengard

You say you want to remove spaces, but your output data contains spaces. I'm not sure I understand.

Code:

foo$ cat input-file.txt
20110101 1+1-0 1-1 1+1-2 8- 5 3 0 3 4 5 3 7 4
20110102 1+2-0+1-1-1+2-1+ 9 5 6 2 3 3 5 6 5 4
20110103 1-1-0+1 1 2 2 2+10 3 3 2 4 4 7 7 9 5
20110104 1+3-1 1 1+2-2-1-11+ 5 12 4 4 5 6 6 3 6
20110105 0 0 0 1-1-1-1+1 4+ 0 0 0 3 3 3 5 4 2
20110106 1+0+0 0+0+1 2 4+10- 5 2 0 2 2 4 7 32 7

foo$ awk '{gsub(/ +|[+-]/," ");print}' input-file.txt
20110101 1 1 0 1 1 1 1 2 8  5 3 0 3 4 5 3 7 4
20110102 1 2 0 1 1 1 2 1  9 5 6 2 3 3 5 6 5 4
20110103 1 1 0 1 1 2 2 2 10 3 3 2 4 4 7 7 9 5
20110104 1 3 1 1 1 2 2 1 11  5 12 4 4 5 6 6 3 6
20110105 0 0 0 1 1 1 1 1 4  0 0 0 3 3 3 5 4 2
20110106 1 0 0 0 0 1 2 4 10  5 2 0 2 2 4 7 32 7

The output data block exactly matches your example output data block.

HTH

Thanks very much for your quick response. Yes, you are right. The output which I want to is the same as your output. I also tried below code :

Code:

awk '{gsub(/[+-]/," ");print}' input-file.txt

The code gave the same result with your result. If you don't mind could you give some explanation about

Code:

/ +|[+-]/

in your code? Thanks very much.

grail · 05-18-2011, 05:01 AM

Quote:

/ +|[+-]/

One or more spaces or a plus or minus

Alternative:

Code:

awk -F"[ -+]*" '$1=$1' file

MTK358 · 05-18-2011, 06:56 AM

Code:

sed 's/[-+ ]\+/ /g'

syg00 · 05-18-2011, 07:14 AM

Personally I always use a class for whitespace ...

dhodho · 05-18-2011, 10:12 PM

Quote:

Originally Posted by grail

One or more spaces or a plus or minus

Alternative:

Code:

awk -F"[ -+]*" '$1=$1' file

Thanks very much for your reply. Now, it is clear for me.