Bash script to enumerate elements from csv files

Ezzmazz · 06-27-2019, 09:26 AM

Hello,

I allow me to writing here to seek your assistance about my script bash !

My csv file looks like :

Code:

FRAME_NAME1,LPAR_NAME1,25,1.0,2
FRAME_NAME2,LPAR_NAME2,12,0.8,1
FRAME_NAME1,LPAR_NAME1,25,1.0,2
FRAME_NAME3,LPAR_NAME3,0,null,0
FRAME_NAME3,LPAR_NAME3,0,null,0
FRAME_NAME3,LPAR_NAME3,0,null,0
FRAME_NAME1,LPAR_NAME1,25,1.0,2
FRAME_NAME1,LPAR_NAME1,25,1.0,2
FRAME_NAME2,LPAR_NAME2,25,1.0,2

But with 1115 lines.

I want to create a script that allow to display those informations like this :

Code:

FRAME_NAME 1 =======================
LPAR_NAME : LPAR_NAME1
RAM : XXXXX
CPU 1 : XXXXX
CPU 2 : XXXXX


LPAR_NAME : LPAR_NAME1
RAM : XXXXX
CPU 1 : XXXXX
CPU 2 : XXXXX


LPAR_NAME : LPAR_NAME1
RAM : XXXXX
CPU 1 : XXXXX
CPU 2 : XXXXX

LPAR_NAME : LPAR_NAME1
RAM : XXXXX
CPU 1 : XXXXX
CPU 2 : XXXXX

FRAME_NAME 2 =======================
LPAR_NAME : LPAR_NAME2
RAM : XXXXX
CPU 1 : XXXXX
CPU 2 : XXXXX

LPAR_NAME : LPAR_NAME2
RAM : XXXXX
CPU 1 : XXXXX
CPU 2 : XXXXX


FRAME_NAME3 =======================
LPAR_NAME : LPAR_NAME3
RAM : XXXXX
CPU 1 : XXXXX
CPU 2 : XXXXX

LPAR_NAME : LPAR_NAME3
RAM : XXXXX
CPU 1 : XXXXX
CPU 2 : XXXXX

LPAR_NAME : LPAR_NAME3
RAM : XXXXX
CPU 1 : XXXXX
CPU 2 : XXXXX

So it's just the name of the frame with below him, the list of the LPARS and his caracteristics that are in this frame.

I try to do this :

Code:

#!/bin/bash

OLDIFS=$IFS
IFS=","


while read FRAME LPARS RAM CPU1 CPU2
do
        echo -e "\e[1;33m$FRAME \
========================\e[0m\n\
        LPARS : \t$LPARS\n\
        RAM : \t$RAM\n\
        CPU1 : \t$CPU1\n\
        CPU2 : \t$CPU2\n"
done < my_csv_file.csv

But the result is an enumeration of every frames and every LPARS. However, I just want the first Frame with all thoses LPARS then the second frame with all thoses LPARS etc...

Can you show me how I can do this ?

Thanks you !

crts · 06-27-2019, 09:53 AM

See if this does what you want:

Code:

#!/usr/bin/bash

OLDIFS=$IFS
IFS=","


while read FRAME LPARS RAM CPU1 CPU2
do
        if [[ $FRAME != $PREV ]];then
                PREV="$FRAME"
echo -e "\e[1;33m$FRAME \
========================\e[0m\n"
        fi
echo -e "LPARS : \t$LPARS\n\
RAM : \t$RAM\n\
CPU1 : \t$CPU1\n\
CPU2 : \t$CPU2\n"
done < <(sort "$1")

orbea · 06-27-2019, 10:03 AM

Your list seems to be of a consistent order and cleanly eliminated with commas. Here is a quick suggestion how this could be handled.

Code:

$ foo='FRAME_NAME1,LPAR_NAME1,25,1.0,2'
$ for i in a b c d e; do eval "$i=\"${foo%%,*}\""; foo="${foo#*,}"; done
$ echo "a = $a"
a = FRAME_NAME1
$ echo "b = $b"
b = LPAR_NAME1
$ echo "c = $c"
c = 25
$ echo "d = $d"
d = 1.0
$ echo "e = $e"
e = 2

grail · 06-27-2019, 12:53 PM

As demonstrated by crts this can be done in bash, but as the data is cleanly delimited, I would choose to use awk after passing through sort

danielbmartin · 06-27-2019, 08:30 PM

With this InFile ...

Code:

FRAME_NAME1,LPAR_NAME1,25,1.0,2
FRAME_NAME2,LPAR_NAME2,12,0.8,1
FRAME_NAME1,LPAR_NAME1,25,1.0,2
FRAME_NAME3,LPAR_NAME3,1,null,0
FRAME_NAME3,LPAR_NAME3,2,null,0
FRAME_NAME3,LPAR_NAME3,3,null,0
FRAME_NAME1,LPAR_NAME1,25,1.0,2
FRAME_NAME1,LPAR_NAME1,35,1.0,2
FRAME_NAME2,LPAR_NAME2,45,1.0,2

... this awk ...

Code:

awk -F "," '{t=substr($1,1,10)" "substr($1,11)
  a[t]=a[t]"\nLPAR NAME : "$2 \
           "\nRAM : "$3       \
           "\nCPU 1 : "$4     \
           "\nCPU 2 : "$5     \
           "\n"}              \
   END{for (j in a) print j " =============" a[j]"\n"}' \
$InFile >$OutFile

... produced this OutFile ...

Code:

FRAME_NAME 1 =============
LPAR NAME : LPAR_NAME1
RAM : 25
CPU 1 : 1.0
CPU 2 : 2

LPAR NAME : LPAR_NAME1
RAM : 25
CPU 1 : 1.0
CPU 2 : 2

LPAR NAME : LPAR_NAME1
RAM : 25
CPU 1 : 1.0
CPU 2 : 2

LPAR NAME : LPAR_NAME1
RAM : 35
CPU 1 : 1.0
CPU 2 : 2


FRAME_NAME 2 =============
LPAR NAME : LPAR_NAME2
RAM : 12
CPU 1 : 0.8
CPU 2 : 1

LPAR NAME : LPAR_NAME2
RAM : 45
CPU 1 : 1.0
CPU 2 : 2


FRAME_NAME 3 =============
LPAR NAME : LPAR_NAME3
RAM : 1
CPU 1 : null
CPU 2 : 0

LPAR NAME : LPAR_NAME3
RAM : 2
CPU 1 : null
CPU 2 : 0

LPAR NAME : LPAR_NAME3
RAM : 3
CPU 1 : null
CPU 2 : 0

Daniel B. Martin

.

Ezzmazz · 07-08-2019, 09:44 AM

Hello !

I am sorry for the late reply and I thank you for your answers !

Quote:

Originally Posted by crts

See if this does what you want:

Code:

#!/usr/bin/bash

OLDIFS=$IFS
IFS=","


while read FRAME LPARS RAM CPU1 CPU2
do
        if [[ $FRAME != $PREV ]];then
                PREV="$FRAME"
echo -e "\e[1;33m$FRAME \
========================\e[0m\n"
        fi
echo -e "LPARS : \t$LPARS\n\
RAM : \t$RAM\n\
CPU1 : \t$CPU1\n\
CPU2 : \t$CPU2\n"
done < <(sort "$1")

This script works perfectly. Can you just tell me what is the $PREV variable ? I don't understand how this if condition can display one frame and his informlations bellow him !

Thank you !

individual · 07-08-2019, 10:16 AM

Quote:

Originally Posted by Ezzmazz

Hello !

I am sorry for the late reply and I thank you for your answers !

This script works perfectly. Can you just tell me what is the $PREV variable ? I don't understand how this if condition can display one frame and his informlations bellow him !

Thank you !

This is an example of one of the oddities of Bash: variables magically come into scope. To make it less confusing you could set $PREV to an empty string before the loop. If you're wondering what $PREV's purpose is, though, it allows the script to only print the frame names it hasn't encountered before. Basically it allows you to group frame items together.

Code:

#!/usr/bin/bash

OLDIFS=$IFS
IFS=","

PREV=""
while read FRAME LPARS RAM CPU1 CPU2; do
    if [[ $FRAME != $PREV ]]; then
            PREV="$FRAME"
            echo -e "\e[1;33m$FRAME \
        ========================\e[0m\n"
    fi
    echo -e "LPARS : \t$LPARS\n\
    RAM : \t$RAM\n\
    CPU1 : \t$CPU1\n\
    CPU2 : \t$CPU2\n"
done < <(sort "$1")