Hi Team,

Just wanted to address you few things of what am looking out.

We do get CSV file from developer team as I am looking for to extract the contents of CVS file into rsyslog which internally passes on to our receiver.

2) Is there any options to convert the CSV file into log file and internally passes to our receiver.

I have read many of google documentation wherein it didnot my requirement.

Can you please anybody help me out.

Thanks
Nagaraj

What do you man by "converting" ?. Are you simply wanting to send the entire file as-is to rsyslog ?. If so see "man logger".
If you want to process the data first, only you can decide on that - maybe grep or sed or awk or perl or python or ... whatever you already know.

1 members found this post helpful.

...more, I suggest you use another username because:

• here at LQ we don't answer questions by email so anybody can read answers for similar issues (s)he can have,
• any spammer could grab your email address as it's a public forum.

1 members found this post helpful.

Oh? Which links did you read??? And as others have asked, you need to provide actual details, because we have nothing to go on, based on what you posted. Best question is WHY you need to insert a CSV file into a system log. What are you actually trying to accomplish?

Why can your 'developer' not output things in syslog format, since they are *DEVELOPERS*, and write code for a living? Have you looked at the 'logger' command? Or read the documentation on rsyslog (which you mention), and the imfile directive??

Hello Team,

Thanks for your response.

Sorry for the confusion over here from my side. As I have Signed up for the first time.

1) I have received a "csv" files from "Developer Team" in which they have extracted the files from "AS400".
Request you to find the below mentioned cvs contents.

CAENTL CASEQN CACODE CAENTT CATSTP CAJOB CAUSER CANBR CAPGM CAPGMLIB CAPGMDEV CAPGMASP CARES1 CAUSPF CASYNM CARES2 CASYSSEQ CARCV CARCVLIB
6467 110951366 T CA 2018-11-19-07.52.01.411392 SRV223C REDDIP 416052 TURCWXO2 SOFTTURN *SYSBAS 1 0 REDDIP GALAXY 0 1.16643E+19 AUDRCV2607 QGPL


2) The first lines contains the header.
3) The second lines contains the contents of the data. Multiple CSV file data contains 600 lines.

Requirement : -

"All these data which is inside CSV files should be parsed into /var/log/abc.log files".

Would like to know what are all the methods can be applied to parse these data?
Is there any specific script can be developed to do this activity?

Just would like to inform you that am new to coding part. Can anybody help me out in this?

That's fine, but asking ANY question ANYWHERE without details isn't good. And please note that we don't work for your 'team'.
So then why don't you ask your 'Developer Team' to give you the data in a different format, since they write software???
There are THOUSANDS of ways to parse this data, and we cannot (and will not), even attempt to list them all. Again, as asked before, why can't your developers give you this data in whatever format you'd like?? And again, have you looked at the logger program, which inserts things into your system logs?? Also, we don't know what fields are important to you, how you want the data structured, etc. That's for you to decide.
Yes, a script CAN be developed to do this, fairly easily.
We will gladly help you...so post what you have written/done/tried so far, and tell us where you're stuck. You say you have a 'team' of developers...why can they not then help you DEVELOP something? There are also thousands of bash scripting tutorials, covering how to loop through files, split lines up based on delimiters, assign them to variables, and output the data in different formats. The tutorials at tldp.com are probably the best to get you started.

Read the "Question Guidelines" link...we will be glad to help, but we aren't going to write scripts for you.

did you check post #2 already? Is logger suitable for you? How do you want to process that data?

Hello Team,

Below is the information from CSV file.

6467 110951366 T CA 2018-11-19-07.52.01.411392 SRV223C REDDIP 416052 TURCWXO2 SOFTTURN *SYSBAS 1 0 REDDIP GALAXY 0 1.16643E+19 AUDRCV2607 QGPL *SYSBAS
6467 110951368 T CA 2018-11-19-07.52.01.417712 SRV223C REDDIP 416052 TURCWXO2 SOFTTURN *SYSBAS 1 0 REDDIP GALAXY 0 1.16643E+19 AUDRCV2607 QGPL *SYSBAS
6467 110999992 T CA 2018-11-19-08.05.36.723936 QPADEV0006 SUMITHA 415599 LSAMSAUDIT SUMITHA *SYSBAS 1 0 SUMITHA GALAXY 0 1.16643E+19 AUDRCV2607 QGPL *SYSBAS
6467 110999998 T CA 2018-11-19-08.05.36.772160 QPADEV0006 SUMITHA 415599 LSAMSAUDIT SUMITHA *SYSBAS 1 0 SUMITHA GALAXY 0 1.16643E+19 AUDRCV2607 QGPL *SYSBAS
6467 111018649 T CA 2018-11-19-08.10.31.492208 QPADEV0006 SUMITHA 415599 QSECCAJE QSYS *SYSBAS 1 0 SUMITHA GALAXY 0 1.16643E+19 AUDRCV2607 QGPL *SYSBAS
6467 111018655 T CA 2018-11-19-08.10.31.529200 QPADEV0006 SUMITHA 415599 QSECCAJE QSYS *SYSBAS 1 0 SUMITHA GALAXY 0 1.16643E+19 AUDRCV2607 QGPL *SYSBAS
6467 111018658 T CA 2018-11-19-08.10.31.553808 QPADEV0006 SUMITHA 415599 QSECCAJE QSYS *SYSBAS 1 0 SUMITHA GALAXY 0 1.16643E+19 AUDRCV2607 QGPL *SYSBAS
6467 111018659 T CA 2018-11-19-08.10.31.561376 QPADEV0006 SUMITHA 415599 QSECCAJE QSYS *SYSBAS 1 0 SUMITHA GALAXY 0 1.16643E+19 AUDRCV2607 QGPL *SYSBAS

Now we want to get these data and need to put into /var/log/abc.log file which is stored rsyslog. All these logs are parsed in MCafee Security tool.

Manually, am using the command as

logger -p local5.notice "6467 110951366 T CA 2018-11-19-07.52.01.411392 SRV223C REDDIP 416052 TURCWXO2 SOFTTURN *SYSBAS 1 0 REDDIP GALAXY 0 1.16643E+19 AUDRCV2607 QGPL *SYSBAS"

By doing this manually am able to get the data in MCAfee Security tool.

If I want to automate this process would like to know is there any mechanism to extract the data from csv file and storing into /var/log/abc.log?

where is this file coming from (and how?)

Team will generate this report from AS400.

and how did you get this file? How often? How do you know it has been changed? Which part do you want to put into log?

This report has been provided by engineering team in which they work on AS400 for audit point of view. The security team have ask them the report.

As they have provided us in CSV format.

Now I need to extract these data from CSV file and put into /var/log/abc.log files.

what do you mean by extract data from csv?

I mean to say

The data which are in CSV file needs to parse the data into /var/log/abc.log files

Again, we are NOT on your 'team' and are not your co-workers.
Right. This is what you said before. You were also asked numerous questions before, too, but haven't answered them.
AGAIN: Yes there is...that would be by **YOU** writing a script to pull out the data you're wanting, parsing it, and using the logger tool to insert it. AGAIN, we WILL NOT write your scripts for you.
AGAIN, why can you not ask your 'developer team' to actually DEVELOP something for you? Or at the very least give you the data in a different format??
So you have an 'engineering team', a 'security team', and a 'developer team'...yet the developers can't give you different data output, and the security team doesn't want to be involved in getting the data into the security logs, and the engineering team is ALREADY generating a report for the auditors/security?? So why can't the engineering team also provide a report to security?? And with all these 'teams', is there no one there that can write a fairly simple bash script??

Restating your wants/needs over and over isn't helpful. Again, we understand FULLY what you're trying to do, but AGAIN...we **WILL NOT** write your scripts for you. You were given advice, pointed to bash scripting tutorials, and given the name of a tool (which you're now using), to insert these things into system logs. It is now time for YOU to actually begin to do the work that you've been asked to do. Again, we are happy to help you if you're stuck, but you have yet to actually show any efforts of your own to get this done.

So:

• Look at ANY of the many thousands of easily found bash scripting tutorials.
• Find examples of how to read a file and loop through it until the end.
• Find examples of how to split a line apart and assign those things to variables
• Put those variables into a simple command-line that you **ALREADY HAVE** (the 'logger' line from above)

That's it. Your script is now done.

1 members found this post helpful.