Script to export details to excel - URGENT

druuna · 01-02-2014, 03:47 PM

Quote:

Originally Posted by schneidz

excel files are proprietary binary format (although ms-excel can also read csv files which are ascii text seperated by commas).

You are correct.

I had importing an ascii text file in mind (which seems to be the general context). I should have formulated that a bit different, I agree.

John VV · 01-02-2014, 03:57 PM

MS's office formats are basically ram dumps

MS's Excel or OO's Calc has NO problem with importing
"coma separated value" whether it is a Coma or a blank space or a "#" or a " . "

a lot of software i use outputs to blank space CSV files
( ascii files of photos )

perumal07 · 01-04-2014, 12:04 PM

HI Gabriel linux-romania.com Thank u so much for the script i did modify a lot based on my data's and need its working really wonderful. Thank u so much for understanding and giving me the right solutions. I am facing only one issue which is in a username field if i have a name like ( username: wiki john c ) it export only the last word to excel which is ( c ). So i am working on the same. I am really sorry if i waste any of your time as i am stuck with lots of stuffs and travel i am not able to reply.

perumal07 · 01-04-2014, 12:09 PM

Quote:

Originally Posted by yo8rxp

sorry but i just made ya a free gift. power is where knoledge is...therefore stop wasting your and other good ppl time. it is simply not fair!
made and tested that script for ya in 20 minutes. it simply works !
all u got to do was to add multiple rules as i explained into script.
shame on you !

Thanks for your help i am working on this and i am engaged with some work and travel.

perumal07 · 01-04-2014, 12:15 PM

Quote:

Originally Posted by druuna

You are correct.

I had importing an ascii text file in mind (which seems to be the general context). I should have formulated that a bit different, I agree.

I explained your but the output which i need and try to get is little bit challenging that's why i ask you guys to help me i tried awk, and grep scripts which i know basically it descent help me much.

yo8rxp · 01-04-2014, 01:13 PM

perumal07

you still aint get it .. I wrote that script for you , look in 1-st page .. all you have got to do is to follow my instructions , all you need is to look for pattern there and add more scan options ,, it is simply as that !

It is based on grep and sed , but is creates new.csv file as you want.... DID YOU EVER TRY IT ?

perumal07 · 01-05-2014, 09:04 AM

Quote:

Originally Posted by yo8rxp

perumal07

you still aint get it .. I wrote that script for you , look in 1-st page .. all you have got to do is to follow my instructions , all you need is to look for pattern there and add more scan options ,, it is simply as that !

It is based on grep and sed , but is creates new.csv file as you want.... DID YOU EVER TRY IT ?

#!/bin/bash
rm new.csv
rm tmp.file
## Begin header ##
echo "name", "company", "givenName", "sn", "l", "ou", "pager", "TelephoneNumber", "COSId", "ForwardingAddress", "mail" >> new.csv

## End header

function search {
## Add here next variables , have to substitute values ###
name=$(cat tmp.file | grep 'name' | sed -e 's/* //g' -e 's/# name //g')
company=$(cat tmp.file | grep 'company' | sed -e 's/* //g' -e 's/company: //g')
givenName=$(cat tmp.file | grep 'givenName' | sed -e 's/* //g' -e 's/givenName: //g')
sn=$(cat tmp.file | grep 'sn:' | sed -e 's/* //g' -e 's/sn: //g')
l=$(cat tmp.file | grep 'l:' |grep -v 'zimbra' | grep -v 'mail' | sed -e 's/* //g' -e 's/l: //g')
ou=$(cat tmp.file | grep 'ou:' | sed -e 's/* //g' -e 's/ou: //g' )
pager=$(cat tmp.file | grep 'pager' | sed -e 's/* //g' -e 's/pager: //g')
TelephoneNumber=$(cat tmp.file | grep 'TelephoneNumber' | sed -e 's/* //g' -e 's/TelephoneNumber: //g')
COSId=$(cat tmp.file | grep 'COSId' | sed -e 's/* //g' -e 's/COSId: //g')
ForwardingAddress=$(cat tmp.file | grep 'ForwardingAddress' | sed -e 's/* //g' -e 's/zimbraPrefMailForwardingAddress: //g')
mail=$(cat tmp.file | grep 'mail' |grep -v 'zip' | sed -e 's/* //g' -e 's/mail: //g')

## Populate new file rows ##
echo "$name", "$company", "$givenName", "$sn", "$l", "$ou", "$pager", "$TelephoneNumber", "$COSId", "$ForwardingAddress", "$mail" >> new.csv
}

lenght=$(cat file.txt |wc -l)
for line in `seq 1 $lenght`
do
if [ "$(sed ''$line'!d' file.txt)" != "" ] ; then echo $(sed ''$line'!d' file.txt) >> tmp.file ; else search ; echo "" > tmp.file
fi
echo $line
done
rm tmp.file

while running the script i get this error

sed ''$line'!d' file.txt
sed ''$line'!d' file.txt
378
sed ''$line'!d' file.txt
sed ''$line'!d' file.txt
379
sed ''$line'!d' file.txt
sed ''$line'!d' file.txt
380
sed ''$line'!d' file.txt
sed ''$line'!d' file.txt

Sample data in file :-

# name perumal
cn: Perumal
company: test
displayName: Pandey
facsimileTelephoneNumber: 100
givenName: ndra
l: Indofil
mail: perumal@gmail.com
ou: Super
pager: 4A
sn: Pandey
street: costal
uid: perumal
AccountStatus: active
Id: 4bc494e8-ce96-4b21
ContactEmailFields: email,email2,email3,email4,email5,email6,email7,email8,email9,email10,workEmail1,workEmail2,workEmai l3

# name perumal
cn: Perumal
company: test
displayName: Pandey
facsimileTelephoneNumber: 100
givenName: ndra
l: Indofil
mail: perumal@gmail.com
ou: Super
pager: 4A
sn: Pandey
street: costal
uid: perumal
AccountStatus: active
Id: 4bc494e8-ce96-4b21
ContactEmailFields: email,email2,email3,email4,email5,email6,email7,email8,email9,email10,workEmail1,workEmail2,workEmai l3

# name perumal
cn: Perumal
company: test
displayName: Pandey
TelephoneNumber: 100
givenName: ndra
l: Indofil
mail: perumal@gmail.com
ou: Super
pager: 4A
sn: Pandey
street: costal
uid: perumal
AccountStatus: active
Id: 4bc494e8-ce96-4b21
ContactEmailFields: email,email2,email3,email4,email5,email6,email7,email8,email9,email10,workEmail1,workEmail2,workEmai l3

druuna · 01-05-2014, 11:06 AM

Code:

awk 'BEGIN { FS="[\n]" ; RS="\n\n[\n]*"
printf("%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s\n", "name", "company", "givenName", "sn", "l", "ou", "pager", "TelephoneNumber", "COSId", "ForwardingAddress", "mail") }
{ gsub(/[A-Za-z0-9]*: /,"",$0) ; printf("%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s\n", $2, $3, $6, $11, $7, $9, $10, $5, $15, $12, $8) }
' infile > out.csv

perumal07 · 01-06-2014, 10:58 AM

Quote:

Originally Posted by druuna

Code:

awk 'BEGIN { FS="[\n]" ; RS="\n\n[\n]*"
printf("%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s\n", "name", "company", "givenName", "sn", "l", "ou", "pager", "TelephoneNumber", "COSId", "ForwardingAddress", "mail") }
{ gsub(/[A-Za-z0-9]*: /,"",$0) ; printf("%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s\n", $2, $3, $6, $11, $7, $9, $10, $5, $15, $12, $8) }
' infile > out.csv

thanks for the reply friend but this script is not working. properly for me can u explain how it works pls so if needed i can do some modifications based on that

druuna · 01-06-2014, 11:08 AM

It works perfectly:

Code:

$ cat infile
# name perumal
cn: Perumal
company: test
displayName: Pandey
facsimileTelephoneNumber: 100
givenName: ndra
l: Indofil 
mail: perumal@gmail.com
ou: Super
pager: 4A
sn: Pandey
street: costal
uid: perumal
AccountStatus: active
Id: 4bc494e8-ce96-4b21
ContactEmailFields: email,email2,email3,email4,email5,email6,email7,email8,email9,email10,workEmail1,workEmail2,workEmai l3

# name perumal
cn: Perumal
company: test
displayName: Pandey
facsimileTelephoneNumber: 100
givenName: ndra
l: Indofil 
mail: perumal@gmail.com
ou: Super
pager: 4A
sn: Pandey
street: costal
uid: perumal
AccountStatus: active
Id: 4bc494e8-ce96-4b21
ContactEmailFields: email,email2,email3,email4,email5,email6,email7,email8,email9,email10,workEmail1,workEmail2,workEmai l3


# name perumal
cn: Perumal
company: test
displayName: Pandey
TelephoneNumber: 100
givenName: ndra
l: Indofil 
mail: perumal@gmail.com
ou: Super
pager: 4A
sn: Pandey
street: costal
uid: perumal
AccountStatus: active
Id: 4bc494e8-ce96-4b21
ContactEmailFields: email,email2,email3,email4,email5,email6,email7,email8,email9,email10,workEmail1,workEmail2,workEmai l3

The above is the input you gave in post #22

Example run:

Code:

$ awk 'BEGIN { FS="[\n]" ; RS="\n\n[\n]*" printf("%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s\n", "name", "company", "givenName", "sn", "l", "ou", "pager", "TelephoneNumber", "COSId", "ForwardingAddress", "mail") }
{ gsub(/[A-Za-z0-9]*: /,"",$0) ; printf("%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s\n", $2, $3, $6, $11, $7, $9, $10, $5, $15, $12, $8) }
' infile > out.csv

$ cat out.csv 
name,company,givenName,sn,l,ou,pager,TelephoneNumber,COSId,ForwardingAddress,mail
Perumal,test,ndra,Pandey,Indofil ,Super,4A,100,4bc494e8-ce96-4b21,costal,perumal@gmail.com
Perumal,test,ndra,Pandey,Indofil ,Super,4A,100,4bc494e8-ce96-4b21,costal,perumal@gmail.com
Perumal,test,ndra,Pandey,Indofil ,Super,4A,100,4bc494e8-ce96-4b21,costal,perumal@gmail.com

- The blue part prints the comma separated header, as shown by you in post #22.
- The green part prints the wanted fields. Comma separated and in the order shown by you in post #22

perumal07 · 01-07-2014, 12:07 AM

Quote:

Originally Posted by druuna

It works perfectly:

Code:

$ cat infile
# name perumal
cn: Perumal
company: test
displayName: Pandey
facsimileTelephoneNumber: 100
givenName: ndra
l: Indofil 
mail: perumal@gmail.com
ou: Super
pager: 4A
sn: Pandey
street: costal
uid: perumal
AccountStatus: active
Id: 4bc494e8-ce96-4b21
ContactEmailFields: email,email2,email3,email4,email5,email6,email7,email8,email9,email10,workEmail1,workEmail2,workEmai l3

# name perumal
cn: Perumal
company: test
displayName: Pandey
facsimileTelephoneNumber: 100
givenName: ndra
l: Indofil 
mail: perumal@gmail.com
ou: Super
pager: 4A
sn: Pandey
street: costal
uid: perumal
AccountStatus: active
Id: 4bc494e8-ce96-4b21
ContactEmailFields: email,email2,email3,email4,email5,email6,email7,email8,email9,email10,workEmail1,workEmail2,workEmai l3


# name perumal
cn: Perumal
company: test
displayName: Pandey
TelephoneNumber: 100
givenName: ndra
l: Indofil 
mail: perumal@gmail.com
ou: Super
pager: 4A
sn: Pandey
street: costal
uid: perumal
AccountStatus: active
Id: 4bc494e8-ce96-4b21
ContactEmailFields: email,email2,email3,email4,email5,email6,email7,email8,email9,email10,workEmail1,workEmail2,workEmai l3

The above is the input you gave in post #22

Example run:

Code:

$ awk 'BEGIN { FS="[\n]" ; RS="\n\n[\n]*" printf("%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s\n", "name", "company", "givenName", "sn", "l", "ou", "pager", "TelephoneNumber", "COSId", "ForwardingAddress", "mail") }
{ gsub(/[A-Za-z0-9]*: /,"",$0) ; printf("%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s\n", $2, $3, $6, $11, $7, $9, $10, $5, $15, $12, $8) }
' infile > out.csv

$ cat out.csv 
name,company,givenName,sn,l,ou,pager,TelephoneNumber,COSId,ForwardingAddress,mail
Perumal,test,ndra,Pandey,Indofil ,Super,4A,100,4bc494e8-ce96-4b21,costal,perumal@gmail.com
Perumal,test,ndra,Pandey,Indofil ,Super,4A,100,4bc494e8-ce96-4b21,costal,perumal@gmail.com
Perumal,test,ndra,Pandey,Indofil ,Super,4A,100,4bc494e8-ce96-4b21,costal,perumal@gmail.com

- The blue part prints the comma separated header, as shown by you in post #22.
- The green part prints the wanted fields. Comma separated and in the order shown by you in post #22

Thank you Its working fine. And can u tell me why the script i posted is not working. i have error sed ''$line'!d' file.txt. I can use that script for my other process as well.

druuna · 01-07-2014, 08:18 AM

Quote:

Originally Posted by perumal07

can u tell me why the script i posted is not working.

No.

Re-read the following:
- post #2, - post #6, - post #11

In other words: If you don't provide accurate information we can not help you.

My previous example and the following both work on the example given in post #22:

Code:

#!/bin/bash
function search {
  cn=$( sed -n '/^cn: /s/cn: //p' tmp.file )
  company=$( sed -n '/^company: /s/company: //p' tmp.file )
  name=$( sed -n '/^givenName: /s/givenName: //p' tmp.file )
  sn=$( sed -n '/^sn: /s/sn: //p' tmp.file )
  l=$( sed -n '/^l: /s/l: //p' tmp.file )
  ou=$( sed -n '/^ou: /s/ou: //p' tmp.file )
  pager=$( sed -n '/^pager: /s/pager: //p' tmp.file )
  telephone=$( sed -n '/TelephoneNumber: /s/.*TelephoneNumber: //p' tmp.file )
  id=$( sed -n '/^Id: /s/Id: //p' tmp.file )
  street=$( sed -n '/^street: /s/street: //p' tmp.file )
  mail=$( sed -n '/^mail: /s/mail: //p' tmp.file )
  echo "$cn,$company,$name,$sn,$l,$ou,$pager,$telephone,$id,$street,$mail" >> new.csv
}
echo "cn,company,name,sn,l,ou,pager,telephone,id,street,mail" > new.csv
while read LINE
do
  [[ "$LINE" =~ "# " ]] && > tmp.file
  echo "$LINE" >> tmp.file
  [[ "$LINE" =~ "ContactEmailFields: " ]] && search
done < perumal07.in
rm tmp.file

perumal07 · 01-07-2014, 09:43 AM

Quote:

Originally Posted by druuna

No.

Re-read the following:
- post #2, - post #6, - post #11

In other words: If you don't provide accurate information we can not help you.

My previous example and the following both work on the example given in post #22:

Code:

#!/bin/bash
function search {
  cn=$( sed -n '/^cn: /s/cn: //p' tmp.file )
  company=$( sed -n '/^company: /s/company: //p' tmp.file )
  name=$( sed -n '/^givenName: /s/givenName: //p' tmp.file )
  sn=$( sed -n '/^sn: /s/sn: //p' tmp.file )
  l=$( sed -n '/^l: /s/l: //p' tmp.file )
  ou=$( sed -n '/^ou: /s/ou: //p' tmp.file )
  pager=$( sed -n '/^pager: /s/pager: //p' tmp.file )
  telephone=$( sed -n '/telephone: /s/.*telephone: //p' tmp.file )
  id=$( sed -n '/^Id: /s/Id: //p' tmp.file )
  street=$( sed -n '/^street: /s/street: //p' tmp.file )
  mail=$( sed -n '/^mail: /s/mail: //p' tmp.file )
  echo "$cn,$company,$name,$sn,$l,$ou,$pager,$telephone,$id,$street,$mail" >> new.csv
}
echo "cn,company,name,sn,l,ou,pager,telephone,id,street,mail" > new.csv
while read LINE
do
  [[ "$LINE" =~ "# " ]] && > tmp.file
  echo "$LINE" >> tmp.file
  [[ "$LINE" =~ "ContactEmailFields: " ]] && search
done < perumal07.in
rm tmp.file

Thank you

will work on this and update you

perumal07 · 01-09-2014, 06:10 AM

i want export this datas to a excel in colums

Email ID: akumar@gmail.com
Host1 Nb messages: 2937 messages
Host1 Total size: 798174215 bytes (761.198 MiB)
Host2 Total size: 1036021415 bytes (988.027 MiB)
Host1 Nb messages: 2937 messages
Host1 Total size: 798174215 bytes (761.198 MiB)
Host2 Total size: 1036595954 bytes (988.575 MiB)
Transfer started on : Thu Jan 9 01:37:25 2014
Transfer ended on : Thu Jan 9 01:40:06 2014
Transfer time : 160.4 sec
Messages transferred : 18
Messages skipped : 2918
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Host1 Nb messages: 2939 messages
Host1 Total size: 798219691 bytes (761.242 MiB)
Host2 Total size: 1036595954 bytes (988.575 MiB)
Host1 Nb messages: 2939 messages
Host1 Total size: 798219691 bytes (761.242 MiB)
Host2 Total size: 1036645648 bytes (988.622 MiB)
Transfer started on : Thu Jan 9 12:18:50 2014
Transfer ended on : Thu Jan 9 12:21:29 2014
Transfer time : 158.9 sec
Messages transferred : 2
Messages skipped : 2936
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 1
Email ID: amber@gmail.com
amber-cb@gmail.com
Host1 Nb messages: 16439 messages
Host1 Total size: 2021649612 bytes (1.883 GiB)
Host2 Total size: 0 bytes (0.000 KiB)
Host1 Nb messages: 16439 messages
Host1 Total size: 2021649612 bytes (1.883 GiB)
Host2 Total size: 1839128035 bytes (1.713 GiB)
Transfer started on : Wed Jan 8 21:51:33 2014
Transfer ended on : Thu Jan 9 01:37:25 2014
Transfer time : 13551.9 sec
Messages transferred : 16433
Messages skipped : 6
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 6
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Host1 Nb messages: 16455 messages
Host1 Total size: 2023815900 bytes (1.885 GiB)
Host2 Total size: 2631111635 bytes (2.450 GiB)
Host1 Nb messages: 16457 messages
Host1 Total size: 2023849764 bytes (1.885 GiB)
Host2 Total size: 2633870429 bytes (2.453 GiB)
Transfer started on : Thu Jan 9 12:06:58 2014
Transfer ended on : Thu Jan 9 12:18:49 2014
Transfer time : 711.1 sec
Messages transferred : 17
Messages skipped : 16439
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 6
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID: anand@gmail.com
Host1 Nb messages: 415 messages
Host1 Total size: 207873325 bytes (198.243 MiB)
Host2 Total size: 264141133 bytes (251.905 MiB)
Host1 Nb messages: 415 messages
Host1 Total size: 207873325 bytes (198.243 MiB)
Host2 Total size: 282465573 bytes (269.380 MiB)
Transfer started on : Thu Jan 9 04:04:22 2014
Transfer ended on : Thu Jan 9 04:05:49 2014
Transfer time : 86.4 sec
Messages transferred : 29
Messages skipped : 386
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 0
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Host1 Nb messages: 417 messages
Host1 Total size: 207918799 bytes (198.287 MiB)
Host2 Total size: 282465573 bytes (269.380 MiB)
Host1 Nb messages: 417 messages
Host1 Total size: 207918799 bytes (198.287 MiB)
Host2 Total size: 282525317 bytes (269.437 MiB)
Transfer started on : Thu Jan 9 12:36:54 2014
Transfer ended on : Thu Jan 9 12:37:22 2014
Transfer time : 27.8 sec
Messages transferred : 2
Messages skipped : 415
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 0
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID: antara@gmail.com
Host1 Nb messages: 3434 messages
Host1 Total size: 2149605111 bytes (2.002 GiB)
Host2 Total size: 2981137429 bytes (2.776 GiB)
Host1 Nb messages: 3434 messages
Host1 Total size: 2149605111 bytes (2.002 GiB)
Host2 Total size: 2981144122 bytes (2.776 GiB)
Transfer started on : Wed Jan 8 21:47:53 2014
Transfer ended on : Wed Jan 8 21:51:33 2014
Transfer time : 219.6 sec
Messages transferred : 3
Messages skipped : 3423
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 8
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Host1 Nb messages: 3435 messages
Host1 Total size: 2149606681 bytes (2.002 GiB)
Host2 Total size: 2981144122 bytes (2.776 GiB)
Host1 Nb messages: 3435 messages
Host1 Total size: 2149606681 bytes (2.002 GiB)
Host2 Total size: 2981146353 bytes (2.776 GiB)
Transfer started on : Thu Jan 9 12:03:48 2014
Transfer ended on : Thu Jan 9 12:06:58 2014
Transfer time : 190.3 sec
Messages transferred : 1
Messages skipped : 3426
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 8
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID: asengupta@gmail.com
Host1 Nb messages: 1688 messages
Host1 Total size: 1053997430 bytes (0.982 GiB)
Host2 Total size: 1424787291 bytes (1.327 GiB)
Host1 Nb messages: 1688 messages
Host1 Total size: 1053997430 bytes (0.982 GiB)
Host2 Total size: 1439272385 bytes (1.340 GiB)
Transfer started on : Thu Jan 9 01:40:06 2014
Transfer ended on : Thu Jan 9 01:45:18 2014
Transfer time : 312.3 sec
Messages transferred : 82
Messages skipped : 1606
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Host1 Nb messages: 1694 messages
Host1 Total size: 1055903129 bytes (0.983 GiB)
Host2 Total size: 1439272385 bytes (1.340 GiB)
Host1 Nb messages: 1694 messages
Host1 Total size: 1055903129 bytes (0.983 GiB)
Host2 Total size: 1440249937 bytes (1.341 GiB)
Transfer started on : Thu Jan 9 12:21:29 2014
Transfer ended on : Thu Jan 9 12:23:27 2014
Transfer time : 118.3 sec
Messages transferred : 6
Messages skipped : 1688
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 20
Email ID: asrivastava@gmail.com
Host1 Nb messages: 5884 messages
Host1 Total size: 1713572161 bytes (1.596 GiB)
Host2 Total size: 460852416 bytes (439.503 MiB)
Host1 Nb messages: 5884 messages
Host1 Total size: 1713572161 bytes (1.596 GiB)
Host2 Total size: 1079819714 bytes (1.006 GiB)
Transfer started on : Thu Jan 9 01:50:34 2014
Transfer ended on : Thu Jan 9 03:53:47 2014
Transfer time : 7392.9 sec
Messages transferred : 4594
Messages skipped : 1284
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 555
Messages void (noheader) on host2 : 675
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Host1 Nb messages: 5894 messages
Host1 Total size: 1716974047 bytes (1.599 GiB)
Host2 Total size: 2381019963 bytes (2.217 GiB)
Host1 Nb messages: 5894 messages
Host1 Total size: 1716974047 bytes (1.599 GiB)
Host2 Total size: 2357511432 bytes (2.196 GiB)
Transfer started on : Thu Jan 9 12:26:24 2014
Transfer ended on : Thu Jan 9 12:32:10 2014
Transfer time : 346.5 sec
Messages transferred : 11
Messages skipped : 5877
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 555
Messages void (noheader) on host2 : 675
Messages deleted on host1 : 0
Messages deleted on host2 : 59
Email ID:
Host1 Nb messages: 4629 messages
Host1 Total size: 2613661019 bytes (2.434 GiB)
Host2 Total size: 2626339300 bytes (2.446 GiB)
Host1 Nb messages: 4631 messages
Host1 Total size: 2615056412 bytes (2.435 GiB)
Host2 Total size: 2627196348 bytes (2.447 GiB)
Transfer started on : Thu Jan 9 11:18:13 2014
Transfer ended on : Thu Jan 9 11:57:12 2014
Transfer time : 2338.4 sec
Messages transferred : 3
Messages skipped : 4626
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 0
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID:
Host1 Nb messages: 1632 messages
Host1 Total size: 400165654 bytes (381.628 MiB)
Host2 Total size: 404876067 bytes (386.120 MiB)
Host1 Nb messages: 1632 messages
Host1 Total size: 400165654 bytes (381.628 MiB)
Host2 Total size: 404902486 bytes (386.145 MiB)
Transfer started on : Thu Jan 9 11:01:42 2014
Transfer ended on : Thu Jan 9 11:04:38 2014
Transfer time : 175.3 sec
Messages transferred : 3
Messages skipped : 1629
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 0
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID:
Host1 Nb messages: 163 messages
Host1 Total size: 73989950 bytes (70.562 MiB)
Host2 Total size: 73989950 bytes (70.562 MiB)
Host1 Nb messages: 163 messages
Host1 Total size: 73989950 bytes (70.562 MiB)
Host2 Total size: 73989950 bytes (70.562 MiB)
Transfer started on : Thu Jan 9 11:01:26 2014
Transfer ended on : Thu Jan 9 11:01:42 2014
Transfer time : 16.5 sec
Messages transferred : 0
Messages skipped : 163
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 0
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID:
Host1 Nb messages: 6027 messages
Host1 Total size: 849995990 bytes (810.619 MiB)
Host2 Total size: 860308551 bytes (820.454 MiB)
Host1 Nb messages: 6028 messages
Host1 Total size: 850022828 bytes (810.645 MiB)
Host2 Total size: 851026822 bytes (811.602 MiB)
Transfer started on : Thu Jan 9 10:59:00 2014
Transfer ended on : Thu Jan 9 11:10:22 2014
Transfer time : 682.0 sec
Messages transferred : 10
Messages skipped : 6017
Messages found duplicate on host1 : 6
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 0
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 94
Host1 Nb messages: 6028 messages
Host1 Total size: 850022828 bytes (810.645 MiB)
Host2 Total size: 851026822 bytes (811.602 MiB)
Host1 Nb messages: 6028 messages
Host1 Total size: 850022828 bytes (810.645 MiB)
Host2 Total size: 851053660 bytes (811.628 MiB)
Transfer started on : Thu Jan 9 11:20:58 2014
Transfer ended on : Thu Jan 9 11:22:40 2014
Transfer time : 101.2 sec
Messages transferred : 1
Messages skipped : 6027
Messages found duplicate on host1 : 6
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 0
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID:
Host1 Nb messages: 3370 messages
Host1 Total size: 496407958 bytes (473.412 MiB)
Host2 Total size: 496952414 bytes (473.931 MiB)
Host1 Nb messages: 3370 messages
Host1 Total size: 496407958 bytes (473.412 MiB)
Host2 Total size: 496952414 bytes (473.931 MiB)
Transfer started on : Thu Jan 9 11:19:30 2014
Transfer ended on : Thu Jan 9 11:20:58 2014
Transfer time : 88.2 sec
Messages transferred : 0
Messages skipped : 3370
Messages found duplicate on host1 : 3
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 0
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID: kuldeep@gmail.com
Host1 Nb messages: 1544 messages
Host1 Total size: 222912362 bytes (212.586 MiB)
Host2 Total size: 389357580 bytes (371.320 MiB)
Host1 Nb messages: 1544 messages
Host1 Total size: 222912362 bytes (212.586 MiB)
Host2 Total size: 304932282 bytes (290.806 MiB)
Transfer started on : Thu Jan 9 11:46:23 2014
Transfer ended on : Thu Jan 9 11:47:57 2014
Transfer time : 93.9 sec
Messages transferred : 1
Messages skipped : 1543
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1
Messages void (noheader) on host2 : 1
Messages deleted on host1 : 0
Messages deleted on host2 : 415
Email ID: manoj@gmail.com
Host1 Nb messages: 3844 messages
Host1 Total size: 591211309 bytes (563.823 MiB)
Host2 Total size: 773067053 bytes (737.254 MiB)
Host1 Nb messages: 3844 messages
Host1 Total size: 591211309 bytes (563.823 MiB)
Host2 Total size: 805451938 bytes (768.139 MiB)
Transfer started on : Thu Jan 9 04:05:49 2014
Transfer ended on : Thu Jan 9 04:12:58 2014
Transfer time : 428.6 sec
Messages transferred : 70
Messages skipped : 3772
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1660
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Host1 Nb messages: 3851 messages
Host1 Total size: 591469803 bytes (564.070 MiB)
Host2 Total size: 805451938 bytes (768.139 MiB)
Host1 Nb messages: 3851 messages
Host1 Total size: 591469803 bytes (564.070 MiB)
Host2 Total size: 805770170 bytes (768.442 MiB)
Transfer started on : Thu Jan 9 12:37:22 2014
Transfer ended on : Thu Jan 9 12:43:54 2014
Transfer time : 391.7 sec
Messages transferred : 7
Messages skipped : 3842
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1660
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID: mohan@gmail.com
Host1 Nb messages: 716 messages
Host1 Total size: 78942178 bytes (75.285 MiB)
Host2 Total size: 123787722 bytes (118.053 MiB)
Host1 Nb messages: 716 messages
Host1 Total size: 78942178 bytes (75.285 MiB)
Host2 Total size: 124207112 bytes (118.453 MiB)
Transfer started on : Thu Jan 9 04:12:58 2014
Transfer ended on : Thu Jan 9 04:13:45 2014
Transfer time : 47.5 sec
Messages transferred : 15
Messages skipped : 698
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 3
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Host1 Nb messages: 719 messages
Host1 Total size: 79009283 bytes (75.349 MiB)
Host2 Total size: 124207112 bytes (118.453 MiB)
Host1 Nb messages: 719 messages
Host1 Total size: 79009283 bytes (75.349 MiB)
Host2 Total size: 109472675 bytes (104.401 MiB)
Transfer started on : Thu Jan 9 12:43:54 2014
Transfer ended on : Thu Jan 9 12:44:35 2014
Transfer time : 41.4 sec
Messages transferred : 9
Messages skipped : 707
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 3
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 68
Email ID:
Host1 Nb messages: 10946 messages
Host1 Total size: 2479400948 bytes (2.309 GiB)
Host2 Total size: 2484486392 bytes (2.314 GiB)
Host1 Nb messages: 10948 messages
Host1 Total size: 2479604936 bytes (2.309 GiB)
Host2 Total size: 2485331983 bytes (2.315 GiB)
Transfer started on : Thu Jan 9 11:04:38 2014
Transfer ended on : Thu Jan 9 11:18:13 2014
Transfer time : 815.2 sec
Messages transferred : 4
Messages skipped : 10942
Messages found duplicate on host1 : 8
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 0
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID: ravindra@gmail.com
Host1 Nb messages: 6880 messages
Host1 Total size: 747385818 bytes (712.763 MiB)
Host2 Total size: 979683656 bytes (934.299 MiB)
Host1 Nb messages: 6880 messages
Host1 Total size: 747385818 bytes (712.763 MiB)
Host2 Total size: 961044125 bytes (916.523 MiB)
Transfer started on : Thu Jan 9 11:47:57 2014
Transfer ended on : Thu Jan 9 11:52:38 2014
Transfer time : 280.7 sec
Messages transferred : 4
Messages skipped : 6876
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 235
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 42
Email ID: rishabh@gmail.com
Host1 Nb messages: 6748 messages
Host1 Total size: 840806927 bytes (801.856 MiB)
Host2 Total size: 1264538332 bytes (1.178 GiB)
Host1 Nb messages: 6748 messages
Host1 Total size: 840806927 bytes (801.856 MiB)
Host2 Total size: 1132452059 bytes (1.055 GiB)
Transfer started on : Thu Jan 9 11:32:21 2014
Transfer ended on : Thu Jan 9 11:38:11 2014
Transfer time : 349.7 sec
Messages transferred : 29
Messages skipped : 6684
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 37
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 847
Email ID: sanjeev@gmail.com
Host1 Nb messages: 5893 messages
Host1 Total size: 641811292 bytes (612.079 MiB)
Host2 Total size: 861822544 bytes (821.898 MiB)
Host1 Nb messages: 5894 messages
Host1 Total size: 641816844 bytes (612.084 MiB)
Host2 Total size: 862418389 bytes (822.466 MiB)
Transfer started on : Thu Jan 9 11:59:14 2014
Transfer ended on : Thu Jan 9 12:03:48 2014
Transfer time : 273.5 sec
Messages transferred : 9
Messages skipped : 5878
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 2
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 1
Email ID:
Host1 Nb messages: 5098 messages
Host1 Total size: 1979884248 bytes (1.844 GiB)
Host2 Total size: 1985872938 bytes (1.849 GiB)
Host1 Nb messages: 5098 messages
Host1 Total size: 1979884248 bytes (1.844 GiB)
Host2 Total size: 1986191087 bytes (1.850 GiB)
Transfer started on : Thu Jan 9 12:09:11 2014
Transfer ended on : Thu Jan 9 12:24:09 2014
Transfer time : 897.9 sec
Messages transferred : 4
Messages skipped : 5094
Messages found duplicate on host1 : 3
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 0
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Email ID: vikashk@gmail.com
Host1 Nb messages: 7815 messages
Host1 Total size: 864720484 bytes (824.662 MiB)
Host2 Total size: 1138099557 bytes (1.060 GiB)
Host1 Nb messages: 7816 messages
Host1 Total size: 864736079 bytes (824.677 MiB)
Host2 Total size: 1145161591 bytes (1.067 GiB)
Transfer started on : Thu Jan 9 11:38:11 2014
Transfer ended on : Thu Jan 9 11:46:23 2014
Transfer time : 492.4 sec
Messages transferred : 21
Messages skipped : 7790
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 786
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 8
Email ID: virendra@gmail.com
Host1 Nb messages: 9111 messages
Host1 Total size: 1517843995 bytes (1.414 GiB)
Host2 Total size: 2006111892 bytes (1.868 GiB)
Host1 Nb messages: 9111 messages
Host1 Total size: 1517843995 bytes (1.414 GiB)
Host2 Total size: 2005999287 bytes (1.868 GiB)
Transfer started on : Thu Jan 9 11:52:38 2014
Transfer ended on : Thu Jan 9 11:59:14 2014
Transfer time : 395.7 sec
Messages transferred : 16
Messages skipped : 9095
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 99
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 18
Email ID: vishalg@gmail.com
Host1 Nb messages: 3075 messages
Host1 Total size: 1979295261 bytes (1.843 GiB)
Host2 Total size: 2647489746 bytes (2.466 GiB)
Host1 Nb messages: 3075 messages
Host1 Total size: 1979295261 bytes (1.843 GiB)
Host2 Total size: 2693702750 bytes (2.509 GiB)
Transfer started on : Thu Jan 9 01:45:18 2014
Transfer ended on : Thu Jan 9 01:50:34 2014
Transfer time : 315.4 sec
Messages transferred : 5
Messages skipped : 3069
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1
Messages void (noheader) on host2 : 2
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Host1 Nb messages: 3076 messages
Host1 Total size: 1979358861 bytes (1.843 GiB)
Host2 Total size: 2693702750 bytes (2.509 GiB)
Host1 Nb messages: 3076 messages
Host1 Total size: 1979358861 bytes (1.843 GiB)
Host2 Total size: 2693786263 bytes (2.509 GiB)
Transfer started on : Thu Jan 9 12:23:27 2014
Transfer ended on : Thu Jan 9 12:26:24 2014
Transfer time : 176.3 sec
Messages transferred : 1
Messages skipped : 3074
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1
Messages void (noheader) on host2 : 2
Messages deleted on host1 : 0
Messages deleted on host2 : 0

i want to grep and export it to excel in colums

field needed:-

Email ID:
Host1 Nb messages:
Host1 Total size:
Host2 Nb mesages:
Host2 Total size:
Transfer started on:
Transfer ended on:
Transfer time:
Messages transferred :
Messages skipped:
Messages found duplicate on host1 :
Messages found duplicate on host2 :
Messages void (noheader) on host1 :
Messages void (noheader) on host2 :
Messages deleted on host1 :
Messages deleted on host2 :

druuna · 01-09-2014, 06:26 AM

Again with the lack of information and input that is very inconsistent.....

You say you want these fields:

Quote:

Email ID:
Host1 Nb messages:
Host1 Total size:
Host2 Nb mesages:
Host2 Total size:
Transfer started on:
Transfer ended on:
Transfer time:
Messages transferred :
Messages skipped:
Messages found duplicate on host1 :
Messages found duplicate on host2 :
Messages void (noheader) on host1 :
Messages void (noheader) on host2 :
Messages deleted on host1 :
Messages deleted on host2 :

What needs to be done with an entry like this (multiple block entries):

Quote:

Email ID: vishalg@gmail.com
Host1 Nb messages: 3075 messages
Host1 Total size: 1979295261 bytes (1.843 GiB)
Host2 Total size: 2647489746 bytes (2.466 GiB)
Host1 Nb messages: 3075 messages
Host1 Total size: 1979295261 bytes (1.843 GiB)
Host2 Total size: 2693702750 bytes (2.509 GiB)
Transfer started on : Thu Jan 9 01:45:18 2014
Transfer ended on : Thu Jan 9 01:50:34 2014
Transfer time : 315.4 sec
Messages transferred : 5
Messages skipped : 3069
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1
Messages void (noheader) on host2 : 2
Messages deleted on host1 : 0
Messages deleted on host2 : 0
Host1 Nb messages: 3076 messages
Host1 Total size: 1979358861 bytes (1.843 GiB)
Host2 Total size: 2693702750 bytes (2.509 GiB)
Host1 Nb messages: 3076 messages
Host1 Total size: 1979358861 bytes (1.843 GiB)
Host2 Total size: 2693786263 bytes (2.509 GiB)
Transfer started on : Thu Jan 9 12:23:27 2014
Transfer ended on : Thu Jan 9 12:26:24 2014
Transfer time : 176.3 sec
Messages transferred : 1
Messages skipped : 3074
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 1
Messages void (noheader) on host2 : 2
Messages deleted on host1 : 0
Messages deleted on host2 : 0

Which is very different than this entry (multiple entries):

Quote:

Email ID: virendra@gmail.com
Host1 Nb messages: 9111 messages
Host1 Total size: 1517843995 bytes (1.414 GiB)
Host2 Total size: 2006111892 bytes (1.868 GiB)
Host1 Nb messages: 9111 messages
Host1 Total size: 1517843995 bytes (1.414 GiB)
Host2 Total size: 2005999287 bytes (1.868 GiB)
Transfer started on : Thu Jan 9 11:52:38 2014
Transfer ended on : Thu Jan 9 11:59:14 2014
Transfer time : 395.7 sec
Messages transferred : 16
Messages skipped : 9095
Messages found duplicate on host1 : 0
Messages found duplicate on host2 : 0
Messages void (noheader) on host1 : 99
Messages void (noheader) on host2 : 0
Messages deleted on host1 : 0
Messages deleted on host2 : 18

Both seem like very sloppy copy/paste actions.

Why is this present an what needs to be done with it:

Quote:

Email ID: amber@gmail.com
amber-cb@gmail.com
.
.

And what about empty/missing entries:

Quote:

Email ID:

Last time I will tell you this: PROVIDE ACCURATE INFORMATION OR WE CAN NOT HELP YOU.