manipulating text in python

suran · 11-24-2009, 08:47 AM

hi,

how do i achieve the same results as my shell script in python:

the shell script i wrote:

Code:

#!/bin/ksh
#script:email_logs
#date:16/10/2009
#purpose: to find emails from a specific address and generate a report that is legible

#Define variables

logdir="/scratch/syslog-ng/maillogs"
email_address=$1
output="/tmp/$1.log"

function usage
{
echo "Usage: email_logs <email_address>" 
echo "email_logs sabrix@malca.custhelp.com"
}

#####check for correct usage

if [ $# -ne 1 ]

then
        usage 
        exit 1
fi

#####main program#######

cd ${logdir}

zgrep -E "$1" 10.2[0-9].0.1[0-100]/maillog.[0-99].gz | awk '{print " To: "$13,"From: "$12, "Subject: "$21,$22,$23,$24,$25, "Date & Time: " $1,$2,$3}' \
| sed 's%10.2[0-9].0.1[0-99]/maillog.[0-99].gz:%%g' >>${output} #checks on the 10.20. address range

an example of the file it generates when you give $1 a value is like so:

To: mandsmonthly@mailuk.custhelp.com From: Helen.Owen2@marks-and-spencer.com Subject: - EMPLOYEE CONTRACT CHANGES - Date & Time: Nov 18 09:59:01

bascially the to is filed number 13, from 12, subject 21-25 data and time 1-3

How do i get this exact same thing to work with python?

my python code so far:

Code:

#!/usr/bin/env python
import subprocess
import optparse
import re
import os
import gzip
import sys

LOGDIR="/scratch/syslog-ng/maillogs"
email = raw_input('Please enter email address: ')

im not really sure what to do from here as python is completely new to me.

ywzhaifei · 11-25-2009, 01:30 AM

i write the python code for below

Code:

zgrep -E "$1" 10.2[0-9].0.1[0-100]/maillog.[0-99].gz | awk '{print " To: "$13,"From: "$12, "Subject: "$21,$22,$23,$24,$25, "Date & Time: " $1,$2,$3}' \
| sed 's%10.2[0-9].0.1[0-99]/maillog.[0-99].gz:%%g'

Code:

#import re, os.path, gzip
for i in range(10):
	for j in range(101):
		for k in range(100):
			file='10.2{0}.0.1{1}/maillog.{2}.gz'.format(i,j,k)
			contents=gzip.open(os.path.join(logdir,file), 'rb').read().split('\n')
			for item in contents:
				if item.find(email):
					items=item.split()
					out='To: {0} From: {1} Subject: {2} Date & Time: {3}'.format(items[12], items[11], items[20-24].join(' '), items[0-2].join(' ')])
					print(re.sub('10.2[0-9].0.1[0-99]\/maillog.[0-99].gz', '', out))

not test.

XavierP · 11-25-2009, 03:23 AM

Moved: This thread is more suitable in Programming and has been moved accordingly to help your thread/question get the exposure it deserves.

suran · 11-30-2009, 04:55 AM

hi it says there is a syntax error here:

out='To: {0} From: {1} Subject: {2} Date & Time: {3}'.format(items[12], items[11], items[20-24].join(' '), items[0-2].join(' ')])
print(re.sub('10.2[0-9].0.1[0-99]\/maillog.[0-99].gz', '', out))
? any ideas? i've tried ammending a few times

ywzhaifei · 11-30-2009, 11:33 PM

yeah. remove the ']'
out='To: {0} From: {1} Subject: {2} Date & Time: {3}'.format(items[12], items[11], items[20-24].join(' '), items[0-2].join(' '))

sorry about that.
and next time. Can you also post the entire error message? thanks.