Shell Script / awk / perl Question

cmontr · 06-24-2008, 06:11 PM

Hello guys, could anyone help me please for the following...I have a large DB and it contains large amount of users.

From user data it contains such text as:

dn: uid=ALEX, ou=consumer,o=alex.com
cuserstatus: 0
canswer: hola
cquestion: What is your favorite food?
uid: alex
clinkid:alex

.
.
.

What I am looking to print all uid's corresponding with ou=consumer and it's clinkid's value.

Could someone share with me a script for it please ?

Thank you very much

unSpawn · 06-24-2008, 06:48 PM

Something like

Code:

awk -F':' '/(uid:|clinkid:)/ {print $2}' inputtextfile

?

cmontr · 06-24-2008, 07:05 PM

Quote:

Originally Posted by unSpawn

Something like

Code:

awk -F':' '/(uid:|clinkid:)/ {print $2}' inputtextfile

?

I actuall tried this but it prints everyting such as:

CVA111111
34D9758248E55BD
CVA222222
34D9758248E45BD
CVA333333
.
.
.

and when I did the ldapsearch they contain all the ou's ...so the pattern seems did not match...

What I mean is, in below info, it should print uid's only that has ou=consumer and it's clinkid below it...

dn: uid=ALEX, ou=consumer,o=alex.com
cuserstatus: 0
canswer: hola
cquestion: What is your favorite food?
uid: alex
clinkid:alex

I am actually looking at a specific information...Would you have any idea why it does this ?

Thanks much...

cmontr · 06-24-2008, 07:15 PM

Quote:

Originally Posted by cmontr

I actuall tried this but it prints everyting such as:

CVA111111
34D9758248E55BD
CVA222222
34D9758248E45BD
CVA333333
.
.
.

and when I did the ldapsearch they contain all the ou's ...so the pattern seems did not match...

What I mean is, in below info, it should print uid's only that has ou=consumer and it's clinkid below it...

dn: uid=ALEX, ou=consumer,o=alex.com
cuserstatus: 0
canswer: hola
cquestion: What is your favorite food?
uid: alex
clinkid:alex

I am actually looking at a specific information...Would you have any idea why it does this ?

Thanks much...

sorry if I confused

cmontr · 06-24-2008, 07:37 PM

do you think ldapsearch would be a better idea?

such like...but it didnt work so far...

while read UID
do ldapsearch -L -h localhost -p 5555 -D "uid=ab,ou=abadmin,o=alex.com" -w passwd -b o=alex.com -s sub uid=$UID clinkid
done <input.ldif >output.txt

cmontr · 06-24-2008, 08:22 PM

Quote:

Originally Posted by cmontr

do you think ldapsearch would be a better idea?

such like...but it didnt work so far...

while read UID
do ldapsearch -L -h localhost -p 5555 -D "uid=ab,ou=abadmin,o=alex.com" -w passwd -b o=alex.com -s sub uid=$UID clinkid
done <input.ldif >output.txt

mmm I guess I am stuck...can anyone help pls ?

thnx...

ghostdog74 · 06-24-2008, 09:52 PM

these are similar: this thread and this

after so long, you are still stuck ?

cmontr · 06-24-2008, 10:10 PM

Quote:

Originally Posted by ghostdog74

these are similar: this thread and this

after so long, you are still stuck ?

sorry this has different conditions...i made it working with this but not the way I wanted...too slow too...

jschiwal · 06-24-2008, 10:12 PM

I think cmontr's idea to let a directory service be a directory service is the best idea. I'm not running an ldap service to I cant test his example.

Code:

sed -n '/ou=consumer/,/clinkid/{
                                 /dn: uid=/s/.*uid=\([^,]*\), .*/\1/p
                              /clinkid/s/clinkid://p
                               }' input.ldif >output.txt

Since the UID is listed twice, I don't know which value you wanted. One is in uppercase and the other in lower.

Also, if you only post one record, you could be hiding a pattern that can be used to delineate record.

For example, look at the output of "/sbin/lspci -v". Since each output record is separated by a blank line, it's possible to extract a record using a Broadcom device:

Code:

/sbin/lspci -v | sed -n '/Broadcom/,/^$/p'
03:0a.0 Network controller: Broadcom Corporation BCM4306 802.11b/g Wireless LAN Controller (rev 03)
        Subsystem: Linksys Device 0015
        Flags: bus master, fast devsel, latency 32, IRQ 18
        Memory at fddfc000 (32-bit, non-prefetchable) [size=8K]
        Kernel driver in use: b43-pci-bridge
        Kernel modules: ssb

cmontr · 06-24-2008, 10:34 PM

Quote:

Originally Posted by jschiwal

I think cmontr's idea to let a directory service be a directory service is the best idea. I'm not running an ldap service to I cant test his example.

Code:

sed -n '/ou=consumer/,/clinkid/{
                                 /dn: uid=/s/.*uid=\([^,]*\), .*/\1/p
                              /clinkid/s/clinkid://p
                               }' input.ldif >output.txt

Since the UID is listed twice, I don't know which value you wanted. One is in uppercase and the other in lower.

Also, if you only post one record, you could be hiding a pattern that can be used to delineate record.

For example, look at the output of "/sbin/lspci -v". Since each output record is separated by a blank line, it's possible to extract a record using a Broadcom device:

Code:

/sbin/lspci -v | sed -n '/Broadcom/,/^$/p'
03:0a.0 Network controller: Broadcom Corporation BCM4306 802.11b/g Wireless LAN Controller (rev 03)
        Subsystem: Linksys Device 0015
        Flags: bus master, fast devsel, latency 32, IRQ 18
        Memory at fddfc000 (32-bit, non-prefetchable) [size=8K]
        Kernel driver in use: b43-pci-bridge
        Kernel modules: ssb

I appreciate for the try ...It partially works ..I have done this with awl earlier...when it prints, it prints all "ou's" with the clinkid's. But I need only the ones with ou=consumer with along their clinkid's...it is a bit confusing...Please let me know if you have an idea. thanks much again.

cmontr · 06-25-2008, 09:27 AM

Quote:

Originally Posted by cmontr

I appreciate for the try ...It partially works ..I have done this with awl earlier...when it prints, it prints all "ou's" with the clinkid's. But I need only the ones with ou=consumer with along their clinkid's...it is a bit confusing...Please let me know if you have an idea. thanks much again.

I tried this but it didnt bring what I needed ...any ideas someone please let me know..

awk '
/^uid:/ { dn = $0 }
/^clinkid:/ { print dn; print }' input.ldif >output.txt

schneidz · 06-25-2008, 01:00 PM

does this work (assuming each user has exactly 6 lines):
[untested]

Code:

max=`grep -c . input.txt`
i=1
while [ $i -lt $max ]
do
 dn=`sed -n "$i"p input.txt` | grep ou=consumer ]
 if [ $dn ]
 then
  uid=`expr $i + 4`; clinkid=`expr $i + 5`
#  sed -n "$uid"p input.txt
#  sed -n "$clinkid"p input.txt
  sed -n "$uid","$clinkid"p input.txt
 fi
 i=`expr $i + 6`
done

[/season to taste]