suing sed to remove certain list of strings from a file ???

HuMan-BiEnG · 09-28-2010, 02:28 PM

Hello there,,

i want to know how can i use sed to remove a list of emails from my email list ?? please can anyone help me to do that ??

example :

- i have fileA & fileB
- fileA contain a list of emails (say 7 emails), while fileB contain 300 email (including the 7 emails in fileA)
- now i want to make fileB doesnt contain the list of emails in fileA (which are 7 emails)

any help will be appretiated ,,

may all accept my best regards,,

David the H. · 09-28-2010, 03:21 PM

You want to sue sed? What have they ever done to you?

But seriously, could you provide some actual examples of the text you want to remove? It's almost impossible to give clear advice when we have only vague descriptions to work with.

Finally, how do you know that sed would be the best tool for the job? It's usually better to simply explain what you want to accomplish, and leave the how to be determined in the discussion.

HuMan-BiEnG · 09-29-2010, 10:32 AM

Quote:

Originally Posted by David the H.

You want to sue sed? What have they ever done to you?

But seriously, could you provide some actual examples of the text you want to remove? It's almost impossible to give clear advice when we have only vague descriptions to work with.

Finally, how do you know that sed would be the best tool for the job? It's usually better to simply explain what you want to accomplish, and leave the how to be determined in the discussion.

Hello David,

ictually you are write, about the tool of program that will help me to finish what i want ,,

the example you want :

FileA ,contain :
email1@domain.com
email4@domain.com
email6@domain.com

fileB ,contain :
email1@domain.com
email2@domain.com
email3@domain.com
email4@domain.com
email5@domain.com
email6@domain.com
email7@domain.com
email8@domain.com

now i want to remove emails in FileA from FileB, to make FileB contain :
email2@domain.com
email3@domain.com
email5@domain.com
email7@domain.com
email8@domain.com

thanks David for your concern ,,

accept my best regards,,

vinaytp · 09-29-2010, 11:02 AM

Hi HuMan-BiEnG,

Try this

Code:

diff fileA fileB | sed -n '/.com$/p' | sed 's/^> //'  > file
mv file fileB

Warm Regards,

kurumi · 09-29-2010, 07:24 PM

Quote:

Originally Posted by HuMan-BiEnG

Hello David,

ictually you are write, about the tool of program that will help me to finish what i want ,,

the example you want :

FileA ,contain :
email1@domain.com
email4@domain.com
email6@domain.com

fileB ,contain :
email1@domain.com
email2@domain.com
email3@domain.com
email4@domain.com
email5@domain.com
email6@domain.com
email7@domain.com
email8@domain.com

now i want to remove emails in FileA from FileB, to make FileB contain :
email2@domain.com
email3@domain.com
email5@domain.com
email7@domain.com
email8@domain.com

thanks David for your concern ,,

accept my best regards,,

go try these out

Code:

grep -f <file1> <file2>
grep -f <file2> <file1>
grep -v -f <file1> <file2>
grep -v -f <file2> <file1>

HuMan-BiEnG · 09-30-2010, 02:11 AM

Quote:

Originally Posted by vinaytp

Hi HuMan-BiEnG,

Try this

Code:

diff fileA fileB | sed -n '/.com$/p' | sed 's/^> //'  > file
mv file fileB

Warm Regards,

Hello vinaytp,,

thank you man very alot

i really appretiate your kind helping so much

please man accept my best regards

,,

good luck vinaytp,,

HuMan-BiEnG · 09-30-2010, 02:13 AM

Quote:

Originally Posted by kurumi

go try these out

Code:

grep -f <file1> <file2>
grep -f <file2> <file1>
grep -v -f <file1> <file2>
grep -v -f <file2> <file1>

Hello kurumi,,

thank you so much man for helping & offering me this solution ,,

please kurumi accept my regards,,

hope that all who helped me will be always & 4ever in a very good health

goodluck to everyone,,

acid_kewpie · 09-30-2010, 02:24 AM

Quote:

Originally Posted by vinaytp

Hi HuMan-BiEnG,

Try this

Code:

diff fileA fileB | sed -n '/.com$/p' | sed 's/^> //'  > file
mv file fileB

Warm Regards,

just doing a diff could mask all sorts of things. What if the addresses are not in the same order? why only .com suffix domains? why manually strip out the diff formatting instead of using proper formatting in the first place?

vinaytp · 09-30-2010, 02:44 AM

Code:

grep -f <file1> <file2>
grep -f <file2> <file1>
grep -v -f <file1> <file2>
grep -v -f <file2> <file1>

Works nice !!

vinaytp · 09-30-2010, 02:52 AM

Quote:

Originally Posted by acid_kewpie

just doing a diff could mask all sorts of things. What if the addresses are not in the same order? why only .com suffix domains? why manually strip out the diff formatting instead of using proper formatting in the first place?

Hi,

I just tried to strip off the characters and lines other than required.

In the below output I needed to eliminate lines other than email address.
Also > character.

Code:

# diff fileA fileB
1a2,3
> email2@domain.com
> email3@domain.com
2a5
> email5@domain.com
3a7,8
> email7@domain.com
> email8@domain.com

I took .com into consideration since only .com set of email addresses were specified by the OP.

Warm Regards,

gapan · 10-11-2010, 02:52 AM

Code:

for i in `cat fileA`; do sed -i "/^${i}$/d" fileB; done

HuMan-BiEnG · 10-13-2010, 09:04 AM

Quote:

Originally Posted by gapan

Code:

for i in `cat fileA`; do sed -i "/^${i}$/d" fileB; done

Hello gapan,

many many thanks man ,& please accept my best regards