extract text portions from html files

linuxfond · 04-21-2004, 06:08 PM

Hello,
I have a daunting task: 350 html files on HD, each of these files contain a portion of text which I want to extract and save into a text file:
<li>E-mail: <a href="mailto:abc@abc.abc">abc@abc.abc</a></li>
Is there an easy way to do, a shell script, a command line tool, or something of this kind which will extract the emails?
Once this is done, I have to extract other text data and save it to file.
Thanks, indeed.

linuxfond · 04-21-2004, 06:46 PM

I downloaded something from the Web which runs under Windox.
Now I have a text file with 4000+ email addresses. More than half of it are duplicates. How can I remove the duplicates?
Please, help.
N.B. I know it looks like I am going to spam these addresses, but, I am really not going to do so.

itsme86 · 04-21-2004, 11:21 PM

man uniq

You might need to run your text file through sort first (cat file.txt | sort | uniq > newfile.txt)

linuxfond · 04-28-2004, 11:00 AM

Thank you. It worked!