These days, I'm too lazy to look for stuff on google and what not

and what I wanted to know is how I would go about to creating

a Search engine search bot... basicly capturing all the links from

different search engines that contain key words that I specify.


Anyone have any thoughts or possibly code examples?



(PS: This will in no way used for malicious purpuses such as flooding or any other type of script kiddie activities. I'm pro grc.com)


-vex

Retrieving the links returned by the search engine would probably be very easy. Most search engines allow you to specify one line with the search term, like:
http://www.google.com/linux?q=word1+word2
All you have to do then is parse the output. A simple script with wget and egrep could probably do most of that.

Your biggest problem would be to have some kind of rating system which determines which links are usefull and which aren't. Just because the page has the same word you where searching for doesn't mean the page is usefull to you at all. Just having a bot which returns 10,000 links from 10 search engines isn't gonna reduce the work you have to do if you have to go through each link and see which one happens to be usefull.

look at search.cpan.org and search for search or WWW::Search or just WWW. You'll find it.