LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Software (https://www.linuxquestions.org/questions/linux-software-2/)
-   -   selective spidering of forums (https://www.linuxquestions.org/questions/linux-software-2/selective-spidering-of-forums-754292/)

Z038 09-10-2009 09:28 PM

selective spidering of forums
 
Are there any programs that can be used to selectively copy posts from a forum site? If I wanted to search a forum to find and copy all posts that I made in that forum without having to do it manually using search tools and cut&paste, how might I accomplish that?

I'm thinking some kind of forum-aware spider might do it, but it would have to be very selective. I don't want to copy every page where a post I'm interested in occurs.

syg00 09-12-2009 08:03 AM

You might have to write your own - very site specific I would think. LQ for example; look at any page - easy to get a page with (all) your own posts. Wouldn't take much to follow the links returned.
Lots of examples on the web - just pick a favoured language; perl, python, ruby ...


All times are GMT -5. The time now is 04:40 PM.