LinuxQuestions.org
Go Job Hunting at the LQ Job Marketplace
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices

Reply
 
LinkBack Search this Thread
Old 11-01-2004, 04:50 PM   #16
Adler
Member
 
Registered: Oct 2004
Location: Wildwood, NJ
Distribution: Backbox Linux
Posts: 174

Original Poster
Rep: Reputation: 17

320mb,

Jeez, lighten up a bit.

I'm not looking to become some type of spammer. If I was, there is enough stuff in the MS Universe to go after the NewsGroups and the participants there.

I think this could turn into a positive and informational exchange of what's there to be had. And there are certainly people out there with this type of knowledge, therefore I'd approached the Linux "Community".

I understand your concerns, but I think that you can appreciate my point.
 
Old 11-02-2004, 02:15 AM   #17
TigerOC
Senior Member
 
Registered: Jan 2003
Location: Devon, UK
Distribution: Debian Etc/kernel 2.6.18-4K7
Posts: 2,380

Rep: Reputation: 49
Sounds like you need your own crawler. I found one Larbin which you may be able to tune to your own needs.
 
Old 11-02-2004, 07:23 AM   #18
Adler
Member
 
Registered: Oct 2004
Location: Wildwood, NJ
Distribution: Backbox Linux
Posts: 174

Original Poster
Rep: Reputation: 17
TigerOC,

Thanks for the link. It'll take some playing around with, but it looks interesting.
 
Old 11-02-2004, 05:04 PM   #19
Adler
Member
 
Registered: Oct 2004
Location: Wildwood, NJ
Distribution: Backbox Linux
Posts: 174

Original Poster
Rep: Reputation: 17
TigerOC,

The Larbin project doesn't look like it is what I'm looking for.

Any other ideas?
 
Old 11-03-2004, 03:51 AM   #20
TigerOC
Senior Member
 
Registered: Jan 2003
Location: Devon, UK
Distribution: Debian Etc/kernel 2.6.18-4K7
Posts: 2,380

Rep: Reputation: 49
After a quick google search this is a very techniical area in which some of the major players (IBM et al) are involved in. Basically it is multi-step process involving server clusters using crawlers and then consolidating the information in databases for rational use. It may be well worth your while contacting the author of Larbin and discussing your ideas with him.
Personal opinion is that unless you replicate this in some way it is not possible. Your only option is to use conventional detailed search parameters on all the major search engines. In addition establishing connections with leading personalties in various geographical regions who are well acquainted with biotech developments in their own regions would be imperative.

Last edited by TigerOC; 11-03-2004 at 03:55 AM.
 
Old 11-03-2004, 04:17 AM   #21
Adler
Member
 
Registered: Oct 2004
Location: Wildwood, NJ
Distribution: Backbox Linux
Posts: 174

Original Poster
Rep: Reputation: 17
TigerOC,

Thanks for the incitive post.

I have run into the technologies wrapped around this on the Linux side. Over in the MS Universe there's so many Crawlers, Spiders, Extractors (e-mail, address, phone, fax), etc. that is almost like a zoo. I'd bought a couple of apps @ $US100 a pop, but would like to try eveything in Linux and not jump to the MS side of my box.

It seems the big players -- like Big Blue -- are clustering server farms and spending big bucks just to re-create the wheel, basically trying to do a better Google. Novell and Sun seem to be pretty quite.

Linux is so much simpler that -- no reflection on the OS, I love it -- someone usually comes up with a simple solution, another does a GUI and then finally someone says -- Hey, here's how to do it.

I'll try the Larbin guy per your suggestion.

Finally, I lived in Europe for 10 years and also spent another 10 years living in Asia and have my fair share of Biotech / Colleague contacts. We trade information back and forth when one of us has a special need. Call it my Global Network in the Biotech area.

Again, thanks for your post.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
HELP: survey data collection & analysis woes :S kevingpo Programming 2 10-19-2005 08:30 AM
Nmon data collection blues looseCannon AIX 5 11-11-2004 05:52 AM
Biotech Data Mining Adler Linux - Software 2 10-31-2004 03:03 AM
Star Office 7 - No 'Data Sources' rickh Linux - Software 1 06-11-2004 12:33 PM
Data Mining and how to stop it ????? bigjohn Linux - Security 11 10-27-2003 01:50 AM


All times are GMT -5. The time now is 08:12 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration