LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Closed Thread
  Search this Thread
Old 01-27-2012, 04:06 PM   #1
OldManRiver
LQ Newbie
 
Registered: Aug 2004
Posts: 26

Rep: Reputation: 5
Yellow Pages


All,

Sorry you only see 12 posts (now 13 with this one), because I do most of my postings on other sites, but looking for a solution that should be Linux wide so posting here!

I know they exist as opensource, but having trouble finding a bot to do:

1. Scan YP for business by category (Looking for Churches and Tech Companies),
2. Filter by area (mine is Dallas Metro Area),
3. Compare and prioritize by listings from The Dallas Business Journal (already in a DB),
4. Find emails for those entities not listing them in YP.

I know there has been recent laws and litigation about bots invading privacy, but found the Yellow Pages, because how they always have published this information, have been excluded from these privacy and legal actions.

I'm figuring the legal status is why I can no longer find such bots, but know CURL in PHP does this so hoping to find some source that gets me started. I do not want to re-invent the wheel.

URLs to code you know would be good here.

All help appreciated!

Thanks!

OMR
 
Old 01-28-2012, 10:50 PM   #2
kbp
Senior Member
 
Registered: Aug 2009
Posts: 3,790

Rep: Reputation: 652Reputation: 652Reputation: 652Reputation: 652Reputation: 652Reputation: 652
There may be an API to reference and also a "conditions of use" notice, it may be worth checking these out so you stay within the law.
 
Old 01-29-2012, 09:58 AM   #3
OldManRiver
LQ Newbie
 
Registered: Aug 2004
Posts: 26

Original Poster
Rep: Reputation: 5
Links

KPB,

Do you have links to these? If any resource you have are not acceptable to forum rules, email me privately at davisoftaec-at-gmail-dot-com

Thanks!

OMR

Last edited by OldManRiver; 01-29-2012 at 10:01 AM.
 
Old 01-29-2012, 04:05 PM   #4
kbp
Senior Member
 
Registered: Aug 2009
Posts: 3,790

Rep: Reputation: 652Reputation: 652Reputation: 652Reputation: 652Reputation: 652Reputation: 652
No, I don't have any resources .. but from prior work experience any bots or automated crawlers will not be well received, access via the api with credentials is the approved method.
 
Old 01-30-2012, 09:30 AM   #5
onebuck
Moderator
 
Registered: Jan 2005
Location: Summer Midwest USA, Central Illinois, Winter Central Florida
Distribution: SlackwareŽ
Posts: 13,366
Blog Entries: 31

Rep: Reputation: 2549Reputation: 2549Reputation: 2549Reputation: 2549Reputation: 2549Reputation: 2549Reputation: 2549Reputation: 2549Reputation: 2549Reputation: 2549Reputation: 2549
Moderator response

This thread/post is marginal so I am leaning on the privacy side. This post is closed;
Quote:
Do not post any messages that are obscene, vulgar, sexually-orientated, hateful, threatening, or otherwise violative of any laws.
@OP, If you wish to discuss this action then feel free to contact me via PM.
 
  


Closed Thread


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Index pages and friendly pages in Internet. stf92 General 12 01-18-2012 07:10 AM
Web server sees the pages, but not the folder that has all the images for the pages nortonz Linux - Server 9 05-17-2010 03:04 PM
MS Publisher html pages for new web pages do not open in firefox, any suggestions?? Bwebman Linux - Newbie 3 06-13-2009 10:35 AM
PHP pages are displayed as blank pages Hirszu Linux - Software 6 03-03-2008 12:09 AM
Firefox 64bit: How to get rid of annoying yellow bar on flash pages? sureshot324 Linux - Software 4 09-03-2006 10:42 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 09:58 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration