LinuxQuestions.org
Help answer threads with 0 replies.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
Reload this Page How web crawlers detects new website on the internet?
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 10-22-2013, 08:08 PM   #1
markotitel
Member
 
Registered: Feb 2009
Location: Titel - Serbia
Posts: 181

Rep: Reputation: 18
How web crawlers detects new website on the internet?

Hi I have been wondering how is it done? How search engines finds out that there is new website online ?

I am banging my head with this
 
Old 10-22-2013, 09:01 PM   #2
smallpond
Senior Member
 
Registered: Feb 2011
Location: Massachusetts, USA
Distribution: Fedora
Posts: 4,140

Rep: Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263
Most search engines have a submission form.

http://www.google.com/submityourcontent/
 
Old 10-23-2013, 05:29 AM   #3
markotitel
Member
 
Registered: Feb 2009
Location: Titel - Serbia
Posts: 181

Original Poster
Rep: Reputation: 18
Yes but I dont think that all of website owners submit that.
 
Old 10-23-2013, 08:06 AM   #4
Habitual
LQ Veteran
 
Registered: Jan 2011
Location: Abingdon, VA
Distribution: Catalina
Posts: 9,374
Blog Entries: 37

Rep: Reputation: Disabled
dns registrations are a matter of "public record" and are published daily.
 
1 members found this post helpful.
Old 10-23-2013, 09:40 AM   #5
zhjim
Senior Member
 
Registered: Oct 2004
Distribution: Debian Squeeze x86_64
Posts: 1,748
Blog Entries: 11

Rep: Reputation: 233Reputation: 233Reputation: 233
Quote:
Originally Posted by Habitual View Post
dns registrations are a matter of "public record" and are published daily.
Hm intresting. So where might I be able to get those?
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
ubuntu 10.04 wont connect to the internet but detects my router tym31 Linux - Wireless Networking 9 09-25-2010 07:14 PM
Blocking Web crawlers, bots, spiders, proxies, etc from private site areas haydenyoung Linux - Security 3 11-15-2008 11:03 AM
Reliance netconnect USB modem detects but cannot log on to internet JAYARAJAN.C.N SUSE / openSUSE 2 03-01-2007 01:15 PM
Internet disconnects, but nothing detects it Orgullomoore Linux - General 2 06-17-2006 10:50 PM
I Can't Login The Internet Although Suse Detects My Ip Correctly mesh2005 Linux - Networking 2 05-22-2006 02:08 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 07:41 PM.

Contact Us - Advertising Info - Rules - Privacy - LQ Merchandise - Donations - Contributing Member - LQ Sitemap -
Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration