Help answer threads with 0 replies.
Go Back > Forums > Linux Forums > Linux - Software
User Name
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.


  Search this Thread
Old 04-18-2005, 05:36 AM   #1
Registered: Apr 2004
Posts: 340

Rep: Reputation: 30
Stop the Google robots

I do NOT want the Google robots to traverse web pages on a particular web server.

What can I do to stop this?
Old 04-18-2005, 05:47 AM   #2
LQ Guru
Registered: May 2003
Location: INDIA
Distribution: Ubuntu, Solaris,CentOS
Posts: 5,522

Rep: Reputation: 58
maybe u need to put up some authentication on that webpages....
Old 04-18-2005, 05:47 AM   #3
Registered: Nov 2002
Location: Kent, England
Distribution: Debian Testing
Posts: 19,191
Blog Entries: 4

Rep: Reputation: 464Reputation: 464Reputation: 464Reputation: 464Reputation: 464
Look at robots.txt - that's how you stop them


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
robots.txt paleogryph Linux - Software 1 11-11-2005 02:32 PM
Linux Powered Robots. rvijay Linux - News 8 07-31-2005 09:01 AM
configuring robots.txt jc materi Linux - Security 1 04-09-2005 10:37 AM
The Robots movie ahz General 4 03-24-2005 04:31 PM
difference between and dr_zayus69 General 4 01-12-2005 02:45 PM

All times are GMT -5. The time now is 05:26 PM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration