Quote:
Originally Posted by xchido
By the way I am still getting this entries on my logs. They are in the thousands. my daily access logs are over 100MB each so at this rate I am getting close to 1GB of access logs this week alone. 99% filled with these entries. They are mostly the same with different referrer IP addresses. THe same IP addresses that I baned in my htaccess file. Why are they still appearing?
What else should I be looking at to stop this traffic?
|
You are not going to stop that traffic. Your raw log files show every attempt to connect. These are attempts to connect that are all getting a 404 (file not found) response.
You can't stop them from trying to connect; prior to the attempt you don't even know they are there.
The whole point of referer spam is to get links to spam sites when your logs and your site statistics are indexed by the search engines. Your raw logs will always show these attempted connections, but your statistics gathering tools should filter them out. For instance, I usually use AWStats, and all of those 404 attempts would show up as one number on the chart, that being the connects that failed. Also, none of the referers will show up in my statistics as referring sites.
You should have things set up so your raw logs are never searchable by a search engine and if you do choose to expose your outputs from programs like awstats, those bogus referers won't show there.