Mod rewrite Code Library

Code Library - Denying bots & email scrapers

Security
Denying bots & email scrapers

htaccess code
RewriteEngine on
# (testing purposes) RewriteCond %{HTTP_USER_AGENT} ^.*Mozilla.* [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Pockey.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*NetMechanic.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*SuperBot.* [OR,NC]
RewriteCond %[HTTP_USER_AGENT} ^QRVA.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*WebMiner.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*WebCopier.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*Web\ Downloader.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*WebMirror.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*Offline.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*WebZIP.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*WebReaper.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*Anarchie.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*Mass\ Down.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*Slurp.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*BlackWidow.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*WebStripper.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*Wget.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*WebHook.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*Scooter.* [OR,NC]
RewriteCond %{HTTP_USER_AGENT} ^.*Teleport.* [NC]
RewriteRule ^.*$ - [F,L]

home | blog | tutorials | code library

Questions that are answered here:

  • How to protect against site scrapers?
  • How to deny email scrapers?
  • How to deny malicious bots?
  • How to detect scraper bots?

 

Mod Rewrite (Home) | Mod Rewrite Tutorials | Directory | Code Library | Blog | Mod Rewrite Quick Guide

copyright © 2001 - 2010 Webforgers.net
Owned By SEO Uncloaked, LLC
Aggressive Search Engine Optimization
All rights reserved.