title: How to block bad-bots in htaccess
body: <p>I've used htaccess to block bad bots. I found a complete list of them which are around 400 items and put a code like below in my .htaccess file, but I got 500 Internal Error on my web server.</p>
  
  <pre><code>&lt;IfModule mod_setenvif.c&gt;
      SetEnvIfNoCase User-Agent ^$ bad_bot
      SetEnvIfNoCase User-Agent "^WebReaper [webreaper@otway.com]" bad_bot
      SetEnvIfNoCase User-Agent "^WebZIP/5.0 PR1 (http://www.spidersoft.com)" bad_bot
      SetEnvIfNoCase User-Agent "^Wget/1.8.1+cvs" bad_bot
      SetEnvIfNoCase User-Agent "^Zeus 97371 Webster Pro V2.9 Win32" bad_bot
  
      &lt;Limit GET POST HEAD&gt;
          Order Allow,Deny
          Allow from all
          Deny from env=bad_bot
      &lt;/Limit&gt;
  &lt;/IfModule&gt;
  </code></pre>
  
  <p>I also found that it's not about the size of data, but the codes seems to have a problem. How can I fix this problem?</p>