title: Order of User agents in robots.txt
body: <p>my robots.txt looks like this:</p>
  
  <pre><code>User-agent: *
  Disallow: /admin
  Disallow: /test
  
  User-Agent: Googlebot
  Disallow: /maps
  </code></pre>
  
  <p>Now Google ignores the user-agent * part and only obeys the specific Googlebot directives (/maps). Is this normal behaviour and shouldn't also obey the useragent * directives (/admin, /test)?</p>
  
  <p>It seems strange to have to add every line for every useragent?</p>