Spartanicus wrote:
Is there something wrong with it? Yahoo Slurp still indexes content in
the auth folder...
Try:
Disallow: /auth/*
The Robots Exclusion Protocol does not specify wildcards, some robots
support this as a proprietary extension.
The problem in the original post was probably the blank line between the
User-agent and the Disallow lines.
--
Klaus Johannes Rusch
Kl********@atmedia.net http://www.atmedia.net/KlausRusch/