# search - robots control file # use any robot without any restriction User-agent: * Disallow: /admin User-agent: Yahoo! Slurp Disallow: / User-agent: twiceler Disallow: /