User-agent: * Disallow: /404 Disallow: /500 Disallow: /admin Disallow: /bin Disallow: /files Disallow: /img Disallow: /search Disallow: /sys Allow: /