User-agent: * Disallow: /404.asp Disallow: /blog*.asp Disallow: /register.asp Disallow: /login.asp Disallow: /search.asp /sitemap.asp