User-agent: * Disallow: /req.php Allow: / Clean-param: buster Disallow: /common Disallow: /sessions Disallow: /weblogic Crawl-delay: 2