User-agent: * Disallow: *.htm Disallow: *.asp?* Disallow: */pay/*