User-agent: * Disallow: /admin/ Disallow: /cart/ Disallow: /CFlickr/ Disallow: /CGI-BIN/ Disallow: /Documentation/ Disallow: /go/ Disallow: /messages/ Disallow: /mssp/script/ Disallow: /script/ Disallow: /shared/ Disallow: /temp/ # no session or other variables dupes Disallow: /*CFID= Disallow: /*CFTOKEN= Disallow: /*ad= Disallow: /*kw= Disallow: /*SID= Disallow: /*sid= # none of these extensions Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.txt$