# robots.txt User-agent: * Disallow: /temp/ Disallow: *date= Disallow: *text= Disallow: *ip= Disallow: *www= Disallow: *.html Clean-param: sqi&sqibig&age&url / Clean-param: sqi&sqibig&age&url /cenzor* User-agent: CCBot Disallow: /