robots.txt in CI

[eluser]abmcr[/eluser]
[quote author="xwero" date="1202745227"]

You should use an .htacces file or use the setting of your webserver to make sure spiders can't crawl your directories.[/quote]

An example? Thank you