Welcome Guest, Not a member yet? Register   Sign In
Help regarding robots.txt

Somebody please suggest me a robots.txt file for my codeigniter project. Am not sure which are the folders that should not be crawled by robots on a codeigniter project.

Thank You.

Messages In This Thread
Help regarding robots.txt - by jithinjohnygeorge - 07-13-2015, 10:49 AM
RE: Help regarding robots.txt - by ivantcholakov - 07-13-2015, 02:48 PM

Theme © iAndrew 2016 - Forum software by © MyBB