Help regarding robots.txt |
Somebody please suggest me a robots.txt file for my codeigniter project. Am not sure which are the folders that should not be crawled by robots on a codeigniter project.
Thank You. |
Messages In This Thread |
Help regarding robots.txt - by jithinjohnygeorge - 07-13-2015, 10:49 AM
RE: Help regarding robots.txt - by ivantcholakov - 07-13-2015, 02:48 PM
|