• 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
creating robots.txt

#1
Hello all. 

I'm Newbie in CI. I don't know how to create robots.txt 

 should I block controllers or views so that any bot can not index sensitive page..  Like should I use application/controllers/admin to block access to admin controller..
Please help.
Reply

#2
Google search is your friend...
What did you Try? What did you Get? What did you Expect?

Joined CodeIgniter Community 2009.  ( Skype: insitfx )
Reply

#3
A robots.txt is just a file you can create with any text editor, it will only advise a search engine what to index and what not (note that not all crawlers will listen to your set guidelines). It's not a security measure to prevent someone from accessing a url in your project. A .htaccess file can limit that if you will.
Reply

#4
The folders you mention in your post should not be in yourt public_html folder at all.
No need to add them to the robots.
application and system folder should allways be placed above public_html.
Just change the index.php to
$application_folder = '../application';
$system_path = '../system';
On the package it said needs Windows 7 or better. So I installed Linux.
Reply


Digg   Delicious   Reddit   Facebook   Twitter   StumbleUpon  


  Theme © 2014 iAndrew  
Powered By MyBB, © 2002-2020 MyBB Group.