• 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Help regarding robots.txt

#2
Code:
# www.robotstxt.org/
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

User-agent: *
# Check and update the following list of disabled directories.
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /assets/

# If you support sitemap.xml: Update the actual site address and enable the following line.
# Sitemap: http://my-site.com/sitemap.xml
Reply


Messages In This Thread
Help regarding robots.txt - by jithinjohnygeorge - 07-13-2015, 10:49 AM
RE: Help regarding robots.txt - by ivantcholakov - 07-13-2015, 02:48 PM

Digg   Delicious   Reddit   Facebook   Twitter   StumbleUpon  


  Theme © 2014 iAndrew  
Powered By MyBB, © 2002-2020 MyBB Group.