+- CodeIgniter Forums (https://forum.codeigniter.com)
+-- Forum: Archived Discussions (https://forum.codeigniter.com/forumdisplay.php?fid=20)
+--- Forum: Archived General Discussion (https://forum.codeigniter.com/forumdisplay.php?fid=21)
+--- Thread: Prevent image indexation by robots (/showthread.php?tid=58175)
Prevent image indexation by robots - El Forum - 05-22-2013
[eluser]flacznik[/eluser]
Hi, I was just wondering if I can block my assets folder having Images subfolder in it from being indexed by some robots? (I don't want to find my images in google results etc.). My folder structure:
-website
---application
---assets
----images
----css
----js
---system
Prevent image indexation by robots - El Forum - 05-22-2013
[eluser]flacznik[/eluser]
I guess It might be solution to place at the end of the .htaccess file <FilesMatch> rule. As I am not an expert please advise if the structure of my file is correct. Thank you in advance...
Code:
RewriteEngine On
RewriteBase /
#Removes access to the system folder by users.
#Additionally this will allow you to create a System.php controller,
RewriteCond %{REQUEST_URI} ^system.*
RewriteRule ^(.*)$ index.php?/$1 [L]
#When your application folder isn't in the system folder
RewriteCond %{REQUEST_URI} ^application.*
RewriteRule ^(.*)$ /index.php?/$1 [L]
#Checks to see if the user is attempting to access a valid file,
#such as an image or css document, if this isn't true it sends the
#request to index.php
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule ^(.*)$ index.php?/$1 [L]
# If we don't have mod_rewrite installed, all 404's
# can be sent to index.php, and everything works as normal.
# Submitted by: ElliotHaughin
ErrorDocument 404 /index.php
<FilesMatch "\.(bmp|gif|jpg|png|tif)$">
Header set X-Robots-Tag "noindex"
</FilesMatch>Prevent image indexation by robots - El Forum - 05-22-2013
[eluser]CroNiX[/eluser]
robots.txt
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449
User-agent: *
Disallow: /assets/
for everything in assets dir
or
Disallow: /assets/images/
for images dir specifically