googlebot 404 in my log - Printable Version

googlebot 404 in my log - Printable Version

+- CodeIgniter Forums (https://forum.codeigniter.com)
+-- Forum: Archived Discussions (https://forum.codeigniter.com/forumdisplay.php?fid=20)
+--- Forum: Archived General Discussion (https://forum.codeigniter.com/forumdisplay.php?fid=21)
+--- Thread: googlebot 404 in my log (/showthread.php?tid=28762)

googlebot 404 in my log - El Forum - 03-20-2010

[eluser]taber[/eluser]
Hi guys, love the codeigniter.

I modified my Log library to include user hostnames/IP's and saw a couple of 404 entries in my logs from googlebot.com for a URL that I'm using as a route.

Here's the line in my error log:

Code:
ERROR - (crawl-66-249-67-216.googlebot.com) 2010-03-20 20:09:06 --&gt; 404 Page Not Found --&gt; picture-of-the-day

And here's the line in routes.php:

Code:
$route['picture-of-the-day'] = "/potd";

My potd controller exists, and I can see it just fine while browsing my site. Any idea why it would be logged as a 404?

I tried to search but this was the only thing that seemed to be remotely related:

http://ellislab.com/forums/viewthread/98498/

Thanks a ton!
-Taber

googlebot 404 in my log - El Forum - 03-20-2010

[eluser]helmutbjorg[/eluser]
Not sure why you have a forward slash before the controller? Don't know if that causes any issues but the userguide suggests your route should look like:

Code:
$route['picture-of-the-day'] = "potd";

googlebot 404 in my log - El Forum - 03-20-2010

[eluser]taber[/eluser]
Thanks! I've made that change and the bot detection change in that link I posted. Hopefully one of those will do the trick. Smile