I’ve noticed that much of my web traffic has come from Google and MSN bots crawling my site – they count for almost fifty percent of my traffic!
So I found this interesting script that you can include on your site that will email you a notification everytime a googlebot crawls your site:
if(eregi("googlebot",$HTTP_USER_AGENT)) {
if ($QUERY_STRING != "")
{$url = "http://".$SERVER_NAME.$PHP_SELF.'?'.$QUERY_STRING;}
else
{$url = "http://".$SERVER_NAME.$PHP_SELF;}
$today = date("F j, Y, g:i a");
mail("[email protected]", "Googlebot detected on http://$SERVER_NAME", "$today - Google crawled $url");
}