crawler+google Questions - Search Marketing Arenamost recent 30 from http://www.searchmarketingarena.com2010-09-09T10:10:08Zhttp://www.searchmarketingarena.com/feeds/tag/crawler%2bgooglehttp://www.creativecommons.org/licenses/by-nc/2.5/rdfhttp://www.searchmarketingarena.com/questions/277/visits-from-google-keyword-generator-user-agentVisits from Google Keyword Generator User Agentwebface2009-11-08T20:27:52Z2009-11-08T21:45:01Z
<p>Reading my server logs, I noticed 4 hits from Google with the Google Keyword Generator user agent.</p>
<pre><code>64.233.172.1 - - [08/Nov/2009:14:24:20 +0000] "GET / HTTP/1.1" 200 4868 "-" "Mozilla/5.0 (compatible; Google Keyword Generator; +http://www.google.com/bot.html)"
64.233.172.1 - - [08/Nov/2009:14:25:34 +0000] "GET / HTTP/1.1" 200 4867 "-" "Mozilla/5.0 (compatible; Google Keyword Generator; +http://www.google.com/bot.html)"
64.233.172.1 - - [08/Nov/2009:14:25:34 +0000] "GET / HTTP/1.1" 200 4867 "-" "Mozilla/5.0 (compatible; Google Keyword Generator; +http://www.google.com/bot.html)"
64.233.172.1 - - [08/Nov/2009:14:33:44 +0000] "GET / HTTP/1.1" 200 4867 "-" "Mozilla/5.0 (compatible; Google Keyword Generator; +http://www.google.com/bot.html)"
</code></pre>
<p>What is this? Is it a new crawler? Is it Google or someone else with a different user agent?</p>
http://www.searchmarketingarena.com/questions/244/what-is-the-google-adsense-crawler-user-agentWhat is the Google AdSense Crawler user agent?webface2009-10-30T16:17:05Z2009-11-08T20:31:16Z
<p>What is the Google AdSense Crawler user agent? I assume this is not the same of Googlebot.</p>