crawler+google Questions - Search Marketing Arena most recent 30 from http://www.searchmarketingarena.com 2010-09-09T10:10:08Z http://www.searchmarketingarena.com/feeds/tag/crawler%2bgoogle http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://www.searchmarketingarena.com/questions/277/visits-from-google-keyword-generator-user-agent Visits from Google Keyword Generator User Agent webface 2009-11-08T20:27:52Z 2009-11-08T21:45:01Z <p>Reading my server logs, I noticed 4 hits from Google with the Google Keyword Generator user agent.</p> <pre><code>64.233.172.1 - - [08/Nov/2009:14:24:20 +0000] "GET / HTTP/1.1" 200 4868 "-" "Mozilla/5.0 (compatible; Google Keyword Generator; +http://www.google.com/bot.html)" 64.233.172.1 - - [08/Nov/2009:14:25:34 +0000] "GET / HTTP/1.1" 200 4867 "-" "Mozilla/5.0 (compatible; Google Keyword Generator; +http://www.google.com/bot.html)" 64.233.172.1 - - [08/Nov/2009:14:25:34 +0000] "GET / HTTP/1.1" 200 4867 "-" "Mozilla/5.0 (compatible; Google Keyword Generator; +http://www.google.com/bot.html)" 64.233.172.1 - - [08/Nov/2009:14:33:44 +0000] "GET / HTTP/1.1" 200 4867 "-" "Mozilla/5.0 (compatible; Google Keyword Generator; +http://www.google.com/bot.html)" </code></pre> <p>What is this? Is it a new crawler? Is it Google or someone else with a different user agent?</p> http://www.searchmarketingarena.com/questions/244/what-is-the-google-adsense-crawler-user-agent What is the Google AdSense Crawler user agent? webface 2009-10-30T16:17:05Z 2009-11-08T20:31:16Z <p>What is the Google AdSense Crawler user agent? I assume this is not the same of Googlebot.</p>