vote up 1 vote down
star

What is the Google AdSense Crawler user agent? I assume this is not the same of Googlebot.

flag

3 Answers

vote up 2 vote down
check

A typical Google AdSense crawler user agent is

Mediapartners-Google/2.1

Googlebot is usually identified by the following one

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

As explained by franseo, in the robotx.txt file you can easily refer to the Google AdSense crawler as Mediaparter-Google.

link|flag
vote up 1 vote down

May be this Mediapartners-Google.

link|flag
vote up 1 vote down

Google Search:

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google Image:

Googlebot-Image/1.0

Google Mobile:

SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

Google Adsense:

Mediapartners-Google

Google Adwords:

AdsBot-Google (+http://www.google.com/adsbot.html)

Google Reader:

Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; XYZ subscribers; feed-id=XXXXXYYYYZZZZZ)
link|flag
Excellent answer! – weppos Nov 8 at 20:31

Your Answer

Get an OpenID
or

Not the answer you're looking for? Browse other questions tagged or ask your own question.