most recent 30 from http://www.searchmarketingarena.com 2010-07-30T08:43:03Z http://www.searchmarketingarena.com/feeds/tag/robots.txt http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://www.searchmarketingarena.com/questions/35/how-to-block-all-crawlers-excepts-google-adsense-and-google-adwords Andre4 2009-10-14T08:01:28Z 2009-12-16T12:20:50Z

<p>Which is the right syntax to block all crawlers excepts Google AdSense and Google AdWords using a robots.txt? This is the content of my robots.txt file</p> <pre><code>User-agent: Mediapartners-Google Allow: / User-agent: Adsbot-Google Allow: / </code></pre>

http://www.searchmarketingarena.com/questions/389/remove-pages-with-querystring-parameter-from-google petez 2009-12-05T10:23:44Z 2009-12-06T12:05:30Z

<p>How to remove all pages with the id_category querystring parameter from Google index?</p>

http://www.searchmarketingarena.com/questions/299/strategy-to-change-domain-name-without-risk-google-problem enzone 2009-11-12T22:49:24Z 2009-11-13T20:41:32Z

<p>Hi, I've to change a domain name, in the meanwhile that I complete the work with the right 301 Redirect for all the pages, I'm thinking to approach in the following way: - set the Robots in order to avoid that google will spider the site - change all the necessary - create the new sitemap - reset the Robots to the normal - submit the new sitemap</p> <p>Will I have negative impact due to the Robots update?</p> <p>Is it the right approach?</p> <p>Regards Enzo</p>

http://www.searchmarketingarena.com/questions/104/i-dont-have-a-robots-txt-file-is-it-a-problem petez 2009-10-17T14:45:05Z 2009-10-19T17:13:54Z

<p>My corporate website is managed with a third party CMS and I can't upload new files on the server. I can add pages but I don't have any option to create a robots.txt file.</p> <p>I saw many other websites doesn't provide a robots.txt file but I don't know whether this can harm my website ranking.</p>