Tweet
Hi,
I have Google Adsense on my site (www.bestbeekeeping.com). In the Google site diagnostics, there seems to be a problem with a blocked URL, and the Google solution is:
If you would like to grant our crawler access to your pages, you can do so without granting permission to any other bots. Simply add the following two lines of text to the top of your robots.txt file:
User-agent: Mediapartners-Google
Disallow:
This change will allow our crawler to index the content of your site and provide you with the most relevant Google ads for that content.
If I do this, will it stop other search engines iindexing my site?
Also, after reading other posts in the forum, my understanding is that I only need a robots.txt file if I want to stop the pages being indexed (which I don't), so do I need a robots.txt file at all? (I do not have one uploaded yet).
As always, thanks for any help.
I have Google Adsense on my site (www.bestbeekeeping.com). In the Google site diagnostics, there seems to be a problem with a blocked URL, and the Google solution is:
If you would like to grant our crawler access to your pages, you can do so without granting permission to any other bots. Simply add the following two lines of text to the top of your robots.txt file:
User-agent: Mediapartners-Google
Disallow:
This change will allow our crawler to index the content of your site and provide you with the most relevant Google ads for that content.
If I do this, will it stop other search engines iindexing my site?
Also, after reading other posts in the forum, my understanding is that I only need a robots.txt file if I want to stop the pages being indexed (which I don't), so do I need a robots.txt file at all? (I do not have one uploaded yet).
As always, thanks for any help.