Tweet
How can the website be made more easily accessible to SEO robots? (A special "robots page" or code perhaps?)
-
Re: Robots guider
Originally posted by gabor View PostVisit this resource to auto-generate a compliant sitemap that you can upload to your public_html/ directory > http://www.xml-sitemaps.com
* You should also provide a small text hyperlink on your index page (usually in the footer, next to your Privacy Policy link which can be seen and shown just as "XML") to your www.YourDomain.com/sitemap.xml file as well (establishes definitive association of index page to sitemap installed), but place a transparent shape over the XML textlink so Visitors cannot use it or click on it!
You do not want people to open your sitemap.xml file, as it is not a "map" but lines of code that specifically instruct the Search Engines on what to follow, what not to follow, and where to find specific pages in an "Ordered Set" of references they can cache and later return to their Search Clients as ranked lists of results according to their querry!
If you want a usable "map" of your site for Visitor use, create an HTML sitemap file at the same auto-generator site suggested above.
To instruct the Search Engines to avoid spidering any pages, you should also create a robots.txt file, and when complimenting a sitemap.xml file, your sitemap.xml file should note specifics as mentioned here in this detailed thread > http://www.vodahost.com/vodatalk/new...-new-post.html
Basically, before you upload your sitemap.xml file, delete the coding that maps the pages you do not want spidered ... thus, it "mirrors" your 'disallow' instructions in your robots.txt file via simple omission.
Comment