site maps

[CarbonTerry]

I have added more pages with new content to one of my sites. I use http://sitemap.xmlecho.org/sitemap/
to generate the xml file. However, not all of the URL's/links that are on my index page are listed in the generated files. All URL's/links are text links.
Any suggestions? Could the sitemap software be seeing a cached version of my index page? HELP!!!

[CarbonTerry]

Re: site maps

Some additional info. I went to another source http://www.xml-sitemaps.com and generated 3 sitemaps. They were all different with none including all URL's.

[Karen Mac]

Re: site maps

Yes its possible for a sitemap maker to run the SE gambit and use the cache to generate the map. Its also possible that if you are running a robots.txt file that you have disallowed robots to certain pages.. and that would INCLUDE sitemap spiders.

Karen

[CarbonTerry]

Re: site maps

Thanks for the reply.
No robots.txt file. What is confusing is that I can run the sitemap generator and it comes up with different links displayed. Three different sitemaps on the tries.

[CarbonTerry]

Re: site maps

Oooops...there is a robots.txt file but it allows "all"
I also have a "no cache" file.

[Karen Mac]

Re: site maps

I dont think that meta tag keeps the SE from caching your pages.. thats when someone lands on your site, after 64mb is loaded, then the rest are refreshed instead of cached in the browser. That wouldnt keep the SE from counting your pages etc.

What are you using to generate a sitemap?

Karen

[Karen Mac]

Re: site maps

Never mind.. just scrolled up..

Try this one..

http://www.rorweb.com/rormap.htm

Karen

[CarbonTerry]

Re: site maps

I have also tried that one. It does a better job but still misses several URL's and lists other URL's for images that are on my gallery page.
What I have wound up doing is editing what is generated and add/subtract appropriate URL's.
I appreciate your help.