Sitemaps in your robots.txt file?
April 12th, 2007
Google has recently announced some interesting new features to sitemaps.org. As well as now being available in 18 languages, including Japanese and German, but they have also made it easier to advise search engine robots of sitemap files.
By adding a line as follows:
Sitemap: http://www.e-gain.co.uk/sitemap.xml (including full URL ie http:// etc
to your robots.txt file, any search engine supporting the sitemap protocol will be able to retrieve the sitemap and process accordingly, including Google, Yahoo, MSN and ASK.
To read further please visit
Entry Filed under: SEO Industry, Search Engines, SEO
1 Comment Add your own
1. The X-Robots-Tag : Contro&hellip | July 19th, 2007 at 11:04 pm
[…] Hot on the heels of my previous post “Google Takes the Robots Meta Tag Further“ comes news that Google has now added the ability to manipulate robots without a Robots Meta Tag or a robots.txt file. How? and what use can this possibly serve? […]
Leave a Comment
You must be logged in to post a comment.
Trackback this post | Subscribe to the comments via RSS Feed