Tuesday, May 05, 2009

Submitting Sitemaps using robots.txt

What are Sitemaps?

Sitemaps are an easy way for webmasters to inform search engines about pages on their sites that are available for crawling. In its simplest form, a Sitemap is an XML file that lists URLs for a site along with additional metadata about each URL (when it was last updated, how often it usually changes, and how important it is, relative to other URLs in the site) so that search engines can more intelligently crawl the site.

You can tell Google and other search engines about your Sitemap by using robot.txt

No comments: