On this page
What a sitemap is for
A sitemap lists the pages you want crawled. It does not guarantee indexing, but it helps search engines find new pages faster.
What robots.txt is for
robots.txt tells crawlers what not to fetch, such as filtered collection URLs that create duplicate content.
Common mistakes
Blocking pages you want indexed, and leaving thousands of filter URLs open to crawlers.