How do meta robots noindex and nofollow influence my sitemap?
Sunday, 4 May 2014
We try our best to process urls in the same way search engines do. This article gives a quick overview of how the meta robots tag influences your sitemapindex , nofollow
Applies to :
<meta name="robots" content="index, nofollow" />
<meta name="robots" content="nofollow" />
We include this page in your sitemap, but do not follow any of the links on it.
noindex, follow
Applies to :
<meta name="robots" content="noindex, follow" />
<meta name="robots" content="noindex" />
We do not include this page in your sitemap, but we follow any of the links on it.
noindex, nofollow
Applies to :
<meta name="robots" content="noindex, nofollow" />
We do not include this page in your sitemap and do not follow any of the links on it.
others
Any other values do not influence the sitemap and pages will be processed and included as normal.
