Sunday, 4 May 2014

How do meta robots noindex and nofollow influence my sitemap?

We try our best to process urls in the same way search engines do. This article gives a quick overview of how the meta robots tag influences your sitemap

index , nofollow


Applies to :
<meta name="robots" content="index, nofollow" />
<meta name="robots" content="nofollow" />

We include this page in your sitemap, but do not follow any of the links on it.


noindex, follow


Applies to :
<meta name="robots" content="noindex, follow" />
<meta name="robots" content="noindex" />

We do not include this page in your sitemap, but we follow any of the links on it. 


noindex, nofollow


Applies to :
<meta name="robots" content="noindex, nofollow" />

 We do not include this page in your sitemap and do not follow any of the links on it.

others


Any other values do not influence the sitemap and pages will be processed and included as normal.