Saturday, 31 May 2014

What happened to the advanced sitemaps feature?

The advanced sitemaps feature was one that allowed you to generate your sitemap and then edit it online. This feature was a beta prototype which we discontinued some time ago.

We embarked on a revamp of our website and spidering engine some time ago and maintaining the advanced editor along side the new code became inefficient. We took the decision to focus on our key services and get them right.

We are about to introduce more advanced settings and saving of sitemaps again and will be adding new editing features shortly.

Sorry if this caused you inconvenience, however we believe it is for the long term good of the service.

Tuesday, 13 May 2014

More XML Sitemap Settings

Did you know that if you choose the "More settings" option you can get more control over how our spider will index your website and generate your sitemap?

Give it a try and find out for yourself!




Sunday, 4 May 2014

How do meta robots noindex and nofollow influence my sitemap?

We try our best to process urls in the same way search engines do. This article gives a quick overview of how the meta robots tag influences your sitemap

index , nofollow


Applies to :
<meta name="robots" content="index, nofollow" />
<meta name="robots" content="nofollow" />

We include this page in your sitemap, but do not follow any of the links on it.


noindex, follow


Applies to :
<meta name="robots" content="noindex, follow" />
<meta name="robots" content="noindex" />

We do not include this page in your sitemap, but we follow any of the links on it. 


noindex, nofollow


Applies to :
<meta name="robots" content="noindex, nofollow" />

 We do not include this page in your sitemap and do not follow any of the links on it.

others


Any other values do not influence the sitemap and pages will be processed and included as normal.