Some fixes applied
Monday, 21 January 2013
Fix : Indexing websites with port number.
Our spider was not able to manage port numbers and this should now be fixed.e.g. http://XmlSitemapGenerator.org:8080/demo
Fix : Some issues with indexing framesets and image maps.
We refined the way we process framesets and image maps as some html formats/ordering were not working for users.
Sitemap file limit increased and support for frames added.
Thursday, 10 January 2013
New : File limit increased from 100 to 250 (as a trial).
Quite a number of users were hitting the 100 file limit and our performance data suggetsed we had capacity to increase this so we have and will keep an eye on the situation to ensure it stays efficient.New : Index iFrames and Frameset option.
We have added support for following urls embedded in iFrames and Framesets. This feature is enabled by default, so if you want to disable it click "more settings".New : Default settings changed so it will spider all links and query strings by default.
We had quite a few people frustrated they had to keep selecting features and it seemed fairly obvious we should spider most urls by default so we made it so! You can now switch stuff off using "more settings".Fix : Some problems with checking querystring and file extensions.
Some patterns of dots and ampersands were causing some issues so we fixed this.
Sitemap email notification feature
Saturday, 5 January 2013
New : Email alert facility to let you know when your sitemap is ready.
Instead of sitting there waiting for your sitemap you can now enter your email address so that when your sitemap is ready, we will send you an email to let you know!Fix : Error locating sitemap when spidering from a non root location.
Some users were using urls that were not the root of the domain e.g. xmlsitemapgenerator.org/illustration and this was sometimes tripping our spider up.
Spider image-maps and more .....
Tuesday, 1 January 2013
New : Spider will now follow image-maps.
Our spider will now pick out urls from any image maps you create using standard HTML..jpg)
New : We've added a user-agent string ("XmlSitemapGenerator - http://xmlsitemapgenerator.org").
You can now see our spider activity more clearly in your server logs by looking for the user-agent string that our spider uses. This makes it easier to filter out the activity when doing stats.Fix : Removed advance filters user interface as there we're never functional.
We had this as a demonstrator UI that was never implemented, but it leaked in to our production environment so we removed it. Oops!Please note : changes prior to 1st Jan 2013 do not feature in our online change log.
Subscribe to:
Posts (Atom)