Spider image-maps and more .....

Tuesday, 1 January 2013

New : Spider will now follow image-maps.

Our spider will now pick out urls from any image maps you create using standard HTML.



New : We've added a user-agent string ("XmlSitemapGenerator - http://xmlsitemapgenerator.org").

You can now see our spider activity more clearly in your server logs by looking for the user-agent string that our spider uses. This makes it easier to filter out the activity when doing stats.

Fix : Removed advance filters user interface as there we're never functional.

We had this as a demonstrator UI that was never implemented, but it leaked in to our production environment so we removed it. Oops!


Please note : changes prior to 1st Jan 2013 do not feature in our online change log.