3 replies to this topic

[Mark Derrick]

Just started using SiteMap Automator on our site, set up a couple of rules to exclude non product pages, and we then let it run.

However, it only finds 180 pages, and the end result in the "edit pages" screen is that it just lists the one page www.computerwarehouse.co.uk/empty.html.

We're using NetSuite, a SaaS provider - and cannot see any reason this is happening.

Any suggestions?

Thanks.

[RageSW]

Hi Mark,

All of your pages are returning a 302 redirect when they don't actually redirect to another page. The content management system you have used appears to be at fault and you won't be able to easily create a proper sitemap with it.

Even if other software works, your sitemap will not be effective because all of your pages return a 302 redirect when trying to access them. They should be returning a 200 success code.

[Mark Derrick]

Hi Mark,

All of your pages are returning a 302 redirect when they don't actually redirect to another page. The content management system you have used appears to be at fault and you won't be able to easily create a proper sitemap with it.

Even if other software works, your sitemap will not be effective because all of your pages return a 302 redirect when trying to access them. They should be returning a 200 success code.

Thanks for your help with this.
I've asked our software provider to investigate this issue.

However, I've also come across a posting on their support forum relating to what may be a similar issue.

-----------------------------------------------------
We've also had site-mapping issues with our descriptive URLs that don't end in HTML or "/" or ".jpg" or "/parameter=...". There is only one decent Goggle map making program for the MacOS (made by Rage software) and it rejects URLs that don't end with standard web endings or else it adds "/" to the end of category URLs that it thinks are missing the proper ending.
-----------------------------------------------------

Could this also be connected?

[Mark Derrick]

Hi Mark,

All of your pages are returning a 302 redirect when they don't actually redirect to another page. The content management system you have used appears to be at fault and you won't be able to easily create a proper sitemap with it.

Even if other software works, your sitemap will not be effective because all of your pages return a 302 redirect when trying to access them. They should be returning a 200 success code.

Thanks for your help with this.
I've asked our software provider to investigate this issue.

However, I've also come across a posting on their support forum relating to what may be a similar issue.

-----------------------------------------------------
We've also had site-mapping issues with our descriptive URLs that don't end in HTML or "/" or ".jpg" or "/parameter=...". There is only one decent Goggle map making program for the MacOS (made by Rage software) and it rejects URLs that don't end with standard web endings or else it adds "/" to the end of category URLs that it thinks are missing the proper ending.
-----------------------------------------------------

Could this also be connected?

Here's some further feedback from our software provider.

Below may be the reasons why your third party application not generate the sitemap correctly.
User agent setting- If your sitemap generator is not using some popular user agent like Firefox or IE but an unknown one to Netsuite, since unknown crawlers are bandwidth throttled, so it may fail to crawl the site.
Request Method - 'HEAD' method http request is not supported in Netsuite. If your sitemap generator is using 'HEAD' method, it will end up getting a 404 page or 302 redirect.
File extension- Netsuite is using some file extension like .nl or .f. It will be a better idea to generate the sitemap base on MIME type instead of using file extension to ensure every page is included in the sitemap.
Max simultaneous connections - Web store hosted on Netsuite are dynamic pages. You may get an 503 page if too many simultaneous connections are sending request to the server at the same time.