1 reply to this topic

[mbcfdude]

Hi,
We have a really large SEO initiative and really like this software but we have 6,781 total unique pages and for "links scanned" and 'total links' we've just crossed over the 1 million mark and its' still going. I'm seeing this as an exponential problem. As we grow more total unique pages and have more links, this becomes an unusable solution.

I easily got through the almost 7k pages within a few hours (~ 6) but have seen this program run for about 3 days just scanning the links.

For the record, your software doesn't display 1 million correctly, it's currently showing: 1.0131023+6

I'm happy this is scanning links and it does still find a few original pages but I can't keep this running for 3 days+ to get through my site and do this each day / week / month to generate a new sitemap.

I'm currently running version 2.5.1 on OSX Lion.

Any help / suggestions are appreciated.

- Rob

[RageSW]

Hi Rob,

That's the nature of your website. You can't really get around this.

However because all the links just appear duplicated once you get to the 6-7k mark you can stop the scan.

Sitemaps don't have to have every single link as Google can discover more on its own. It isn't vital that you collect the last (if any links), by keeping the app open for 3 days.