Hi,My site has over 14000 pages and the sitemap generated shows only ~300+ links in it. I noticed that the pages are being skipped. When the crawler is executing, I can see all those pages being crawled, however they are not getting added in the sitemap.

Issue #2:I want the crawler to ignore a certain type of query. I have tried blocking Disallow: /? and also tried the generator exclude url. Both works fine. However, the crawled URL's are now even less.

Would appreciate if you could help me fix/ look into what is going wrong in my case.

Hi,I just noticed that when I use your free sitemap tool for the same site I use your unlimited sitemap generator, all the skipped url's are perfectly being crawled and added to the sitemap. I'm wondering why your unlimited generator is skipping my URL's when the free tool can generate properly.