Hey friend! Have fun exploring Q&A, but in order to ask your own
questions, comment, or give thumbs up, you need to be logged in to your
Moz Pro account.
You can also earn access by receiving 500
MozPoints
from participating in YouMoz and the Moz Blog!

Why have only 6 pages been crawled?

Hi there, I have an e-commerce website which has about 30 product pages and categories and other auxiliary pages. How come when I come to generate a sitemap to submit to search engines it tells me that there are only 6 pages?

3 Responses

First thing - you have to setup a canonical tag on your homepage. Currently you can either access your site by www.biogameuk.com or http://biogameuk.com.

Next, if you Google: site:www.biogameuk.com you will see that you are correct in that Google has only indexed 5 pages; however, if you Google: site:http://biogameuk.com you will see Google has indexed 225 pages.

One of the reasons you are getting this separation is because of the linking structure you have in place on the www-version of your site. The logo links to the www-version of the homepage (when you are viewing a www-page... it changes to non-www when on non-www pages). It appears that you are also linking to the www-versions of /sports-supplements-competition, /sponsorship-fundraising, /newsletter-signup, and /diet-plans pages when you are on the www-version of the site; however, you are linking the rest of the pages as non-www.

You need to choose to use either the www or non-www version of your site and make sure that you links are set up appropriately. You also need to choose your preferred domain in Google Webmaster Tools.

As far as home many pages your site actually has... a scan I am running with ScreamingFrog is showing 5000+ (it is still scanning). The reason I am getting such a high reading is including all of the URLs you link to. So for instance, on your /weight-loss-supplements page, here are some of the additional URLs it is seeing as links:

/weight-loss-supplements?limit=15

/weight-loss-supplements?limit=25

/weight-loss-supplements?limit=50

/weight-loss-supplements?limit=75

/weight-loss-supplements?limit=100

and also all of the Sort By options A-Z, Z-A, etc.

You have a nice HTML sitemap built already. I guess if I were you, I would maybe just create an XML-based sitemap using the HTML sitemap as a guide.

Whenever I go to Google Webmaster Tools it asks me to verify the website but then doesn't give me the option to do anything about verifying the site. Do you know how I can do this? What do I need to do to be verified?

Hey friend! Have fun exploring Q&A, but in order to ask your own
questions, comment, or give thumbs up, you need to be logged in to your
Moz Pro account.
You can also earn access by receiving 500
MozPoints
from participating in YouMoz and the Moz Blog!
Learn more.