If you've ever wondered whether our crawler is able to reach all of your pages, you should try out the new Site Diagnostics tool. To determine the meaning of your site and show relevant ads, our crawlers need to be able to access your pages. Site Diagnostics enables you to see some of the errors our crawler finds while it's crawling. You can find the Site Diagnostics page listed under the Reports tab of your account.

If our crawler is having trouble reaching any of your pages, you'll see those URLs listed in the Blocked URLs section of the Site Diagnostics table. At the moment, we're displaying two types of errors:

URL not found – this means our crawler wasn't able to reach your pages, most likely because your server was temporarily down