Free tool · Technical SEO

Can Google find all your pages?

Type your website. We find the sitemap, count the pages in it, test a few of them, and read robots.txt for anything blocking Google or AI tools.

  1. Reading robots.txt
  2. Finding the sitemap
  3. Counting pages and testing a sample

What we check

  • Whether robots.txt exists, and whether it blocks Google or all crawlers from the whole site.
  • Whether AI crawlers such as GPTBot, ClaudeBot and PerplexityBot are blocked.
  • Where the sitemap is, from robots.txt or the usual addresses, including sitemap indexes from Yoast, Rank Math and Shopify.
  • How many pages it lists and when it was last updated.
  • Whether a sample of the listed pages actually loads.

Common mistakes

A "Disallow: /" left over from when the site was being built, which hides everything from Google. A sitemap that still lists the old website's pages after a rebuild. And sitemaps full of redirects and missing pages, which tell Google the site is badly kept. All three are quick to fix once you know.