Free tool · Technical SEO
Can Google find all your pages?
Type your website. We find the sitemap, count the pages in it, test a few of them, and read robots.txt for anything blocking Google or AI tools.
- Reading robots.txt
- Finding the sitemap
- Counting pages and testing a sample
What we check
- Whether robots.txt exists, and whether it blocks Google or all crawlers from the whole site.
- Whether AI crawlers such as GPTBot, ClaudeBot and PerplexityBot are blocked.
- Where the sitemap is, from robots.txt or the usual addresses, including sitemap indexes from Yoast, Rank Math and Shopify.
- How many pages it lists and when it was last updated.
- Whether a sample of the listed pages actually loads.
Common mistakes
A "Disallow: /" left over from when the site was being built, which hides everything from Google. A sitemap that still lists the old website's pages after a rebuild. And sitemaps full of redirects and missing pages, which tell Google the site is badly kept. All three are quick to fix once you know.