Skip to content

Google indexing checker

Verify robots.txt and sitemap.xml: crawl signals, Sitemap declarations, and whether your default sitemap aligns with robots - server-side, no sign-up.

How it works

Three steps to your result.

  1. Enter your domain

    Paste a public domain or site URL. We fetch robots.txt and sitemap.xml from our servers (localhost and private hosts are blocked).

  2. Run the audit

    We check that core crawl files exist, list Sitemap declarations, and compare your default sitemap URL with robots.txt.

  3. Fix gaps

    Use the pass / needs-work signals to fix missing files or misaligned sitemap URLs - then verify in Google Search Console.

Frequently asked questions

Quick answers about this tool.

Does this prove I’m in Google’s index?
No. It only checks robots.txt and sitemap.xml reachability and alignment. Use Google Search Console for index coverage.
How do I check if my page is indexed by Google?
Use URL Inspection in Google Search Console: paste the full URL and it tells you whether the URL is on Google, and if not, why. A site:example.com/page search is a rough check only - a missing result does not prove the page is not indexed.
robots.txt passes here. Why is my page still not indexed?
Check the page for a noindex robots meta tag, an X-Robots-Tag header, or a canonical pointing to another URL. If none apply, Google probably crawled the page and chose not to index it, which usually points to thin or duplicate content.
What if I use a sitemap not at /sitemap.xml?
We still read Sitemap lines from robots.txt in this audit. A dedicated sitemap-only tool focuses on the default path.
Do you store my domain?
We don’t log URLs for marketing. Rate limits apply to keep the tool free.

Good to know

Context and tips to get more out of this tool.

What this index checker does, and what it cannot do

This tool checks the two files that most often stop Google from indexing a whole site. It reads robots.txt for a site-wide block, lists the Sitemap: lines, fetches /sitemap.xml, and checks that the two point to the same place. It does not ask Google whether a page is in its index. Only Google can answer that, and it shows the answer to verified site owners in Search Console.

How to check if a page is indexed by Google

The reliable way is URL Inspection in Google Search Console. Paste the full URL into the bar at the top. "URL is on Google" means it is indexed. "URL is not on Google" comes with a reason, such as a noindex tag, a canonical pointing elsewhere, or "Crawled - currently not indexed". For the whole site, open Indexing, then Pages, to see every reason in one list. A quick search for site:example.com/your-page also works as a rough check, but it is not complete: a missing result does not prove the page is not indexed, and the result counts are estimates.

Robots and sitemap alignment

Search engines read robots.txt before they budget crawl on your site. A disallow rule that accidentally blocks /blog, or a sitemap that lists noindex URLs, sends mixed signals. This checker compares robots rules and sitemap declarations side by side.

When robots.txt is fine but pages still are not indexed

Check the page itself next. A noindex robots meta tag, an X-Robots-Tag header, or a canonical that points to another URL will keep a page out even when robots.txt allows it. If none of those apply, the usual cause is quality: Google crawled the page and decided it was not worth indexing. Thin, near-duplicate, or templated pages are the common cases.

A common surprise

Issue:
robots.txt allows everything and the sitemap is valid, but Search Console says "Crawled - currently not indexed" for half the blog.
Fix:
The files are not the problem. Merge or improve thin posts, link to the ones that matter from strong pages, and re-inspect a few URLs after the changes.

See the real conversations behind this check

The moment you know your site, name, or profile is healthy, the next step is demand: find the people already discussing the problem you solve, ranked by buying intent.

Book a demo

Cancel anytime