Robots.txt controls crawling
If robots.txt blocks a URL, search engines may not be able to fetch the page to read its content or directives.
Paste a URL and check the signals that affect crawl and index eligibility: redirects, status codes, robots.txt access, noindex directives, and canonical tags.
Run a check to see the page's crawl and indexability signals.
A page can be live and still be invisible to search. Indexability is the technical side of the question: can a crawler reach the URL, is it allowed to crawl it, and does the page tell search engines to keep it out of the index or treat another URL as the main version?
If robots.txt blocks a URL, search engines may not be able to fetch the page to read its content or directives.
A noindex directive tells search engines not to include the page in search results, even when the page is crawlable.
A canonical tag can tell search engines that another URL should receive the indexing and ranking signals.
For the bigger picture, read crawlable vs. indexable vs. indexed and how to find your site if Google has not indexed it yet, or use this with the robots.txt checker and sitemap validator.
Indexability is a page's technical eligibility to appear in search results. A page is indexable when search engines can fetch it (a working URL that robots.txt does not block) and nothing on the page says to stay out of the index: no noindex directive, and no canonical tag pointing at a different URL.
Indexability sits in the middle of a three-step chain. Crawlable means a search engine can fetch the page. Indexable means the fetched page is allowed into search results. Indexed means it actually made it in. Each step gates the next, and the failures look identical from a browser, which is why this needs a tool instead of eyeballs. The full breakdown lives in crawlable vs. indexable vs. indexed.
Nearly every "my page isn't showing up" case I audit comes down to one of these five.
Anything other than a 200 at the final URL is a problem: 5xx errors get pages dropped, 4xx means the page is gone as far as Google is concerned, and soft 404s (a "not found" page served with a 200) confuse everything. Fix: make the URL return a clean 200, or a single 301 to the page that should rank instead.
Robots.txt controls crawling, not indexing. A blocked page can even stay in the index from before the block, showing a bare URL with no description. Fix: unblock pages you want ranked. If you want a page out of the index, use noindex and let Google crawl it to see the directive.
The meta tag version is visible in the source. The header version isn't, which is why noindex left over from staging survives launches and goes unnoticed for months. Fix: remove the directive from the page or the server config, then request reindexing in Search Console.
A canonical pointing at another URL asks search engines to index that URL instead. Common on migrated sites where canonicals still reference the old domain or the no-slash variant. Fix: every page that should rank gets a self-referencing canonical, exactly matching the live URL format.
Each hop wastes crawl budget and leaks signals, and chains of three or more from old migrations are common. Fix: point every redirect straight at the final destination in one hop.
The four summary cards mirror the four deciding signals: HTTP status, robots.txt, noindex, and canonical. A clean result is a 200, Allowed, no noindex, and a canonical matching the tested URL. Below the cards, each finding carries a color. Teal means the signal passed. Yellow means look closer. Red means something is keeping this page out of search until you fix it. Every finding names the fix.
The $500 flat-rate health check covers crawl and indexation across the whole site: every template, the redirect map, robots.txt, canonicals, and the sitemap, plus performance, metadata, schema, and analytics. You get a written report in plain English within 48 hours.
SEO workflow
A page can be live, crawlable, and still missing from Google. This checker connects the technical signals that decide whether a URL appears eligible for indexing: status codes, redirects, robots.txt, noindex, canonicals, and sitemap consistency.
Redirects, HTTP to HTTPS behavior, and canonical tags can change which URL search engines are actually being asked to keep.
Fix hard technical blockers before rewriting content, because Google cannot evaluate a page it cannot crawl or is told not to index.
The tool checks public signals quickly; Google Search Console confirms how Google has actually seen the URL.
The diagnostic sequence for pages missing from Google.
How the tool ties crawl, index, canonical, and redirect checks into one report.
Indexability is a page's technical eligibility to appear in search results. A page is indexable when search engines can fetch it (a working URL that robots.txt does not block) and nothing on the page says to stay out of the index: no noindex directive, and no canonical tag pointing at a different URL.
Run the URL through an indexability checker to read the technical signals in one pass: HTTP status, robots.txt access, noindex directives, and the canonical tag. Then confirm actual index status with the URL Inspection tool in Google Search Console, which is the only authoritative source.
No. The tool checks whether a page appears eligible to be crawled and indexed based on visible technical signals. It cannot confirm Google's actual index status without Google Search Console data.
Common causes include robots.txt crawl blocks, noindex directives, X-Robots-Tag headers, redirects, error status codes, and canonical tags pointing to a different URL.
Crawlability is whether a search engine can fetch the page at all. Robots.txt, status codes, and redirects control it. Indexability is whether the fetched page is allowed into search results. Noindex directives and canonical tags control that. A page can be crawlable but not indexable, and a blocked page can even stay indexed from before the block.
Yes. It's free, with no signup and no account required. The tool fetches the URL you submit as the crawler you select and reports the status, robots, noindex, and canonical signals on this page.