robots.txt, sitemap and llms.txt checker

What do search engines and AI crawlers see when they arrive?

Live lookupPlain English + technicalFree, no sign-up

How to read the results

Blocking Googlebot hides the site from Google search.
AI bots listed are blocked by robots.txt rules.

Check everything at once

The health check runs this and 30 more checks on a domain, then ranks what to fix.

More in Website and HTTP

HTTP checkLoad a URL and break down DNS, connect, TLS and first byte.
Is it down?Is a website down for everyone or just you?
Geoblock checkerSee which countries can open a URL and which are blocked.
Redirect tracerTrace every redirect from first URL to final page.
Security headersGrade a site’s security headers from A to F.
Website speedTime a page load and weigh its assets.
HTTP/2, HTTP/3, IPv6 supportCheck HTTP/2, HTTP/3 and IPv6 support.
What’s that site running?See every technology a website runs: CDN, host, CMS, scripts and trackers.
Sitemap inspectorValidate a sitemap, follow its index and spot risks.
Meta tag / link checkerPreview search and social cards, find broken links.

About the robots.txt, sitemap, llms.txt

Check a site’s robots.txt, sitemap.xml, llms.txt and security.txt: which crawlers and AI bots are blocked and whether sitemaps are valid.

Every result comes in two styles: plain English for everyone, and the exact technical detail for engineers, with the raw JSON one click away.

Questions

A proposed file that gives AI assistants a short, clean summary of your site.