New
AI Crawler Checker
See which AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more) your robots.txt allows or blocks.
How it works
AI Readiness Checker
Find out whether AI search engines and assistants can read, understand and cite a page. Enter a URL or paste HTML for a scored checklist with specific fixes.
Enter a URL or paste HTML
You'll get a score and a checklist of what helps or blocks AI search and assistants.
0
Page as Markdown
- 01
Enter a page URL, or paste the page's HTML if fetching isn't available.
- 02
Review the score and the checklist. Failing and warning items explain what to change.
- 03
Fix the issues, then check again to compare.
About this tool
What makes a page ready for AI
AI search tools and assistants such as ChatGPT search, Perplexity, Claude and Google's AI features can only cite what they can fetch and understand. Most of their crawlers don't run JavaScript, so content that only appears after scripts run can be invisible to them. Clear headings, semantic HTML and structured data make it easier to pick out facts and answer questions, and robots.txt decides whether they may visit at all.
This checker looks at the page as an AI crawler would: the text present in the raw HTML, heading structure, landmarks, title and description, canonical and robots meta tags, Open Graph and JSON-LD. With a URL, it also checks the site's robots.txt for 22 AI crawlers, looks for llms.txt and a sitemap, and shows the page converted to clean Markdown, close to what a language model reads. Each check explains why it matters and what to change.
Sees what AI sees
Analyses the raw HTML, the way non-JavaScript crawlers read it.
Scored checklist
Content, structure, metadata and AI access, each with a specific fix.
Site-level checks
AI crawler access in robots.txt, llms.txt and sitemap, from a URL.
Markdown preview
See the page as clean Markdown, close to what a model reads.
FAQ
Frequently asked questions
What is AI SEO or GEO?
Generative engine optimisation (GEO) is making content easy for AI search and assistants to find, understand and cite. It builds on regular SEO: crawlable pages, clear structure and accurate metadata matter most.
Why does my JavaScript site score low?
If the main content is rendered in the browser, crawlers that don't run JavaScript see an almost empty page. Server-side rendering or static generation fixes this.
Does a high score guarantee AI citations?
No. It means there are no technical barriers. Whether a page is cited depends on its content, authority and the question being asked.
Can I check a page that isn't public?
Yes: open the page, view its source, and paste the HTML. Site-level checks need a public URL.
What happens when I fetch a URL?
The address is sent to our fetching service, which downloads only that public page (or its robots.txt, sitemap or llms.txt) and returns it to your browser. Nothing is stored. Private network addresses and non-web ports are refused. You can always paste content instead.
Missing something?
Tell us the tool you wish existed.
Instant.tools grows from real requests. Describe the task you're stuck on and we'll consider building it next.