New
AI Crawler Checker
See which AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more) your robots.txt allows or blocks.
How it works
llms.txt Generator
Create an llms.txt file that gives AI assistants a clean, curated map of your site. Build it with a form, import pages from your sitemap, and check an existing file against the format.
Your site
Import pages from your sitemap
Validation
- 01
Enter your site name and a one-line summary of what it is.
- 02
Add sections (Docs, Products, Guides…) with links and short notes, or import pages from your sitemap.
- 03
Download llms.txt and upload it to your site's root, so it's served at https://yoursite.com/llms.txt.
About this tool
What is llms.txt?
llms.txt is a proposed standard (llmstxt.org) for a Markdown file at the root of a website, like /llms.txt. It gives large language models a short summary of the site and a curated list of the pages that matter, with a note about each, so an AI tool can find the right documentation or product page without crawling and cleaning hundreds of HTML pages.
The format is simple: an H1 with the site or project name, a one-line summary in a blockquote, optional details, then H2 sections that each contain a list of Markdown links with optional notes. A section called Optional holds links that can be skipped when context is short. Adoption is still growing and no major AI company has committed to reading it, so treat it as a low-effort addition alongside good HTML, structured data and an open robots.txt rather than a replacement for them.
Form or Markdown
Fill in sections and links, or edit the Markdown directly and validate it.
Sitemap import
Pull page URLs from your sitemap and group them into sections automatically.
Format validation
Checks the H1, summary, sections and link syntax with line numbers.
Saved as you go
Your draft stays in this browser until you clear it.
FAQ
Frequently asked questions
Where do I put llms.txt?
At the root of your domain, so it's available at https://example.com/llms.txt, served as plain text or Markdown.
Do ChatGPT, Claude or Google use llms.txt?
It's an emerging convention. Some AI tools and developer platforms read it, but major AI search engines haven't said they use it for ranking. It's cheap to add and helps tools that do read it.
What's the difference between llms.txt and robots.txt?
robots.txt tells crawlers what they may access. llms.txt is a curated guide to your most useful content. They work together: llms.txt can't grant access that robots.txt blocks.
What is llms-full.txt?
A companion file some sites publish with the full text of their key pages in one Markdown file. This tool focuses on llms.txt; for full text, the AI Readiness Checker can extract a page as Markdown.
Is my data sent anywhere?
No. Everything you type is processed in your browser and never leaves your device. Drafts are saved only in this browser's local storage so you can come back to them.
Missing something?
Tell us the tool you wish existed.
Instant.tools grows from real requests. Describe the task you're stuck on and we'll consider building it next.