llms.txt generator
Create a concise Markdown source map from your core pages.
Open generatorAI search visibility toolkit
Create a clean /llms.txt, align crawler access, and publish source pages that search engines and AI answer engines can understand without guessing.
Free tool
Generated locally in your browser.
Toolbox
Generate, validate, convert, and audit the files that help crawlers and AI assistants understand your strongest source pages.
Create a concise Markdown source map from your core pages.
Open generatorPaste sitemap XML or URLs and draft a source map to refine.
Open converterCheck headings, summary, source links, and concise structure.
Open validatorDraft crawler rules for search, user retrieval, and training bots.
Open builderReview whether your policy supports AI search visibility.
Open checkerCheck whether your pages are crawlable, factual, and citeable.
Open checklistWhat to build first
Google's public guidance for AI search emphasizes unique, valuable content, crawlability, page experience, and structured data that matches visible content. Bing's webmaster guidance says the same SEO foundation supports AI grounding and Copilot visibility.
Answer exact questions with first-hand, specific information. AI systems need sources they can quote, not vague category pages.
Learn the source-page patternA concise llms.txt file can point assistants to your strongest docs, pricing, policies, and factual reference pages.
Generate the fileDecide which bots can crawl your site and keep that policy consistent with your search and AI visibility goals.
Build robots.txtExamples and decisions
Use examples and comparisons to avoid treating llms.txt like a replacement for sitemap.xml, robots.txt, or useful source pages.
Compare concise examples for SaaS, ecommerce, publisher, documentation, and local sites.
Open examplesLearn why sitemap.xml is for URL discovery while llms.txt is a curated source map.
Read comparisonSeparate crawler permissions from AI-readable guidance for your strongest pages.
Read comparisonPlatform recipes
Each recipe focuses on what source pages to include and how to keep the file useful for AI assistants without promising unsupported platform magic.
Map cornerstone pages, category hubs, editorial policy, authors, and evergreen explainers.
Open WordPress recipeHighlight buying guides, collections, shipping, returns, warranty, and customer support pages.
Open Shopify recipeKeep static source pages discoverable and align canonical URLs with generated files.
Open Next.js recipeExpose quickstarts, API references, SDK guides, versioned docs, and changelogs.
Open Docusaurus recipePoint assistants to README, docs, examples, releases, license, and contribution pages.
Open GitHub Pages recipeConnect product pages, comparisons, case studies, pricing, and trust pages.
Open Webflow recipeBot guides
Several AI companies now document different crawlers for search, user-triggered retrieval, and training. Treat them separately when you write robots.txt rules.
Allow search discovery while deciding separately whether training crawls fit your policy.
Read OpenAI bot guideMap Anthropic's three documented agents to search, user retrieval, and training choices.
Read Claude guideUnderstand what Perplexity says it indexes when pages are allowed or disallowed.
Read Perplexity guideLong-tail library
Start with a template, then rewrite it with real details from your website. Thin generic files do not create durable search value.
Prioritize docs, pricing, integrations, security, changelog, and support policy pages.
Open SaaS templateHighlight category hubs, buying guides, shipping policy, returns, warranty, and product data feeds.
Open ecommerce templateExpose evergreen explainers, editorial policy, author pages, corrections, and topic archives.
Open publisher templatePoint AI assistants to quickstarts, API reference, examples, SDKs, and changelogs.
Open docs templateClarify service areas, booking, pricing, policies, location pages, and trust signals.
Open local template