AI Chatbot Glossary
What Is llms.txt?
llms.txt is a proposed plain-text Markdown file placed at the root of a website (for example, example.com/llms.txt) that gives large language models a concise, curated summary of the site and links to its most important pages.
Definition
The llms.txt proposal was published in 2024 as a lightweight convention, similar in spirit to robots.txt or sitemap.xml but aimed at AI readers rather than crawlers. The file is Markdown: a title, a short description of the site or product, and grouped lists of links with one-line notes about what each page contains. A companion llms-full.txt can hold the full text of key documentation. The idea is to help a model that has limited context pick the right pages instead of guessing from navigation menus. As of 2026 adoption is voluntary, and there is no public confirmation that the major AI search engines require or prioritise it, so it is best treated as a low-cost complement to good page structure, not a ranking lever.
Why llms.txt Matters for AI Chatbots
For a store, an llms.txt file is a five-minute way to point an assistant at your shipping policy, returns page, size guide, and top categories in one place. It does not replace structured data, accurate product pages, or clean crawling, which is where AI engines actually get most of their facts. Chatonbo's crawler follows normal links and sitemaps when it trains your assistant, so the same tidy site structure that helps llms.txt readers also produces a better on-site bot.
Related Terms
Generative Engine Optimization (GEO)
Generative engine optimization (GEO) is the practice of making a website's content more likely to be used, cited, and recommended by generative AI engines such as ChatGPT, Perplexity, Gemini, and Google's AI Overviews.
Answer Engine Optimization (AEO)
Answer engine optimization (AEO) is the practice of structuring content so that answer engines, including AI assistants, voice assistants, and search features like featured snippets, can extract and present it as a direct answer to a question.
Large Language Model (LLM)
An LLM is an AI model trained on vast amounts of text that can understand and generate human language - LLMs like GPT-5.4, Claude, and Gemini power modern chatbots.
Knowledge Base
A knowledge base is a structured collection of information (documents, FAQs, policies) that a chatbot uses to find accurate answers - searched in real time to ground responses.