llms.txt
An emerging convention: a plain-text file at your site root that gives AI systems a clean map of what is on it. It saves an assistant from crawling around to work out what your site contains.
Related terms
Hallucination
When an AI states something false with complete confidence — an invented price, a policy you never had, a product you do not sell. The usual cause is that the correct fact was not available anywhere it could read.
Context Window
How much text a model can hold in mind at once, counted in tokens. Anything beyond it is forgotten, which is why very long conversations start to lose earlier details.
robots.txt
A plain text file at the root of a site listing which bots may read what. It is a request rather than a lock — well-behaved crawlers obey it, and all the major AI crawlers do.
Microdata
An older way of marking up facts, written as attributes on the HTML itself rather than in a separate block. Still understood, but JSON-LD is now the safer choice.
LLM (Large Language Model)
The kind of AI behind ChatGPT, Claude and Gemini. It is trained on an enormous amount of text and predicts what should come next, which is enough to answer questions, summarise, translate and write.
Training Data
The text, images or code a model learned from. It shapes everything the model knows and every bias it carries, and it is why what your website said two years ago may still be what an assistant repeats.