ClaudeBot
Anthropic’s crawler, which reads public pages for Claude. Like the others it identifies itself and follows robots.txt.
Related terms
Content Provenance
A record of where a piece of content came from and how it was made, sometimes attached to the file itself. Emerging as a way to tell an original photograph from a generated one.
FAQPage Schema
Markup that labels questions and their answers as questions and answers. It is the most direct way to hand an assistant something it can quote in full without swallowing the surrounding page.
Answer Box
A boxed answer at the top of a results page, lifted from one page and credited to it. Winning one usually means having answered the question plainly and early rather than burying it.
AI Search
Searching by asking a question in ordinary language and getting a written reply, rather than typing keywords and choosing from links. It changes what a website has to do: be readable and quotable by a machine, not just findable.
AI Bias
When a system produces unfair results because its training data reflected an unfair world. It matters commercially as well as ethically: a biased model makes confidently wrong decisions about real people.
HowTo Schema
Markup for step-by-step instructions, labelling each step in order. Useful for anything procedural, and easy for an assistant to reproduce accurately.