Supervised Learning
Training a model on examples that are already labelled with the right answer. It is the most common approach when you know exactly what you want the system to produce.
Related terms
Content Negotiation
When the same URL serves different formats depending on what the visitor asks for — HTML for a browser, Markdown for an assistant. It lets one address serve people and machines without either getting a compromise.
AI Crawler
A bot that reads websites on behalf of an AI company, either to build an index or to answer a live question. They arrive under their own names and obey robots.txt, so you can decide which are welcome.
JSON-LD
The format Google and the AI assistants prefer for structured data — a block of machine-readable facts tucked into the page. It states plainly what prose only implies: this is the business, this is the address, this is the price.
Agentic Browsing
An AI navigating a website on somebody’s behalf: finding the price, checking availability, sometimes buying. Sites that rely on hover menus and unlabelled buttons are hard for an agent to use.
Speech Recognition
Turning spoken words into text. It underpins voice search, dictation and call transcription, and it now handles accents and background noise far better than it used to.
ClaudeBot
Anthropic’s crawler, which reads public pages for Claude. Like the others it identifies itself and follows robots.txt.