Happened in AI

Glossary

Large language model

An AI system trained on very large amounts of text to predict and generate language.

A large language model (LLM) is a type of AI system trained on huge collections of text, and often code, to predict the next piece of text in a sequence. Repeating that prediction many times lets it write answers, summaries, code, and conversation. Chatbots such as ChatGPT, Claude, and Gemini are built on large language models.

"Large" refers to the number of internal settings, called parameters, and the amount of data and computing used in training. There is no fixed size at which a model becomes "large."

A common misreading is that an LLM looks facts up the way a search engine does. By default it generates text from patterns learned in training, which is why it can state false things fluently. Some products add search or document retrieval to reduce this.