LLM.

A Large Language Model (LLM) is a type of artificial intelligence model trained on text from books, websites, code repositories, and other sources at massive scale. The 'large' refers both to the amount of training data (trillions of tokens) and the model's size (billions of parameters). LLMs learn statistical patterns in language that translate into surprisingly broad capabilities.

Modern LLMs are built on the Transformer architecture, which uses attention mechanisms to understand relationships between words across long distances. They are trained using self-supervised learning — predicting the next word in a sequence — which requires no human-labeled data and scales efficiently with more compute and data.

The capabilities of LLMs have expanded dramatically since GPT-3's release in 2020. Today's frontier models can write software, analyze medical research, tutor students, generate creative fiction, and reason through complex logic problems. They have become infrastructure for a new generation of AI-powered products across virtually every industry.