Foundation Model.
A large AI model trained on broad data at massive scale that can be adapted to a wide variety of downstream tasks, forming the 'foundation' for specialized applications.
The term 'foundation model' was coined by Stanford researchers in 2021 to describe large AI models trained on internet-scale data that serve as a general starting point for diverse applications. GPT-4, Claude, Gemini, and Llama are all foundation models — each capable of writing, coding, reasoning, summarizing, and translating without task-specific training.
What makes foundation models powerful is their emergent capabilities: abilities that appear at scale that weren't explicitly trained for. As models grow larger, they spontaneously acquire new skills like arithmetic, analogical reasoning, and multilingual translation — behaviors that weren't seen in smaller models trained on the same data.
Foundation models represent a fundamental shift in AI development. Instead of training separate models for each task, organizations can fine-tune a single foundation model for multiple applications. This dramatically reduces the cost and expertise required to deploy AI, which is why foundation models have catalyzed an explosion of AI-powered products since 2022.