Large Language Models: The Big Picture
How GPT-style models are trained, aligned and deployed
4.9 26,310 students 2h 30m
Beginner
Free course
AnVisit channel
Taught by Andrej Karpathy
Lessons play via the official YouTube embed. All views credit the creator.
Create a free account to start learning
Every course is free — you just need an account so we can save your progress, bookmarks and certificates.
Intro to Large Language Models
Video by Andrej Karpathy · Watch on YouTube
AI lesson summary
A one-hour overview of what an LLM is, how base models are pretrained on internet text, and how assistants are fine-tuned from them.
Key takeaways
- An LLM is a next-token predictor
- Pretraining is compression of the internet
- Fine-tuning creates the assistant behaviour
Practical exercise
List three tasks where a base model and an assistant model would behave differently.
About this course
A practitioner-level tour of what an LLM is, how pretraining and fine-tuning work, and what the current model landscape means for builders.
llm
gpt
theory
Knowledge check
Generate a free AI quiz to test what you just learned.