Theory ofIntelligence
Join Class Waitlistauto_awesomeAsk TOImailContact

Master

Build an LLM from Scratchfirst principles.

GENERATIVE AI & LLMS • BUILD, PROMPT, RETRIEVE.

Chapter-by-chapter theory notes, step-by-step textbook exercises, video lectures, and SLO-aligned board examination prep for Build an LLM from Scratch (Generative AI & LLMs).

Start First Chapter→Browse Chapters↓
3
Textbook Chapters
9
Lessons & Exercises
100%
Solved Derivations
0%
0 / 9 Completed
format_list_bulletedCurriculum & Chapterssmart_displayVideo Lecturesaccount_treeCurriculum Syllabusfolder_openExam Prep & Resources
LLM Foundations (8)Build an LLM from Scratch (9)Prompting & Using LLMs (6)Retrieval-Augmented Generation (6)Agents & Tools (6)Alignment, Evaluation & Safety (6)
Syllabus

Curriculum Syllabus

Course chapter sequence roadmap and learning outcomes.

Build an LLM from Scratch (Generative AI & LLMs)

1. Data

1.1 Preparing Text
1.2 BPE Tokenizer
1.3 Data Loaders

2. Model

2.1 GPT Architecture
2.2 Pretraining Loop
2.3 Decoding & Generation

3. Fine Tuning

3.1 Classification Fine-Tuning
3.2 Instruction Fine-Tuning
3.3 Evaluating Your LLM
INTERACTIVE LAB • 18 STEM WORKSTATIONS

Bridge High-School Science to Computational AI

Connect textbook physics, mathematics, and computing to real-world artificial intelligence models and symbolic solvers.

scienceOpen Interactive Laboratories→Board MCQs & Past Papers