這裡是版主CS336學習記錄的總目錄
課程網站：https://cs336.stanford.edu/
課程影片：https://www.youtube.com/playlist?list=PLoROMvodv4rOY23Y0BoGoBGgQ1zmU_MT_
Basics
Stanford CS336 Day 1 - Overview, Tokenization
Stanford CS336 Day 2 - Pytorch, Resource Accounting
Stanford CS336 Day 3 - Architectures, Hyperparameters
Stanford CS336 Day 7 - Mixture of experts
Assignment 1
Systems
Stanford CS336 Day 8 - GPUs
Stanford CS336 Day 9 - Kernels, Triton
Stanford CS336 Day 10 - Parallelism
Stanford CS336 Day 11 - Parallelism 2
Scaling Laws
Stanford CS336 Day 12 - Scaling laws
Stanford CS336 Day 13 - Inference
Stanford CS336 Day 14 - Scaling laws 2
Data
Stanford CS336 Day 15 - Evaluation
Stanford CS336 Day 16 - Data 1
Stanford CS336 Day 17 - Data 2
Alignment
Stanford CS336 Day 18 - 15. Alignment - SFT/RLHF
Stanford CS336 Day 19 - Alignment - RL 1
Stanford CS336 Day 20 - Alignment - RL 2