Week 4 Outline
- Discuss experience summaries
- microGPT demo folder
- microGPT: saving weights with pickle
- microGPT: Accessing embedded token weights
- microGPT: Analyzing token weights
- Byte Pair Encoding (BPE) tokenizing (demo code)
- Thursday: revisit course prediction as a linear function
- The XOR problem (demo code with interactive puzzle)
- Ideas for experience report
- Quiz 2