reply
If you have a coding agent available, ask it to try transcribing a few of the PDFs.
I spent a days reviewing the lecture notes for CS336: Language Modeling from Scratch - and then trained a nanoGPT-esque model in PyTorch.
I'd recommend trying it for those who are curious. Computational bottlenecks become much more intuitive when you've looked at the overall process.
I got 83/100 suggesting 60,000.
My SAT reading was 760/800.
Would be great to have a community to discuss the material - even if folks can't commit to the full course.
reply