Writing
Blog
Notes on the maths and code behind machine learning.
The Log Trick
Logarithms, numerical underflow, and the maths behind LLM pretraining and PPO, with small examples and PyTorch code.
Read article
Writing
Notes on the maths and code behind machine learning.
Logarithms, numerical underflow, and the maths behind LLM pretraining and PPO, with small examples and PyTorch code.
Read article