Grokking Deep Reinforcement Learning
by Miguel Morales · first published 2020
7mentions
1recommended by
3HN commenters
2022–2025first – last mentioned
33% recommend67% neutral
Affiliate links. As an Amazon Associate I earn from qualifying purchases.
I enjoyed "Grokking Deep Reinforcement Learning"[0]. It doesn't include anything about transformers though. Also, see Python's gymnasium[1] library for a lunar lander environment, it's the one I focused on most while I was learning and I've solved…
on “Implementing a ChatGPT-like LLM from scratch, step by step” ↗Thirded. I also like Grokking Deep Reinforcement Learning a lot. OReilly's Grokking series is 2 for 2 for me. For those who don't know, OReilly stopped selling DRM free PDFs directly, but they still sell DRM free PDFs through other sources like ebooks.com, which…
on “Notes on Grokking Simplicity: Taming complex software with functional thinking” ↗I enjoyed the book Grokking Deep Reinforcement Learning from Manning. It's written in a very accessible style and explains the mathematical formulas you will see in other RL teaching material. I'd suggest getting a good book or other teaching resource and…
on “Q-Transformer: Scalable Reinforcement Learning via Autoregressive Q-Functions” ↗…implementing my own RL algorithms (PPO and SAC). If I had to recommend a curriculum to a friend I would say: (1) Spend a few hours on Spinning Up. (2) If the mathematical notation is intimidating, read Grokking Deep Reinforcement Learning (from Manning), which is slower paced and spends a lot of time explaining the notation itself, rather than just assuming the mathematical notation is self-explanatory as is so often the case. This book…
on “Implementing a ChatGPT-like LLM from scratch, step by step” ↗I second this suggestion. Read Grokking Deep Reinforcement Learning before reading Sutton. Well, the Sutton book is free, so take a peak, but if the formulas scare you then read Grokking Deep Reinforcement Learning.
on “Richard Sutton and Andrew Barto Win 2024 Turing Award” ↗"Grokking Deep Reinforcement Learning" by Miguel Morales and "Deep Reinforcement Learning in Action" by Alexander Zai and Brandon Brown both look promising, though the code might be outdated. Looks like they use the OpenAI Gym environment,…
on “Reinforcement Learning: An Introduction (2018)” ↗…also completed the program. Some classes did better at feedback than others. But honestly, whats so bad about getting feedback from teaching assistants? The TA for Reinforcement Learning wrote the book Grokking Deep Reinforcement Learning and has experience using RL in industry. If that is the worst they can say about OMSCS its sort of a pretty big endorsement.
on “The case against CS master’s degrees” ↗