
The art and theory of dynamic programming
by Stuart E. Dreyfus · first published 1977
10mentions
1recommended by
4HN commenters
2010–2025first – last mentioned
25% recommend75% neutral
Affiliate links. As an Amazon Associate I earn from qualifying purchases.







…stochastic dynamic programming: Dimitri P. Bertsekas, Dynamic Programming: Deterministic and Stochastic Models. George L. Nemhauser, Dynamic Programming. Stuart E. Dreyfus and Averill M. Law, The Art and Theory of Dynamic Programming. E. B. Dynkin and A. A. Yushkevich, Controlled Markov Processes. Wendell H. Fleming and Raymond W. Rishel, Deterministic and Stochastic Optimal Control. There is more from R. T. Rockafellar and R.…
on “The Mathematics of 2048: Optimal Play with Markov Decision Processes (2018)” ↗Start with books on dynamic programming, discrete time, discrete space space, no uncertainty. There's a nice one by Dreyfus and Law, The Art and Theory of Dynamic Programming that also gets into the stochastic case. It's called dynamic programming because the program, that is, the planning, changes dynamically over time as learn more and more as time passes. D&L show a nice…
on “David Patterson Says It’s Time for New Computer Architectures and Languages” ↗…Ph.D. dissertation in dynamic programming. For an easy introduction, can have fun, like eating from the appetizer plate at Thanksgiving, say, a half hour at a bite from Stuart E. Dreyfus and Averill M. Law, The Art and Theory of Dynamic Programming, ISBN 0-12-221860-4, Academic Press, New York, 1977. One of the amazing advantages of dynamic programming is how well it handles randomness -- then have stochastic optimal control, Markov decision theory,…
on “Introduction to Algorithms (2020)” ↗…plane thought about his lecture, ..., and stood for my Ph.D. orals and passed (extra credit for guessing my employer). Some references (with TeX markup): Stuart E.\ Dreyfus and Averill M.\ Law, {\it The Art and Theory of Dynamic Programming,\/} ISBN 0-12-221860-4, Academic Press, New York.\ \ Dimitri P.\ Bertsekas, {\it Dynamic Programming: Deterministic and Stochastic Models,\/} ISBN 0-13-221581-0, Prentice-Hall.\ \ George L.\ Nemhauser,…
on ““Dynamic programming” is not referring to “computer programming”” ↗…work of R. Bellman, G. Nemhauser, R. Rockafellar, R. Wetts, D. Bertsekas, E. Dynkin, W. Fleming, S. Shreve, and more. E.g., there is, with TeX markup, Stuart E.\ Dreyfus and Averill M.\ Law, {\it The Art and Theory of Dynamic Programming,\/} ISBN 0-12-221860-4, Academic Press, New York, 1977.\ \ Dimitri P.\ Bertsekas, {\it Dynamic Programming: Deterministic and Stochastic Models,\/} ISBN 0-13-221581-0, Prentice-Hall, Englewood Cliffs,…
on “Solving dynamic programming interview problems” ↗…basic idea of dynamic programming, then study the topic for an hour or so and you will get the idea. If want to get deeper into the subject, work through, say, Stuart E. Dreyfus and Averill M. Law, 'The Art and Theory of Dynamic Programming', ISBN 0-12-221860-4, Academic Press. and notice the 'deterministic equivalence' for the case of 'linear plant' (the system being 'controlled'), quadratic objective function (say, reduce cost or risk),…
on “Programmer Competency Matrix: Do you use it when hiring?” ↗…goes back to Newton. My references are old. More recent work on stochastic optimal control has been by R. T. Rockafellar at University of Washington. For Stuart E. Dreyfus and Averill M. Law, 'The Art and Theory of Dynamic Programming', ISBN 0-12-221860-4, Academic Press, New York. 'dynamic programming' is a big part of the discrete time versions of optimal control. It can be stochastic or deterministic. The linear-quadratic-Gaussian…
on “The pitfalls of jargon and the damage it does to mathematics” ↗…state. Commonly we can be drawn into the applied mathematics of stochastic optimal control, say, at least discrete time stochastic dynamic programming, e.g., Stuart E. Dreyfus and Averill M. Law, 'The Art and Theory of Dynamic Programming', ISBN 0-12-221860-4, Academic Press. Dimitri P. Bertsekas and Steven E. Shreve, 'Stochastic Optimal Control: The Discrete Time Case', ISBN 0-12-093260-1, Academic Press. Wendell H. Fleming and Raymond…
on “Super easy project planning and estimation” ↗…same intuitively. For some books, Dimitri P. Bertsekas, Dynamic Programming: Deterministic and Stochastic Models. George L. Nemhauser, Dynamic Programming. Stuart E. Dreyfus and Averill M. Law, The Art and Theory of Dynamic Programming. E. B. Dynkin and A. A. Yushkevich, Controlled Markov Processes. Wendell H. Fleming and Raymond W. Rishel, Deterministic and Stochastic Optimal Control. There is more from R. T. Rockafellar and R.…
on “Decision Making Under Uncertainty with POMDPs.jl” ↗…the problem as dynamic programming, but can do such things quite generally. For what 'dynamic programming' is, see the original books by R. Bellman or: Stuart E.\ Dreyfus and Averill M.\ Law, {\it The Art and Theory of Dynamic Programming,\/} ISBN 0-12-221860-4, Academic Press, New York, 1977.\ \ Dimitri P.\ Bertsekas, {\it Dynamic Programming: Deterministic and Stochastic Models,\/} ISBN 0-13-221581-0, Prentice-Hall, Englewood Cliffs,…
on “Retiring a Great Interview Problem” ↗