AarXiv2023

Completely Abstract Dynamic Programming

Thomas J. Sargent, John Stachurski

Abstract

We introduce a framework that represents dynamic programs as families of policy operators acting on a partially ordered set. We provide an optimality theory based on high-level assumptions and show how applications across a broad spectrum of dynamic programming subfields fit into this framework. We apply the framework to establish new results for specific applications.

§ The Valyu brief

The paper, in five minutes

Read from the full text via Valyu Contents

A new order‑theoretic framework rewrites dynamic programs as operators on partially ordered sets, unifying many DP variants.

What’s new

i.Introduces a framework representing dynamic programs as families of operators on partially ordered sets
ii.Develops an optimality theory using only order‑theoretic assumptions
iii.Shows that almost all subfields of dynamic programming fit into the framework
iv.Derives new optimality and algorithmic results for specific applications

How they did it

The authors model a dynamic program as a collection of operators acting on a partially ordered set and then prove optimality properties relying solely on order‑theoretic conditions. They illustrate the approach by mapping diverse DP models—including recursive preferences, robustness, function approximation, Monte Carlo sampling, and distributional DP—into this unified setting.

What they found

Establishes new optimality results for several dynamic programming applications
Provides algorithmic guarantees for the mapped DP variants

§ The Valyu brief

Reading the full paper and taking notes. This takes a few seconds…

§ Ask this paper

Ask a question about this paper

Valyu reads the full text and answers from what the paper actually says.

§ Related work in other archives

Completely Abstract Dynamic Programming

The paper, in five minutes

Ask a question about this paper

Similar papers in all four archives

The paper, in five minutes

Similar papers in all four archives