AarXiv31 Dec 2012Cited 365×

Artificial intelligence framework for simulating clinical decision-making: A Markov decision process approach

Casey C. Bennett, Kris Hauser

Abstract

Objective: In the modern healthcare system, rapidly expanding costs/complexity, the growing myriad of treatment options, and exploding information streams that often do not effectively reach the front lines hinder the ability to choose optimal treatment decisions over time. The goal in this paper is to develop a general purpose (non-disease-specific) computational/artificial intelligence (AI) framework to address these challenges. This framework serves two potential functions: 1) a simulation environment for exploring various healthcare policies, payment methodologies, etc., and 2) the basis for clinical artificial intelligence – an AI that can "think like a doctor."

A figure from Artificial intelligence framework for simulating clinical decision-making: A Markov decision process approach — fig. from the paper

§ The Valyu brief

The paper, in five minutes

Read from the full text via Valyu Contents

A general AI framework using Markov decision processes outperforms standard care, cutting costs by >60% and boosting outcomes 30‑35% in real patient data.

What’s new

i.Developed a general‑purpose AI framework for clinical decision‑making based on Markov decision processes and dynamic decision networks
ii.Created a simulation environment for exploring healthcare policies and payment models
iii.Demonstrated the framework outperforms treatment‑as‑usual in cost and patient outcomes using real EHR data
iv.Enabled operation in partially observable settings via belief‑state maintenance

How they did it

The approach combines Markov decision processes with dynamic decision networks to learn from electronic health record data and simulate alternative sequential treatment paths. It maintains belief states to handle missing observations and functions as an online agent that continuously plans and replans decisions.

What they found

Cost per Unit Change: $189 vs. $497 for standard case‑rate/fee‑for‑service models
30‑35% increase in patient outcomes compared to treatment‑as‑usual
Parameter tuning yields roughly 50% more improvement for roughly half the costs

§ The Valyu brief

Reading the full paper and taking notes. This takes a few seconds…

§ Ask this paper

Ask a question about this paper

Valyu reads the full text and answers from what the paper actually says.

§ Related work in other archives

Similar papers in all four archives

The same idea searched in arXiv, PubMed, bioRxiv and chemRxiv at once, so a method can lead you to where it is being applied.

AarXiv3 found

PPubMed4 found

BbioRxiv3 found

CchemRxiv2 found

Searching the other archives…