You are not currently logged in.
Access JSTOR through your library or other institution:
An Equivalence between Continuous and Discrete Time Markov Decision Processes
Richard F. Serfozo
Vol. 27, No. 3 (May - Jun., 1979), pp. 616-620
Published by: INFORMS
Stable URL: http://www.jstor.org/stable/170221
Page Count: 5
You can always find the topics here!Topics: Markov processes, Markov chains, Operations research, Optimal policy, Dynamic programming, Mathematics
Were these topics helpful?See something inaccurate? Let us know!
Select the topics that are inaccurate.
Preview not available
A continuous time Markov decision process with uniformly bounded transition rates is shown to be equivalent to a simpler discrete time Markov decision process for both the discounted and average reward criteria on an infinite horizon. This result clarifies some earlier work in this area.
Operations Research © 1979 INFORMS