You are not currently logged in.
Access JSTOR through your library or other institution:
An Equivalence between Continuous and Discrete Time Markov Decision Processes
Richard F. Serfozo
Vol. 27, No. 3 (May - Jun., 1979), pp. 616-620
Published by: INFORMS
Stable URL: http://www.jstor.org/stable/170221
Page Count: 5
Preview not available
A continuous time Markov decision process with uniformly bounded transition rates is shown to be equivalent to a simpler discrete time Markov decision process for both the discounted and average reward criteria on an infinite horizon. This result clarifies some earlier work in this area.
Operations Research © 1979 INFORMS