You are not currently logged in.
Access your personal account or get JSTOR access through your library or other institution:
If You Use a Screen ReaderThis content is available through Read Online (Free) program, which relies on page scans. Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.
Sensitive Discount Optimality in Controlled One-Dimensional Diffusions
Martin L. Puterman
The Annals of Probability
Vol. 2, No. 3 (Jun., 1974), pp. 408-419
Published by: Institute of Mathematical Statistics
Stable URL: http://www.jstor.org/stable/2959174
Page Count: 12
Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.
Preview not available
In this paper we consider the problem of optimally controlling a diffusion process on a compact interval in one-dimensional Euclidean Space. Under the assumptions that the action space is finite and the cost rate, drift and diffusion coefficients are piecewise analytic, we present a constructive proof that there exist piecewise constant $n$-discount optimal controls for all finite $n \geqq 1$ and measurable $\infty$-discount optimal controls. In addition we present a sequence of second order differential equations that characterize the coefficients of the Laurent series of the expected discounted cost of an $n$-discount optimal control.
The Annals of Probability © 1974 Institute of Mathematical Statistics