Access

You are not currently logged in.

Access your personal account or get JSTOR access through your library or other institution:

login

Log in to your personal account or through your institution.

If You Use a Screen Reader

This content is available through Read Online (Free) program, which relies on page scans. Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.

Sensitive Discount Optimality in Controlled One-Dimensional Diffusions

Martin L. Puterman
The Annals of Probability
Vol. 2, No. 3 (Jun., 1974), pp. 408-419
Stable URL: http://www.jstor.org/stable/2959174
Page Count: 12
  • Read Online (Free)
  • Download ($19.00)
  • Subscribe ($19.50)
  • Cite this Item
Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.
Sensitive Discount Optimality in Controlled One-Dimensional Diffusions
Preview not available

Abstract

In this paper we consider the problem of optimally controlling a diffusion process on a compact interval in one-dimensional Euclidean Space. Under the assumptions that the action space is finite and the cost rate, drift and diffusion coefficients are piecewise analytic, we present a constructive proof that there exist piecewise constant $n$-discount optimal controls for all finite $n \geqq 1$ and measurable $\infty$-discount optimal controls. In addition we present a sequence of second order differential equations that characterize the coefficients of the Laurent series of the expected discounted cost of an $n$-discount optimal control.

Page Thumbnails

  • Thumbnail: Page 
408
    408
  • Thumbnail: Page 
409
    409
  • Thumbnail: Page 
410
    410
  • Thumbnail: Page 
411
    411
  • Thumbnail: Page 
412
    412
  • Thumbnail: Page 
413
    413
  • Thumbnail: Page 
414
    414
  • Thumbnail: Page 
415
    415
  • Thumbnail: Page 
416
    416
  • Thumbnail: Page 
417
    417
  • Thumbnail: Page 
418
    418
  • Thumbnail: Page 
419
    419