Access

You are not currently logged in.

Access your personal account or get JSTOR access through your library or other institution:

login

Log in to your personal account or through your institution.

If You Use a Screen Reader

This content is available through Read Online (Free) program, which relies on page scans. Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.

The Asymptotic Behaviour of a General Finite Nonhomogeneous Markov Chain (The Decomposition-Separation Theorem)

Isaac Sonin
Lecture Notes-Monograph Series
Vol. 30, Statistics, Probability and Game Theory: Papers in Honor of David Blackwell (1996), pp. 337-346
Stable URL: http://www.jstor.org/stable/4355954
Page Count: 10
  • Read Online (Free)
  • Download ($19.00)
  • Subscribe ($19.50)
  • Cite this Item
Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.
The Asymptotic Behaviour of a General Finite Nonhomogeneous Markov Chain (The Decomposition-Separation Theorem)
Preview not available

Abstract

The Decomposition-Separation Theorem generalizing the classical Kolmogorov-Doeblin results about the decomposition of finite homogeneous Markov chains to the nonhomogeneous case is presented. The ground-breaking result in this direction was given in the work of David Blackwell in 1945. The relation of this theorem with other problems in probability theory and Markov Decison Processes is discussed.

Page Thumbnails

  • Thumbnail: Page 
337
    337
  • Thumbnail: Page 
338
    338
  • Thumbnail: Page 
339
    339
  • Thumbnail: Page 
340
    340
  • Thumbnail: Page 
341
    341
  • Thumbnail: Page 
342
    342
  • Thumbnail: Page 
343
    343
  • Thumbnail: Page 
344
    344
  • Thumbnail: Page 
345
    345
  • Thumbnail: Page 
346
    346