By a decision process is meant a pair (X, Γ), where X is an arbitrary set (the state space), and Γ associates to each point x in X an arbitrary nonempty collection of discrete probability measures (actions) on X. In a decision process with nonnegative costs depending on the current state, the action taken, and the following state, there is always available a Markov strategy which uniformly (nearly) minimizes the expected total cost. If the costs are strictly positive and depend only on the current state, there is even a stationary strategy with the same property. In a decision process with a fixed goal g in X, there is always a stationary strategy which uniformly (nearly) minimizes the expected time to the goal, and, if X is countable, such a stationary strategy exists which also (nearly) maximizes the probability of reaching the goal.
The purpose of The Annals of Probability is to publish contributions to the theory of probability and statistics and their applications. The emphasis is on importance and interest; formal novelty and mathematical correctness alone are not sufficient. Also appropriate are authoritative expository papers and surveys of areas in vigorous development. All papers are refereed.
The purpose of the Institute of Mathematical Statistics (IMS) is to foster the development and dissemination of the theory and applications of statistics and probability. The Institute was formed at a meeting of interested persons on September 12, 1935, in Ann Arbor, Michigan, as a consequence of the feeling that the theory of statistics would be advanced by the formation of an organization of those persons especially interested in the mathematical aspects of the subject. The Annals of Statistics and The Annals of Probability (which supersede The Annals of Mathematical Statistics), Statistical Science, and The Annals of Applied Probability are the scientific journals of the Institute. These and The IMS Bulletin comprise the official journals of the Institute. The Institute has individual membership and organizational membership. Dues are paid annually and include a subscription to the newsletter of the organization, The IMS Bulletin. Members also receive priority pricing on all other IMS publications.
This item is part of a JSTOR Collection.
For terms and use, please refer to our
The Annals of Probability
© 1981 Institute of Mathematical Statistics