You are not currently logged in.
Access JSTOR through your library or other institution:
If You Use a Screen ReaderThis content is available through Read Online (Free) program, which relies on page scans. Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.
Markov Population Processes
J. F. C. Kingman
Journal of Applied Probability
Vol. 6, No. 1 (Apr., 1969), pp. 1-18
Published by: Applied Probability Trust
Stable URL: http://www.jstor.org/stable/3212273
Page Count: 18
You can always find the topics here!Topics: Markov processes, Markov chains, Closed systems, Statism, Poisson process, Open systems, Traffic congestion, Epidemics, Linear systems
Were these topics helpful?See somethings inaccurate? Let us know!
Select the topics that are inaccurate.
Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.
Preview not available
The processes of the title have frequently been used to represent situations involving numbers of individuals in different categories or colonies. In such processes the state at any time is represented by the vector n = (n1, n2, ⋯, nk), where ni is the number of individuals in the ith colony, and the random evolution of n is supposed to be that of a continuous-time Markov chain. The jumps of the chain may be of three types, corresponding to the arrival of a new individual, the departure of an existing one, or the transfer of an individual from one colony to another. Models with this structure have been proposed for the evolution of populations, for instance by Bartlett . They are implicit in the theory of epidemics , , and in the closely related study of rumours by Daley and Kendall . The competition processes considered by Reuter  are of this kind, as are the models for networks of queues studied by Jackson . Jackson's results have recently been the subject of an elegant generalisation by Whittle , , the potential applications of which (to the theory of traffic flow  for instance) remain as yet unexplored. The purpose of this paper is to present a systematic account of the methods available to analyse these processes, with particular reference to the calculation of stationary distributions (when they exist). When the process is reversible, such calculations are very easy, and conditions for this to occur are examined in Section 2, where it is shown that in a certain sense reversibility is a 'local' property. Section 3 is devoted to a discussion, within the present formulation, of Whittle's results, and of their relation to methods based on reversibility. A particular case to which Whittle's method can be applied is the linear system studied in Section 4, but here a more direct technique, generalising the classical work of Bartlett  is available. Finally, Sections 5 and 6 contain an analysis of 'flow models', population processes in which at most one individual can occupy any colony, for which a quite different method is appropriate.
Journal of Applied Probability © 1969 Applied Probability Trust