## Access

You are not currently logged in.

Access JSTOR through your library or other institution:

## If You Use a Screen Reader

This content is available through Read Online (Free) program, which relies on page scans. Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.
Journal Article

# Universal Prediction of Random Binary Sequences in a Noisy Environment

Tsachy Weissman and Neri Merhav
The Annals of Applied Probability
Vol. 14, No. 1 (Feb., 2004), pp. 54-89
Stable URL: http://www.jstor.org/stable/4140490
Page Count: 36

#### Select the topics that are inaccurate.

Cancel
Preview not available

## Abstract

Let $X = {(X_t, Y_t)}_{t\in Z}$ be a stationary time series where Xt is binary valued and Yt, the noisy observation of Xt, is real valued. Letting P denote the probability measure governing the joint process $\lbrace(X_t, Y_t)\rbrace$, we characterize U(l, P), the optimal asymptotic average performance of a predictor allowed to base its prediction for Xt on Y1, ..., $Y_{t-1}$, where performance is evaluated using the loss function l. It is shown that the stationarity and ergodicity of P, combined with an additional "conditional mixing" condition, suffice to establish U(l, P) as the fundamental limit for the almost sure asymptotic performance. U(l, P) can thus be thought of as a generalized notion of the Shannon entropy, which can capture the sensitivity of the underlying clean sequence to noise. For the case where $X = {X_t}$ is governed by P and Yt given by $Y_t = g(X_t, N_t)$ where g is any deterministic function and $N = {N_t}$, the noise, is any i.i.d. process independent of X (namely, the case where the "clean" process X is passed through a fixed memoryless channel), it is shown that, analogously to the noiseless case, there exist universal predictors which do not depend on P yet attain U(l, P). Furthermore, it is shown that in some special cases of interest [e.g., the binary symmetric channel (BSC) and the absolute loss function], there exist twofold universal predictors which do not depend on the noise distribution either. The existence of such universal predictors is established by means of an explicit construction which builds on recent advances in the theory of prediction of individual sequences in the presence of noise.

• 54
• 55
• 56
• 57
• 58
• 59
• 60
• 61
• 62
• 63
• 64
• 65
• 66
• 67
• 68
• 69
• 70
• 71
• 72
• 73
• 74
• 75
• 76
• 77
• 78
• 79
• 80
• 81
• 82
• 83
• 84
• 85
• 86
• 87
• 88
• 89