Optional stopping theorem

In probability theory, optional stopping theorem (or Doob's optional sampling theorem) says that, under certain conditions, the expected value of a martingale at a stopping time is equal to the expected value of its initial value. Since martingales can be used to model the wealth of a gambler participating in a fair game, the optional stopping theorem says that on the average nothing can be gained by stopping to play the game based on the information obtainable so far (i.e., by not looking into the future). Of course, certain conditions are necessary for this result to hold true, in particular doubling strategies have to be excluded.

The optional stopping theorem is an important tool of mathematical finance in the context of the fundamental theorem of asset pricing.

Statement of theorem

A discrete-time version of the theorem is given below:

Let X = (Xt)t∈ℕ0 be a discrete-time martingale and τ a stopping time with values in 0 ∪ {∞}, both with respect to a filtration (Ft)t∈ℕ0. Assume that one of the following three conditions holds:

(a) The stopping time τ is almost surely bounded, i.e., there exists a constant c ∈ ℕ such that τc a.s.
(b) The stopping time τ has finite expectation and the conditional expectations of the absolute value of the martingale increments are almost surely bounded, more precisely, \mathbb{E}[\tau]<\infty and there exists a constant c such that \mathbb{E}\bigl[|X_{t+1}-X_t|\,\big\vert\,{\mathcal F}_t\bigr]\le c almost surely on the event {τ > t} for all t ∈ ℕ0.
(c) There exists a constant c such that |Xtτ| ≤ c a.s. for all t ∈ ℕ0 where denotes the minimum operator.

Then Xτ is an almost surely well defined random variable and \mathbb{E}[X_{\tau}]=\mathbb{E}[X_0].

Similarly, if the stochastic process X is a submartingale or a supermartingale and one of the above conditions holds, then

\mathbb{E}[X_\tau]\ge\mathbb{E}[X_0],

for a submartingale, and

\mathbb{E}[X_\tau]\le\mathbb{E}[X_0],

for a supermartingale.

Remark

Under condition (c) it is possible that τ = ∞ happens with positive probability. On this event Xτ is defined as the almost surely existing pointwise limit of X, see the proof below for details.

Applications

Proof

Let Xτ denote the stopped process, it is also a martingale (or a submartingale or supermartingale, respectively). Under condition (a) or (b), the random variable Xτ is well defined. Under condition (c) the stopped process Xτ is bounded, hence by Doob's martingale convergence theorem it converges a.s. pointwise to a random variable which we call Xτ.

If condition (c) holds, then the stopped process Xτ is bounded by the constant random variable M := c. Otherwise, writing the stopped process as

X_t^\tau=X_0+\sum_{s=0}^{\tau \and t-1}(X_{s+1}-X_s),\quad t\in{\mathbb N}_0,

gives |Xtτ| ≤ M for all t ∈ ℕ0, where

M:=|X_0|+\sum_{s=0}^{\tau-1}|X_{s+1}-X_s|=|X_0|+\sum_{s=0}^\infty|X_{s+1}-X_s|\cdot\mathbf{1}_{\{\tau>s\}}.

By the monotone convergence theorem

\mathbb{E}[M]=\mathbb{E}[|X_0|]+\sum_{s=0}^\infty \mathbb{E}\bigl[|X_{s+1}-X_s|\cdot\mathbf{1}_{\{\tau>s\}}\bigr].

If condition (a) holds, then this series only has a finite number of non-zero terms, hence M is integrable.

If condition (b) holds, then we continue by inserting a conditional expectation and using that the event {τ > s} is known at time s (note that τ is assumed to be a stopping time with respect to the filtration), hence

\begin{align}\mathbb{E}[M]
&=\mathbb{E}[|X_0|]+\sum_{s=0}^\infty \mathbb{E}\bigl[\underbrace{\mathbb{E}\bigl[|X_{s+1}-X_s|\big|{\mathcal F}_s\bigr]\cdot\mathbf{1}_{\{\tau>s\}}}_{\le\,c\,\mathbf{1}_{\{\tau>s\}}\text{ a.s. by (b)}}\bigr]\\
&\le\mathbb{E}[|X_0|]+c\sum_{s=0}^\infty\mathbb{P}(\tau>s)\\
&=\mathbb{E}[|X_0|]+c\,\mathbb{E}[\tau]<\infty,\\
\end{align}

where a representation of the expected value of non-negative integer-valued random variables is used for the last equality.

Therefore, under any one of the three conditions in the theorem, the stopped process is dominated by an integrable random variable M. Since the stopped process Xτ converges almost surely to Xτ, the dominated convergence theorem implies

\mathbb{E}[X_\tau]=\lim_{t\to\infty}\mathbb{E}[X_t^\tau].

By the martingale property of the stopped process,

\mathbb{E}[X_t^\tau]=\mathbb{E}[X_0],\quad t\in{\mathbb N}_0,

hence

\mathbb{E}[X_\tau]=\mathbb{E}[X_0].

Similarly, if X is a submartingale or supermartingale, respectively, change the equality in the last two formulas to the appropriate inequality.

References

External links

This article is issued from Wikipedia - version of the Friday, December 11, 2015. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.