Kolmogorov equations

In probability theory, Kolmogorov equations, including Kolmogorov forward equations and Kolmogorov backward equations, characterize random dynamic processes.

In order to try to explain them in simple ideas, suppose we have a complete statistical description of a stochastic process x(t) ^a and know some transformation,a function of the stochastic variable, (for example, velocity, which is the derivative of the state variable) which defines a new process y(t) related to x(t), for the velocity example :$y(t)=x'(t)$. Then the Kolmogorov equations are a means for determining features of the stochastic process y(t), thus without needing to know the stochastic process itself, the details.^[1]

Diffusion Processes vs. Jump Processes

Writing in 1931, Andrei Kolmogorov started from the theory of discrete time Markov processes, which are described by the Chapman-Kolmogorov equation, and sought to derive a theory of continuous time Markov processes by extending this equation. He found that there are two kinds of continuous time Markov Processes, depending on the assumed behavior over small intervals of time:

If you assume that "in a small time interval there is an overwhelming probability that the state will remain unchanged; however, if it changes, the change may be radical",^[2] then you are led to what are called jump processes.

The other case leads to processes such as those "represented by diffusion and by Brownian motion; there it is certain that some change will occur in any time interval, however small; only, here it is certain that the changes during small time intervals will be also small".^[2]

For each of these two kinds of processes, Kolmogorov derived a forward and a backward system of equations (four in all).

History

The equations are named after Andrei Kolmogorov since they were highlighted in his 1931 foundational work.^[3]

William Feller, in 1949, used the names "forward equation" and "backward equation" for his more general version of the Kolmogorov's pair, in both jump and diffusion processes.^[2] Much later, in 1956, he referred to the equations for the jump process as "Kolmogorov forward equations" and "Kolmogorov backward equations".^[4]

Other authors, such as Motoo Kimura referred to the diffusion (Fokker–Planck) equation as Kolmogorov forward equation, a name that has persisted.^[5]

The modern view

• In the context of a continuous-time Markov process with jumps, see Kolmogorov equations (Markov jump process). In particular, in natural sciences the forward equation is also known as master equation.
• In the context of a diffusion process, for the backward Kolmogorov equations see Kolmogorov backward equations (diffusion). The forward Kolmogorov equation are also known as Fokker–Planck equation.

An example from biology

One example from biology is given below:^[6]

$p_n' (t)= (n-1)*\beta*p_{n-1}(t) + n*\beta*p_{n}(t)$

This equation is applied to model population growth with birth. Where $n$ is the population index, with reference the initial population, $\beta$ is the birth rate, and finally $p_n(t)=Pr(N(t)=n)$, i.e. the probability of achieving a certain population size.

The analytical solution is:^[6]

$p_n(t)= (n-1)\beta*exp(-n*\beta*t)* \int_0^t \! p_{n-1}(s)*exp(n*\beta*s)\,ds$

This is a formula for the density $p_n(t)$ in terms of the preceding ones, i.e. $p_{n-1}(t)$.

Notes

• ^a A stochastic process, using the simplest explanation possible, is a process whose outcomes cannot be predicted with precision, just some statistics, e.g. the mean. For instance, one tosses a dice several times, and one makes a cumulative summation, what is the next summation value, given the current one. It is a stochastic process and can be solved using the Bayes theorem. Some stochastic processes allows us to derive a mathematical model, and the majority of them will be a special case of the Komogorov Equation. See ^[6] for examples from ecology.

References

1. Pawula, R. (1967). "Generalizations and extensions of the Fokker- Planck-Kolmogorov equations". IEEE Transactions on Information Theory 13: 33–41. doi:10.1109/TIT.1967.1053955.
2. Feller, W. (1949) "On the Theory of Stochastic Processes, with Particular Reference to Applications", Proceedings of the (First) Berkeley Symposium on Mathematical Statistics and Probability pp 403-432.
3. Andrei Kolmogorov, "Über die analytischen Methoden in der Wahrscheinlichkeitsrechnung" (On Analytical Methods in the Theory of Probability), 1931,
4. William Feller, 1957. On Boundaries and Lateral Conditions for the Kolmogorov Differential Equations
5. Kimura, Motoo (1957) "Some Problems of Stochastic Processes in Genetics", The Annals of Mathematical Statistics, 28 (4), 882-901 JSTOR 2237051
6. Logan, J. David and Wolesensky, Willian R. Mathematical methods in biology. Pure and Applied Mathematics: a Wiley-interscience Series of Texts, Monographs, and Tracts. John Wiley& Sons, Inc. 2009. pp. 325-327.