Ergodicity

For other uses, see Ergodic (disambiguation).

In mathematics, the term ergodic is used to describe a dynamical system which, broadly speaking, has the same behavior averaged over time as averaged over the space of all the system's states (phase space). In physics the term is used to imply that a system satisfies the ergodic hypothesis of thermodynamics.

In statistics, the term describes a random process for which the time average of one sequence of events is the same as the ensemble average. In other words, for a Markov chain, as one increases the steps, there exists a positive probability measure at step  n that is independent of the probability distribution at initial step 0 (Feller, 1971, p. 271).[1]

Etymology

The term "ergodic" was derived from the Greek words έργον (ergon: "work") and οδός (odos: "path" or "way"). It was chosen by Boltzmann while he was working on a problem in statistical mechanics.[2]

Formal definition

Let (X,\; \Sigma ,\; \mu\,) be a probability space, and T:X \to X be a measure-preserving transformation. We say that T is ergodic with respect to \mu (or alternatively that \mu is ergodic with respect to T) if one of the following equivalent statements is true:[3]

Measurable flows

These definitions have natural analogues for the case of measurable flows and, more generally, measure-preserving semigroup actions. Let {Tt} be a measurable flow on (X, Σ, μ). An element A of Σ is invariant mod 0 under {Tt} if

\mu(T^{t}(A)\bigtriangleup A)=0

for each tR. Measurable sets invariant mod 0 under a flow or a semigroup action form the invariant subalgebra of Σ, and the corresponding measure-preserving dynamical system is ergodic if the invariant subalgebra is the trivial σ-algebra consisting of the sets of measure 0 and their complements in X.

Markov chains

In a Markov chain, a state i is said to be ergodic if it is aperiodic and positive recurrent (a state is recurrent if there is a nonzero probability of exiting the state and the probability of an eventual return to it is 1; if the former condition is not true the state is "absorbing"). If all states in a Markov chain are ergodic, then the chain is said to be ergodic.

Markov's theorem: a Markov chain is ergodic if there is a positive probability to pass from any state to any other state in one step.

There is a simple test for ergodicity using eigenvalues of the transition matrix (which are always less or equal to one in absolute value). One is always an eigenvalue. If all other eigenvalues are less than one in absolute value then the chain is ergodic. This follows from the spectral decomposition of a non-symmetrical matrix.

Examples in electronics

Ergodicity is where the ensemble average equals the time average. Each resistor has thermal noise associated with it and it depends on the temperature. Take N resistors (N should be very large) and plot the voltage across those resistors for a long period. For each resistor you will have a waveform. Calculate the average value of that waveform. This gives you the time average. You should also note that you have N waveforms as we have N resistors. These N plots are known as an ensemble. Now take a particular instant of time in all those plots and find the average value of the voltage. That gives you the ensemble average for each plot. If both ensemble average and time average are the same then it is ergodic.

Ergodic decomposition

Conceptually, ergodicity of a dynamical system is a certain irreducibility property, akin to the notions of irreducibility in the theory of Markov chains, irreducible representation in algebra and prime number in arithmetic. A general measure-preserving transformation or flow on a Lebesgue space admits a canonical decomposition into its ergodic components, each of which is ergodic.

See also

Notes

  1. Feller, W. 1971 An introduction to probability theory and its applications, vol. 2, Wiley
  2. Walters 1982,§0.1, p. 2
  3. Walters 1982,§1.5, p. 27

References

External links

Look up ergodic in Wiktionary, the free dictionary.
This article is issued from Wikipedia - version of the Tuesday, April 26, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.