Boltzmann distribution

Occupation probability following a Boltzmann distribution depending on the energy difference and temperature.

In statistical mechanics and mathematics, a Boltzmann distribution (also called Gibbs distribution^[1]) is a probability distribution, probability measure, or frequency distribution of particles in a system over various possible states. The distribution is expressed in the form

$F({\rm state}) \propto e^{-\frac{E}{kT}}$

where $E$ is state energy (which varies from state to state), and $kT$ (a constant of the distribution) is the product of Boltzmann's constant and thermodynamic temperature.

In statistical mechanics, the Boltzmann distribution is a probability distribution that gives the probability that a system will be in a certain state as a function of that state’s energy and the temperature of the system. It is given as ^[2] $p_i={\frac{e^{- {\varepsilon}_i / k T}}{\sum_{j=1}^{M}{e^{- {\varepsilon}_j / k T}}}}$

where p_i is the probability of state i, ε_i the energy of state i, k the Boltzmann constant, T the temperature of the system and M is the number of states accessible to the system.^[3] The sum is over all states accessible to the system of interest. The term system here has a very wide meaning; it can range from a single atom to a macroscopic system such as a natural gas storage tank. Because of this Boltzmann distribution can be used to solve a very wide variety of problems. The distribution shows that states with lower energy will always have a higher probability of being occupied than the states with higher energy.^[3]

The ratio of a Boltzmann distribution computed for two states is known as the Boltzmann factor and characteristically only depends on the states' energy difference.

$\frac{F({\rm state2})}{F({\rm state1})} = e^{\frac{E_1 - E_2}{kT}}$

The Boltzmann distribution is named after Ludwig Boltzmann who first formulated it in 1868 during his studies of the statistical mechanics of gases in thermal equilibrium. The distribution was later investigated extensively, in its modern generic form, by Josiah Willard Gibbs in 1902.^[4]:Ch.IV

The Boltzmann distribution should not be confused with the Maxwell-Boltzmann distribution. The former gives the probability that a system will be in a certain state as a function of that state's energy. When applied to particles such as atoms or molecules, it gives the distribution of particles over energy states.^[3] The Maxwell-Boltzmann distribution is used to describe particle speeds in idealized gases.

The distribution

The Boltzmann distribution is a probability distribution that gives the probability of a certain state as a function of that state’s energy and temperature of the system to which the distribution is applied.^[2] It is given as

$p_i={\frac{e^{- {\varepsilon}_i / k T}}{\sum_{i=1}^{M}{e^{- {\varepsilon}_i / k T}}}}$

where p_i is the probability of state i, ε_i the energy of state i, k the Boltzmann constant, T the temperature of the system and M is the number of all states accessible to the system.^[2][3] The sum is over all states accessible to the system of interest. The right hand side denominator of the equation above is also known as the canonical partition function, commonly denoted by Q (or by some authors by Z).

$Q={\sum_{i=1}^{M}{e^{- {\varepsilon}_i / k T}}}$

Therefore, the Boltzmann distribution can also be written as

$p_i={\frac{1}{Q}} {e^{- {\varepsilon}_i / k T}}$

The partition function can be calculated if we know the energies of the levels accessible to the system of interest. For atoms the partition function values can be found in the NIST Atomic Spectra Database.^[5]

The distribution shows that states with lower energy will always have a higher probability of being occupied than the states with higher energy. It can also give us the quantitative relationship between the probabilities of the two states being occupied. The ratio of probabilities for states i and j is given as

${\frac{p_i}{p_j}}=e^{({\varepsilon}_j-{\varepsilon}_i) / k T}$

where p_i is the probability of state i, p_j the probability of state j, and ε_i and ε_i are the energies of states i and j, respectively.

The Boltzmann distribution is often used to describe the distribution of particles, such as atoms or molecules, over energy states accessible to them. If we have a system consisted of many particles, the probability of a particle being in state i is practically the probability that, if we pick a random particle from that system and check what state it is in, we will find it is in state i. This probability is equal to the number of particles in state i divided by the total number of particles in the system, that is the fraction of particles that occupy state i.

$p_i={\frac{N_i}{N}}$

where N_i is the number of particles in state i and N is the total number of particles in the system. We may use the Boltzmann distribution to find this probability that is, as we have seen, equal to the fraction of particles that are in state i. So the equation that gives the fraction of particles in state i as a function of the energy of that state is ^[3]

${\frac{N_i}{N}}={\frac{e^{- {\varepsilon}_i / k T}}{\sum_{i=1}^{M}{e^{- {\varepsilon}_i / k T}}}}$

This equation is of great importance to spectroscopy. In spectroscopy we observe a spectral line if atoms or molecules that we are interested in go from one state to another.^[3][6] In order for this to be possible, there must be some particles in the first state to undergo the transition. We may find that this condition is fulfilled by finding the fraction of particles in the first state. If it is negligible, the transition is very likely not be observed at the temperature for which the calculation was done. In general, a larger fraction of molecules in the first state means a higher number of transitions to the second state.^[7] This gives a stronger spectral line. However, there are other factors that influence the intensity of a spectral line, such as whether it is caused by an allowed or a forbidden transition.

In statistical mechanics

The Boltzmann distribution appears in statistical mechanics when considering isolated (or nearly-isolated) systems of fixed composition that are in thermal equilibrium (equilibrium with respect to energy exchange). The most general case is the probability distribution for the canonical ensemble, but also some special cases (derivable from the canonical ensemble) also show the Boltzmann distribution in different aspects:

Canonical ensemble (general case)

The canonical ensemble gives the probabilities of the various possible states of an isolated system of fixed composition, in thermal equilibrium with a heat bath. The canonical ensemble is a probability distribution with the Boltzmann form.

Statistical frequencies of subsystems' states (in a non-interacting collection)

When the system of interest is a collection of many non-interacting copies of a smaller subsystem, it is sometimes useful to find the statistical frequency of a given subsystem state, among the collection. The canonical ensemble has the property of separability when applied to such a collection: as long as the non-interacting subsystems have fixed composition, then each subsystem's state is independent of the others and is also characterized by a canonical ensemble. As a result, the expected statistical frequency distribution of subsystem states has the Boltzmann form.

Maxwell–Boltzmann statistics of classical gases (systems of non-interacting particles)

In particle systems, many particles share the same space and regularly change places with each other; the single-particle state space they occupy is a shared space. Maxwell–Boltzmann statistics give the expected number of particles found in a given single-particle state, in a classical gas of non-interacting particles at equilibrium. This expected number distribution has the Boltzmann form.

Although these cases have strong similarities, it is helpful to distinguish them as they generalize in different ways when the crucial assumptions are changed:

• When a system is in thermodynamic equilibrium with respect to both energy exchange and particle exchange, the requirement of fixed composition is relaxed and a grand canonical ensemble is obtained rather than canonical ensemble. On the other hand, if both composition and energy are fixed, then a microcanonical ensemble applies instead.
• If the subsystems within a collection do interact with each other, then the expected frequencies of subsystem states no longer follow a Boltzmann distribution, and even may not have an analytical solution.^[8] The canonical ensemble can however still be applied to the collective states of the entire system considered as a whole, provided the entire system is isolated and in thermal equilibrium.
• With quantum gases of non-interacting particles in equilibrium, the number of particles found in a given single-particle state does not follow Maxwell–Boltzmann statistics, and there is no simple closed form expression for quantum gases in the canonical ensemble. In the grand canonical ensemble the state-filling statistics of quantum gases are described by Fermi–Dirac statistics or Bose–Einstein statistics, depending on whether the particles are fermions or bosons respectively.

In mathematics

In more general mathematical settings, the Boltzmann distribution is also known as the Gibbs measure. In statistics and machine learning it is called a log-linear model.

In economics

The Boltzmann distribution can be introduced to allocate permits in emissions trading.^[9][10] The new allocation method using the Boltzmann distribution can describe the most probable, natural, and unbiased distribution of emissions permits among multiple countries. Simple and versatile, this new method holds potential for many economic and environmental applications.

See also

• Bose–Einstein statistics
• Fermi–Dirac statistics

References

1. Landau, Lev Davidovich; and Lifshitz, Evgeny Mikhailovich (1980) [1976]. Statistical Physics. Course of Theoretical Physics 5 (3 ed.). Oxford: Pergamon Press. ISBN 0-7506-3372-7. Translated by J.B. Sykes and M.J. Kearsley. See section 28
2. McQuarrie, A. (2000) Statistical Mechanics, University Science Books, California
3. Atkins, P. W. (2010) Quanta, W. H. Freeman and Company, New York
4. Gibbs, Josiah Willard (1902). Elementary Principles in Statistical Mechanics. New York: Charles Scribner's Sons.
5. NIST Atomic Spectra Database Levels Form at nist.gov
6. Atkins, P. W.; de Paula J. (2009) Physical Chemistry, 9th edition, Oxford University Press, Oxford, UK
7. Skoog, D. A.; Holler, F. J.; Crouch, S. R. (2006) Principles of Instrumental Analysis, Brooks/Cole, Boston, MA
8. A classic example of this is magnetic ordering. Systems of non-interacting spins show paramagnetic behaviour that can be understood with a single-particle canonical ensemble (resulting in the Brillouin function). Systems of interacting spins can show much more complex behaviour such as ferromagnetism or antiferromagnetism.
9. Park, J.-W., Kim, C. U. and Isard, W. (2012) Permit allocation in emissions trading using the Boltzmann distribution. Physica A 391: 4883–4890
10. The Thorny Problem Of Fair Allocation. Technology Review blog. August 17, 2011. Cites and summarizes Park, Kim and Isard (2012).