Relationships among probability distributions

In probability theory and statistics, there are several relationships among probability distributions. These relations can be categorized in the following groups:

Relationships among some of univariate probability distributions are illustrated with connected lines. dashed lines means approximate relationship. more info:[1]

Special case of distribution parametrization

Transform of a variable

Multiple of a random variable

Multiplying the variable by any positive real constant yields a scaling of the original distribution. Some are self-replicating, meaning that the scaling yields the same family of distributions, albeit with a different parameter: Normal distribution, Gamma distribution, Cauchy distribution, Exponential distribution, Erlang distribution, Weibull distribution, Logistic distribution, Error distribution, Power distribution, Rayleigh distribution.

Example:

Linear function of a random variable

The affine transform ax + b yields a relocation and scaling of the original distribution. The following are self-replicating: Normal distribution, Cauchy distribution, Logistic distribution, Error distribution, Power distribution, Rayleigh distribution.

Example:

Reciprocal of a random variable

The reciprocal 1/X of a random variable X, is a member of the same family of distribution as X, in the following cases: Cauchy distribution, F distribution, log logistic distribution.

Examples:

Other cases

Some distributions are invariant under a specific transformation.

Example:

Conversely, if X is a lognormal (μ, σ2) random variable then log X is a normal (μ, σ2) random variable.

Functions of several variables

Sum of variables

The distribution of the sum of independent random variables is called the convolution of the primal distribution.

Examples of such univariate distributions are: Normal distribution, Poisson distribution, Binomial distribution (with common success probability), Negative binomial distribution (with common success probability), Gamma distribution(with common rate parameter), Chi-squared distribution, Cauchy distribution, Hyper-exponential distribution.

Examples:[2]

Other distributions are not closed under convolution, but their sum has a known distribution:

Product of variables

The product of independent random variables X and Y may belong to the same family of distribution as X and Y: Bernoulli distribution and Log-normal distribution.

Example:

Minimum and maximum of independent random variables

For some distributions, the minimum value of several independent random variables is a member of the same family, with different parameters: Bernoulli distribution, Geometric distribution, Exponential distribution, Extreme value distribution, Pareto distribution, Rayleigh distribution, Weibull distribution.

Examples:

Similarly, distributions for which the maximum value of several independent random variables is a member of the same family of distribution include: Bernoulli distribution, Power distribution.

Other

Approximate (limit) relationships

Approximate or limit relationship means

Combination of iid random variables:

Special case of distribution parametrization:

Consequences of the CLT:

Compound (or Bayesian) relationships

When one or more parameter(s) of a distribution are random variables, the compound distribution is the marginal distribution of the variable.

Examples:

Some distributions have been specially named as compounds: Beta-Binomial distribution, Beta-Pascal distribution, Gamma-Normal distribution.

Examples:

See also

References

  1. LEEMIS, Lawrence M.; Jacquelyn T. MCQUESTON (February 2008). "Univariate Distribution Relationships" (PDF). American Statistician 62 (1): 45–53. doi:10.1198/000313008x270448.
  2. Cook, John D. "Diagram of distribution relationships".

External links

This article is issued from Wikipedia - version of the Thursday, March 31, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.