Compound Poisson distribution

In probability theory, a compound Poisson distribution is the probability distribution of the sum of a number of independent identically-distributed random variables, where the number of terms to be added is itself a Poisson-distributed variable. In the simplest cases, the result can be either a continuous or a discrete distribution.

Definition

Suppose that

$N\sim\operatorname{Poisson}(\lambda),$

i.e., N is a random variable whose distribution is a Poisson distribution with expected value λ, and that

$X_1, X_2, X_3, \dots$

are identically distributed random variables that are mutually independent and also independent of N. Then the probability distribution of the sum of $N$ i.i.d. random variables conditioned on the number of these variables ($N$):

$Y \mid N=\sum_{n=1}^N X_n$

has a well-defined distribution. In the case N = 0, then the value of Y is 0, so that then Y | N = 0 has a degenerate distribution.

The compound Poisson distribution is obtained by marginalising the joint distribution of (Y,N) over N, where this joint distribution is obtained by combining the conditional distribution Y | N with the marginal distribution of N.

Properties

Mean and variance of the compound distribution derive in a simple way from law of total expectation and the law of total variance. Thus

$\operatorname{E}_Y(Y)= \operatorname{E}_N\left[\operatorname{E}_{Y\mid N}(Y)\right]= \operatorname{E}_N\left[N \operatorname{E}_X(X)\right]= \operatorname{E}_N(N)\operatorname{E}_X(X) ,$

$\operatorname{Var}_Y(Y) = E_N\left[\operatorname{Var}_{Y\mid N}(Y)\right] + \operatorname{Var}_N\left[E_{Y\mid N}(Y)\right] =\operatorname{E}_N\left[N\operatorname{Var}_X(X)\right] + \operatorname{Var}_N\left[N\operatorname{E}_X(X)\right] ,$

giving

$\operatorname{Var}_Y(Y) = \operatorname{E}_N(N)\operatorname{Var}_X(X) + \left(\operatorname{E}_X(X)\right)^2\operatorname{Var}_N(N) .$

Then, since E(N)=Var(N) if N is Poisson, and dropping the unnecessary subscripts, these formulae can be reduced to

$\operatorname{E}(Y)= \operatorname{E}(N)\operatorname{E}(X) ,$

$\operatorname{Var}(Y) = E(N)(\operatorname{Var}(X) + {E(X)}^2 )= E(N){E(X^2)}.$

The probability distribution of Y can be determined in terms of characteristic functions:

$\varphi_Y(t) = \operatorname{E}(e^{itY})= \operatorname{E}_N ( \left(\operatorname{E} (e^{itX}) )^N \right)= \operatorname{E}_N ((\varphi_X(t))^N), \,$

and hence, using the probability-generating function of the Poisson distribution, we have

$\varphi_Y(t) = \textrm{e}^{\lambda(\varphi_X(t) - 1)}.\,$

An alternative approach is via cumulant generating functions:

$K_Y(t)=\ln E[e^{tY}]=\ln E[E[e^{tY}\mid N]]=\ln E[e^{NK_X(t)}]=K_N(K_X(t)) . \,$

Via the law of total cumulance it can be shown that, if the mean of the Poisson distribution λ = 1, the cumulants of Y are the same as the moments of X₁.

It can be shown that every infinitely divisible probability distribution is a limit of compound Poisson distributions.^[1] And compound Poisson distributions is infinitely divisible by the definition.

Discrete compound Poisson distribution

When $X_1, X_2, X_3, \dots$ are non-negative integer-valued i.i.d random variables with $P(X_1 = k) = \alpha_k,\ (k =1,2, \ldots )$, then this compound Poisson distribution is named discrete compound Poisson distribution^[2][3] (or stuttering-Poisson distribution^[4]) . We say that the discrete random variable $Y$ satisfying probability generating function characterization

$P_Y(z) = \sum\limits_{i = 0}^\infty P(Y = i)z^i = \exp\left(\sum\limits_{k = 1}^\infty \alpha_k \lambda (z^k - 1)\right), \quad (|z| \le 1)$

has a discrete compound Poisson(DCP) distribution with parameters $(\alpha_1 \lambda,\alpha_2 \lambda, \ldots ) \in \mathbb{R}^\infty \left(\sum_{i = 1}^\infty \alpha_i = 1, \alpha_i \ge 0,\lambda > 0 \right)$, which is denoted by

$X \sim {\text{DCP}}(\lambda {\alpha _1},\lambda {\alpha _r}, \cdots )$

Moreover, if $X \sim {\text{DCP}}(\lambda {\alpha _1}, \cdots ,\lambda {\alpha _r})$, we say $X$ has a discrete compound Poisson distribution of order $r$ . When $r = 1,2$, DCP becomes Poisson distribution and Hermite distribution, respectively. When $r = 3,4$, DCP becomes triple stuttering-Poisson distribution and quadruple stuttering-Poisson distribution, respectively.^[5] Other special cases include: geometric distribution, negative binomial distribution, Geometric Poisson distribution, Neyman type A distribution, Luria–Delbrück distribution in Luria–Delbrück experiment. For more special case of DCP, see the reviews paper^[6] and references therein.

Feller's characterization of the compound Poisson distribution states that a non-negative integer valued r.v. $X$ is infinitely divisible if and only if its distribution is a discrete compound Poisson distribution.^[7] It can be shown that the negative binomial distribution is discrete infinitely divisible, i.e., if X has a negative binomial distribution, then for any positive integer n, there exist discrete i.i.d. random variables X₁, ..., X_n whose sum has the same distribution that X has. The shift geometric distribution is discrete compound Poisson distribution since it is a trivial case of negative binomial distribution.

This distribution can model batch arrivals (such as in a bulk queue ^[4][8]). The discrete compound Poisson distribution is also widely used in actuarial science for modelling the distribution of the total claim amount.^[3]

When some $\alpha_k$ are non-negative, it is the discrete pseudo compound Poisson distribution.^[3] We define that any discrete random variable $Y$ satisfying probability generating function characterization

$G_Y(z) = \sum\limits_{n = 0}^\infty P(Y = n)z^n = \exp\left(\sum\limits_{k = 1}^\infty \alpha_k \lambda (z^k - 1)\right), \quad (|z| \le 1)$

has a discrete pseudo compound Poisson distribution with parameters $(\lambda_1 ,\lambda_2, \ldots )=:(\alpha_1 \lambda,\alpha_2 \lambda, \ldots ) \in \mathbb{R}^\infty \left( {\sum\limits_{k = 1}^\infty {{\alpha _k}} = 1,\sum\limits_{k = 1}^\infty {\left| {{\alpha _k}} \right|} < \infty ,{\alpha _k} \in {\mathbb{R}},\lambda > 0} \right)$.

Other special cases

If the distribution of X is either an exponential distribution or a gamma distribution, then the conditional distributions of Y | N are gamma distributions in which the shape parameters are proportional to N. This shows that the formulation of the "compound Poisson distribution" outlined above is essentially the same as the more general class of compound probability distributions. However, the properties outlined above do depend on its formulation as the sum of a Poisson-distributed number of random variables. The distribution of Y in the case of the compound Poisson distribution with exponentially-distributed summands can be written in an form.^[9][10]

Compound Poisson processes

A compound Poisson process with rate $\lambda>0$ and jump size distribution G is a continuous-time stochastic process $\{\,Y(t) : t \geq 0 \,\}$ given by

$Y(t) = \sum_{i=1}^{N(t)} D_i,$

where the sum is by convention equal to zero as long as N(t)=0. Here, $\{\,N(t) : t \geq 0\,\}$ is a Poisson process with rate $\lambda$, and $\{\,D_i : i \geq 1\,\}$ are independent and identically distributed random variables, with distribution function G, which are also independent of $\{\,N(t) : t \geq 0\,\}.\,$^[11]

For the discrete version of compound Poisson process, it can be used in survival analysis for the frailty models.^[12]

Applications

A compound Poisson distribution, in which the summands have an exponential distribution, was used by Revfeim^[9] to model the distribution of the total rainfall in a day, where each day contains a Poisson-distributed number of events each of which provides an amount of rainfall which has an exponential distribution. Thompson^[10] applied the same model to monthly total rainfalls.

See also

• Compound Poisson process
• Hermite distribution
• Negative binomial distribution
• Geometric distribution
• Geometric Poisson distribution
• Gamma distribution
• Poisson distribution
• Zero-inflated model

References

1. Lukacs, E. (1970). Characteristic functions. London: Griffin.
2. Johnson, N.L., Kemp, A.W., and Kotz, S. (2005) Univariate Discrete Distributions, 3rd Edition, Wiley, ISBN 978-0-471-27246-5.
3. Huiming, Zhang; Yunxiao Liu; Bo Li (2014). "Notes on discrete compound Poisson model with applications to risk theory". Insurance: Mathematics and Economics 59: 325–336. doi:10.1016/j.insmatheco.2014.09.012.
4. Kemp, C. D. (1967). ""Stuttering – Poisson" distributions". Journal of the Statistical and Social Enquiry of Ireland 21 (5): 151–157.
5. Patel, Y. C. (1976). Estimation of the parameters of the triple and quadruple stuttering-Poisson distributions. Technometrics, 18(1), 67-73.
6. Wimmer, G., Altmann, G. (1996). The multiple Poisson distribution, its characteristics and a variety of forms. Biometrical journal, 38(8), 995-1011.
7. Feller, W. (1968).An introduction to probability theory and its applications,Vol. I. 3rd., Wiley, New York.
8. Adelson, R. M. (1966). Compound poisson distributions. OR, 73–75.
9. Revfeim, K.J.A. (1984) An initial model of the relationship between rainfall events and daily rainfalls. Journal of Hydrology, 75, 357–364.
10. Thompson, C.S. (1984) Homogeneity analysis of a rainfall series: an application of the use of a realistic rainfall model. J. Climatology, 4, 609 – 619.
11. S. M. Ross (2007). Introduction to Probability Models (ninth ed.). Boston: Academic Press. ISBN 978-0-12-598062-3.
12. Ata, N., & Özel, G. (2013). Survival functions for the frailty models based on the discrete compound Poisson process. Journal of Statistical Computation and Simulation, 83(11), 2105–2116.