Inverse probability weighting

Inverse probability weighting is a statistical technique for calculating statistics standardized to a population different from that in which the data was collected. Study designs with a disparate sampling population and population of target inference (target population) are common in application.[1] There may be prohibitive factors barring researchers from directly sampling from the target population such as cost, time, or ethical concerns.[2] A solution to this problem is to use an alternate design strategy, e.g. stratified sampling. Weighting, when correctly applied, can potentially improve the efficiency and reduce the bias of unweighted estimators.

One very early weighted estimator is the Horvitz–Thompson estimator of the mean.[3] When the sampling probability is known, from which the sampling population is drawn from the target population, then the inverse of this probability is used to weight the observations. This approach has been generalized to many aspects of statistics under various frameworks. In particular, there are weighted likelihoods, weighted estimating equations, and weighted probability densities from which a majority of statistics are derived. These applications codified the theory of other statistics and estimators such as marginal structural models, the standardized mortality ratio, and the EM algorithm for coarsened or aggregate data.

Inverse probability weighting is also used to account for missing data when subjects with missing data cannot be included in the primary analysis.[4] With an estimate of the inclusion probability, or the probability that the factor would be measured in another measurement, inverse probability weighting can be used to inflate the weight for subjects who are underrepresented due to a large degree of missing data.

References

  1. Robins, JM; Rotnitzky, A; Zhao, LP (1994). "Estimation of regression coefficients when some regressors are not always observed". Journal of the American Statistical Association 89 (427): 846–866. doi:10.1080/01621459.1994.10476818.
  2. Breslow, NE; Lumley, T; et al. (2009). "Using the Whole Cohort in the Analysis of Case-Cohort Data". Am J Epidemiol 169 (11): 1398–1405. doi:10.1093/aje/kwp055. PMC 2768499. PMID 19357328.
  3. Horvitz, D. G.; Thompson, D. J. (1952). "A generalization of sampling without replacement from a finite universe". Journal of the American Statistical Association 47: 663–685. doi:10.1080/01621459.1952.10483446.
  4. Hernan, MA; Robins, JM (2006). "Estimating Causal Effects From Epidemiological Data". J Epi Comm 60: 578–596. doi:10.1136/jech.2004.029496. CiteSeerX: 10.1.1.157.9366.
This article is issued from Wikipedia - version of the Wednesday, May 13, 2015. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.