Bayesian inference in marketing

Bayes' Theorem

In marketing, Bayesian inference allows for decision making and market research evaluation under uncertainty and with limited data.

Introduction

Bayes’ theorem is fundamental to Bayesian inference. It is a subset of statistics, providing a mathematical framework for forming inferences through the concept of probability, in which evidence about the true state of the world is expressed in terms of degrees of belief through subjectively assessed numerical probabilities. Such a probability is known as a Bayesian probability. The fundamental ideas and concepts behind Bayes’ theorem, and its use within Bayesian inference, have been developed and added to over the past centuries by Thomas Bayes, Richard Price and Pierre Simon Laplace as well as numerous other mathematicians, statisticians and scientists.^[1] Bayesian inference has experienced spikes in popularity as it has been seen as vague and controversial by rival frequentist statisticians.^[2] In the past few decades Bayesian inference has become widespread in many scientific and social science fields such as marketing. Bayesian inference allows for decision making and market research evaluation under uncertainty and limited data.^[3]

Bayes’ theorem

Bayesian probability specifies that there is some prior probability. Bayesian statisticians can use both an objective and a subjective approach when interpreting the prior probability, which is then updated in light of new relevant information. The concept is a manipulation of conditional probabilities:^[3]

$P(AB)=P(A|B)P(B)=P(B|A)P(A)$

Alternatively, a more simple understanding of the formula may be reached by substituting the events $A$ and $B$ to become respectively the hypothesis $(H)$ and the data $(D)$. The rule allows for a judgment of the relative truth of the hypothesis given the data.^[3]

This is done through the calculation shown below, where $P(D|H)$ is the likelihood function. This assesses the probability of the observed data $(D)$ arising from the hypothesis $(H)$; $P(H)$ is the assigned prior probability or initial belief about the hypothesis; the denominator $P(D)$ is formed by the integrating or summing of $P(D|H)P(H)$; $P(H|D)$ is known as the posterior which is the recalculated probability, or updated belief about the hypothesis. It is a result of the prior beliefs as well as sample information. The posterior is a conditional distribution as the result of collecting or in consideration of new relevant data.^[3]

$P(H|D)=\frac{P(D|H)P(H)}{P(D)}$

To sum up this formula: the posterior probability of the hypothesis is equal to the prior probability of the hypothesis multiplied by the conditional probability of the evidence given the hypothesis, divided by the probability of the new evidence.^[4]

Use in marketing

History

While the concepts of Bayesian statistics are thought to date back to 1763, marketers’ exposure to the concepts are relatively recent, dating from 1959.^[2] Subsequently many books^[5][6][7] and articles^[8][9] have been written about the application of Bayesian statistics to marketing decision-making and market research. It was predicted that the Bayesian approach would be used widely in the marketing field but up until the mid-1980s the methods were considered impractical.^[10] The resurgence in the use of Bayesian methods is largely due to the developments over the last few decades in computational methods; and expanded availability of detailed marketplace data - primarily due to the birth of the world wide web and explosion of the internet.

Application in marketing

Bayesian decision theory can be applied to all four areas of the marketing mix.^[11] Assessments are made by a decision maker on the probabilities of events that determine the profitability of alternative actions where the outcomes are uncertain. Assessments are also made for the profit (utility) for each possible combination of action and event. The decision maker can decide how much research, if any, needs to be conducted in order to investigate the consequences associated with the courses of action under evaluation. This is done before a final decision is made, but it should be noted that in order to do this costs would be incurred, time used and may overall be unreliable. For each possible action, expected profit can be computed, that is a weighted mean of the possible profits, the weights being the probabilities. The decision maker can then choose the action for which the expected profit is the highest. The theorem provides a formal reconciliation between judgment expressed quantitatively in the prior distribution and the statistical evidence of the experiment.

New product development

The use of Bayesian decision theory in new product development allows for the use of subjective prior information. Bayes in new product development allows for the comparison of additional review project costs with the value of additional information in order to reduce the costs of uncertainty. The methodology used for this analysis is in the form of decision trees and ‘stop’/‘go’ procedures. If the predicted payoff (the posterior) is acceptable for the organisation the project should go ahead, if not, development should stop. By reviewing the posterior (which then becomes the new prior) on regular intervals throughout the development stage managers are able to make the best possible decision with the information available at hand. Although the review process may delay further development and increase costs, it can help greatly to reduce uncertainty in high risk decisions.

Pricing decisions

Bayesian decision theory can be used in looking at pricing decisions. Field information such as retail and wholesale prices as well as the size of the market and market share are all incorporated into the prior information. Managerial judgement is included in order to evaluate different pricing strategies. This method of evaluating possible pricing strategies does have its limitations as it requires a number of assumptions to be made about the market place in which an organisation operates. As markets are dynamic environments it is often difficult to fully apply Bayesian decision theory to pricing strategies without simplifying the model.

Promotional campaigns

When dealing with promotion a marketing manager must account for all the market complexities that are involved in a decision. As it is difficult to account for all aspects of the market, a manager should look to incorporate both experienced judgements from senior executives as well modifying these judgements in light of economically justifiable information gathering. An example of the application of Bayesian decision theory for promotional purposes could be the use of a test sample in order to assess the effectiveness of a promotion prior to a full scale role out. By combining prior subjective data about the occurrence of possible events with experimental empirical evidence gained through a test market, the resultant data can be used to make decisions under risk.

Channel decisions and the logistics of distribution

Bayesian decision analysis can also be applied to the channel selection process. In order to help provide further information the method can be used that produces results in a profit or loss aspect. Prior information can include costs, expected profit, training expenses and any other costs relevant to the decision as well as managerial experience which can be displayed in a normal distribution. Bayesian decision making under uncertainty lets a marketing manager assess his/her options for channel logistics by computing the most profitable method choice. A number of different costs can be entered into the model that helps to assess the ramifications of change in distribution method. Identifying and quantifying all of the relevant information for this process can be very time consuming and costly if the analysis delays possible future earnings.

Strengths

The Bayesian approach is superior to use in decision making when there is a high level of uncertainty or limited information in which to base decisions on and where expert opinion or historical knowledge is available. Bayes is also useful when explaining the findings in a probability- sense to people who are less familiar and comfortable with comprehending statistics. It is in this sense that Bayesian methods are thought of as having created a bridge between business judgments and statistics for the purpose of decision-making.^[12]

The three principle strengths of Bayes' theorem that have been identified by scholars are that it is prescriptive, complete and coherent.^[13] Prescriptive in that it is the theorem that is the simple prescription to the conclusions reached on the basis of evidence and reasoning for the consistent decision maker. It is complete because (for a given choice of model and prior distribution) the solution is often clear and unambiguous. It allows for the incorporation of prior information when available to increase the robustness of the solutions, as well as taking into consideration the costs and risks that are associated with choosing alternate decisions.^[14] Lastly Bayes theorem is coherent. It is considered the most appropriate way to update beliefs by welcoming the incorporation of new information, as is seen through the probability distributions (see Savage^[15] and De Finetti^[16]). This is further complemented by the fact that Bayes inference satisfies the likelihood principle,^[17] which states that models or inferences for datasets leading to the same likelihood function should generate the same statistical information. Bayes methods are more cost effective than the traditional frequentist take on marketing research and subsequent decision making. The probability can be assessed from a degree of belief before and after accounting for evidence, instead of calculating the probabilities of a certain decision by carrying out a large number of trials with each one producing an outcome from a set of possible outcomes. The planning and implementation of trials to see how a decision impacts in the ‘field’ e.g. observing consumers reaction to a relabeling of a product, is time consuming and costly, a method many firms cannot afford. In place of taking the frequentist route in aiming for a universally acceptable conclusion through iteration,^[18] it is sometimes more effective to take advantage of all the information available to the firm to work out the ‘best’ decision at the time, and then subsequently when new knowledge is obtained, revise the posterior distribution to be then used as the prior, thus the inferences continue to logically contribute to one another based on Bayes theorem.^[19]

Weaknesses

In marketing situations, it is important that the prior probability is (1) chosen correctly, and (2) is understood. A disadvantage to using Bayesian analysis is that there is no ‘correct’ way to choose a prior, therefore the inferences require a thorough analysis to translate the subjective prior beliefs into a mathematically formulated prior to ensure that the results will not be misleading and consequently lead to the disproportionate analysis of preposteriors.^[2] The subjective definition of probability and the selection and use of the priors have led to statisticians critiquing this subjective definition of probability that underlies the Bayesian approach.^[13] Bayesian probability is often found to be difficult when analysing and assessing probabilities due to its initial counter intuitive nature. Often when deciding between strategies based on a decision, they are interpreted as: where there is evidence X that shows condition A might hold true, is misread by judging A’s likelihood by how well the evidence X matches A, but crucially without considering the prior frequency of A.^[13] In alignment with Falsification, which aims to question and falsify instead of prove hypotheses, where there is very strong evidence X, it does not necessarily mean there is a very high probability that A leads to B, but in fact should be interpreted as a very low probability of A not leading to B. In the field of marketing, behavioural experiments which have dealt with managerial decision- making,^[20][21] and risk perception,^[22][23] in consumer decisions have utilised the Bayesian model, or similar models, but found that it may not be relevant quantitatively in predicting human information processing behaviour. Instead the model has been proven as useful as a qualitative means of describing how individuals combine new evidence with their predetermined judgements. Therefore “the model may have some value as a first approximation to the development of descriptive choice theory” in consumer and managerial instances.^[2]

Example

An advertising manager is deciding whether or not to increase the advertising for a product in a particular market. The Bayes approach to this decision suggests: 1) These alternative courses of action for which the consequences are uncertain are a necessary condition in order to apply Bayes’; 2) The advertising manager will pick the course of action which allows him to achieve some objective i.e. a maximum return on his advertising investment in the form of profit; 3) He must determine the possible consequences of each action into some measure of success (or loss) with which a certain objective is achieved.

This 3 component example explains how the payoffs are conditional upon which outcomes occur. The advertising manager can characterize the outcomes based on past experience and knowledge and devise some possible events that are more likely to occur than others. He can then assign to these events prior probabilities, which would be in the form of numerical weights.^[24]

He can test out his predictions (prior probabilities) through an experiment. For example he can run a test campaign to decide if the total level of advertising should be in fact increased. Based on the outcome of the experiment he can re-evaluate his prior probability and make a decision on whether to go ahead with increasing the advertising in the market or not. However gathering this additional data is costly, time consuming and may not lead to perfectly reliable results. As a decision makers he has to deal with experimental and systematic error and this is where Bayes’ comes in.

It approaches the experimental problem by asking; is additional data required? If so, how much needs to be collected and by what means and finally, how does the decision maker revise his prior judgment in light of the results of the new experimental evidence? In this example the advertising manager can use the Bayesian approach to deal with his dilemma and update his prior judgments in light of new information he gains. He needs to take into account the profit (utility) attached to the alternative acts under different events and the value versus cost of information in order to make his optimal decision on how to proceed.

Bayes in computational models

Markov Chain Monte Carlo (MCMC) is a flexible procedure designed to fit a variety of Bayesian models. It is the underlying method used in computational software such as the LaplacesDemon R Package and WinBUGS. The advancements and developments of these types of statistical software have allowed for the growth of Bayes by offering ease of calculation. This is achieved by the generation of samples from the posterior distributions, which are then used to produce a range of options or strategies which are allocated numerical weights. MCMC obtains these samples and produces summary and diagnostic statistics while also saving the posterior samples in the output. The decision maker can then assess the results from the output data set and choose the best option to proceed.^[19]

References

1. McGrayne, S. B. (2011). The Theory that Would Not Die, New Haven: Yale University Press.
2. Green, P. E. and Frank, R. E. (1966). “Bayesian Statistics and Marketing Research”, Journal of the Royal Statistical Society, Series C 15 (3): 173-190. JSTOR 2985299
3. Olshausen B. A. (2004) “Bayesian Probability Theory” http://redwood.berkeley.edu/bruno/npb163/bayes.pdf
4. Paulos, J. A. (2011) “The Mathematics of Changing your Mind” Book review, New York Times. (August 5th p14 sunday book review)
5. Chernoff, H. and Moses, L. E. (1959). Elementary Decision Theory. New York: Wiley; London: Chapman & Hall
6. Schlaifer, R. (1959). Probability and Statistics for Business Decisions, New York: McGraw Hill
7. Rossi, P. E., Allenby, G. M. and McCulloch, R. (2005). Bayesian Statistics and Marketing, New York: Wiley
8. Roberts, H. V. (1960). “The New Business Statistics”, Journal of Business 33 (1): 21-30.
9. Pratt, J. W., Raiffa, H. and Schlaifer, R. (1964). ”The Foundations of Decision Under Uncertainty: An Elementary Exposition”, Journal of the American Statistical Association 59 (306): 353- 375
10. Rossi, P.E., Allenby. G. M (2003) "Bayesian Statistics and Marketing" Marketing Science 22 (3): 304-328
11. Alderson, W., Green, P. E. (1964) Planning and Problem Solving in Marketing. Richard D. Irwin Inc Illinois
12. Roberts, H. V. (1963). “Bayesian Statistics in Marketing” Journal of Marketing 27 (1):1-4
13. Little, R.(2006). “Calibrated Bayes: A Bayes/ Frequentist Roadmap”, The American Statistician 60 (3): 213-233
14. Wald, A.(1950). “Statistical Decision Functions”, in: Kotz, S. And Johnson, N. L. (Eds.) (1992). Breakthroughs in Statistics: Foundations and Basic Theory, New York: Wiley
15. Savage, L. J. (1954). The Foundations of Statistics, New York: Wiley
16. De Finetti, B. (1974). The Theory of Probability, New York: Wiley
17. Birnbaum, A. (1962). “On the Foundations of Statistical Inference”, Journal of the American Statistical Association, 57 (298), 269- 306. <http://www.jstor.org/stable/2281640>
18. Bradley, E(2005). “Bayesians, Frequentists, and Scientists”, Journal of the American Statistical Association 100 (469):1- 5. http://search.proquest.com.ezproxy.otago.ac.nz/docview/274829688
19. SAS Institute Inc. (2009). SAS/STAT® 9.2 User’s Guide, Second Edition, Cary, NC: SAS Institute Inc.
20. Green, P. E., Peters, W. S. and Robinson, P. J. (1966). “A Behavioural Experiment in Decision- Making under Uncertainty”, Journal of Purchasing, 2: 18-31
21. Starbuck, W. H. and Bass, F. M. (1965). An Experimental Study of Risk-taking and the Value of Information in a New Product Context. Institute Paper No. 117. Herman C. Krannert Graduate School of Industrial Administration, Perdue University
22. Baur, R. A. (1960). “Consumer Behaviour as Risk Taking”, Proc. 43rd National Conference American Marketing Association., 389-398. Chicago: American Marketing Association
23. Cox, D. F. and Rich, S. (1964). “Perceived Risk and Consumer Decision-making- The Case of Telephone Shopping”, Journal of Marketing Research, 1 (4): 32-39
24. Green, P. E. (1962) “Bayesian Decision Theory in Advertising”. Journal of Advertising 33-42

Further reading

For illustrative examples of Bayesian applications in marketing:

• Rossi, P. E. and Allenby, G. M. (1993) “A Bayesian Approach to estimating Household Parameters” Journal of Marketing Research 30 (2): 171-182.
• Yang, S. and Allenby, G. M. (2003). “Modelling Interdependent Consumer Preferences”, Journal of Marketing Research 40 (3): 282-294.
• Kim, J., Allenby, G. M. and Rossi, P. E. (2002) “Modelling Consumer Demand for Variety” Marketing Science 21 (3): 223-228.
• Allenby, G. M., Shively, T., Yang, S. and Garratt, M. J. (2004). “A Choice Model for Packaged Goods: Dealing with Discrete Quantities and Quantity Discount” Marketing Science 23 (1): 95-108.
• Green, P. E. and Frank, R. E. (1966). “Bayesian Statistics and Marketing Research”, Journal of the Royal Statistical Society, Series C 15 (3): 182 -a marketing manager deciding on whether to re label one of its products
• Alderson, W., Green, P. E. (1964). Planning and Problem Solving in Marketing, Illinois: Richard D. Irwin Inc Illinois.
• McGrayne, S. B. (2011). The Theory that Would Not Die, Yale University Press: New Haven; London.