Subgame perfect equilibrium

Subgame Perfect Equilibrium
A solution concept in game theory
Relationships
Subset of	Nash equilibrium
Intersects with	Evolutionarily stable strategy
Significance
Proposed by	Reinhard Selten
Used for	Extensive form games
Example	Ultimatum game

In game theory, a subgame perfect equilibrium (or subgame perfect Nash equilibrium) is a refinement of a Nash equilibrium used in dynamic games. A strategy profile is a subgame perfect equilibrium if it represents a Nash equilibrium of every subgame of the original game. Informally, this means that if (1) the players played any smaller game that consisted of only one part of the larger game and (2) their behavior represents a Nash equilibrium of that smaller game, then their behavior is a subgame perfect equilibrium of the larger game. Every finite extensive game has a subgame perfect equilibrium.^[1]

A common method for determining subgame perfect equilibria in the case of a finite game is backward induction. Here one first considers the last actions of the game and determines which actions the final mover should take in each possible circumstance to maximize his/her utility. One then supposes that the last actor will do these actions, and considers the second to last actions, again choosing those that maximize that actor's utility. This process continues until one reaches the first move of the game. The strategies which remain are the set of all subgame perfect equilibria for finite-horizon extensive games of perfect information.^[1] However, backward induction cannot be applied to games of imperfect or incomplete information because this entails cutting through non-singleton information sets.

A subgame perfect equilibria necessarily satisfies the One-Shot deviation principle.

The set of subgame perfect equilibria for a given game is always a subset of the set of Nash equilibria for that game. In some cases the sets can be identical.

The Ultimatum game provides an intuitive example of a game with fewer subgame perfect equilibria than Nash equilibria.

Example

An example for a game possessing an ordinary Nash equilibrium and a subgame perfect equilibrium is shown in Figure 1. The strategies for player 1 are given by $\{L, R\}$ whereas player 2 has the choice between $\{K, U\}^2$ as his choice to be kind or unkind to player 1 might depend on the choice previously made by player 1.

Figure 1: An extensive-form game together with two different equilibria

An extensive-form game

A Nash equilibrium which is not subgame perfect

A subgame perfect equilibrium

The payoff matrix of the game is shown in Table 1. Observe that there are two different equilibria, which are also shown in Figure 1. Consider the equilibrium given by the strategy profile $L, (U, U)$ (shown in the middle). Observe that while the profile is obviously a Nash equilibrium the behaviour of player 2 is rather hard to justify when we look at his choice at the node $2_2$ : By choosing strategy $K$ instead of $U$ player 2 would increase his profit if node $2_2$ would actually be reached during the progress of the game. More formally, the equilibrium is not an equilibrium with respect to the subgame induced by node $2_2$ . It is likely that in real life player 2 would choose the strategy $(U, K)$ instead which would in turn inspire player 1 to change his strategy to $R$ . The resulting profile $R, (U, K)$ (shown on the right) is not only a Nash equilibrium but it is also an equilibrium in all subgames (induced by the nodes $2_1$ resp $2_2$ ). It is therefore a subgame perfect equilibrium.

Table 1: Payoff matrix
	(K, K)	(K, U)	(U, U)	(U, K)
L	(3, 1)	(3, 1)	(1, 3)	(1, 3)
R	(2, 1)	(0, 0)	(0, 0)	(2, 1)

Finding subgame-perfect equilibria

One game in which the backward induction solution is well known is tic-tac-toe

Reinhard Selten proved that any game which can be broken into "sub-games" containing a sub-set of all the available choices in the main game will have a subgame perfect Nash Equilibrium strategy (possibly as a mixed strategy giving non-deterministic sub-game decisions). Subgame perfection is only used with games of complete information. Subgame perfection can be used with extensive form games of complete but imperfect information.

The subgame-perfect Nash equilibrium is normally deduced by "backward induction" from the various ultimate outcomes of the game, eliminating branches which would involve any player making a move that is not credible (because it is not optimal) from that node. One game in which the backward induction solution is well known is tic-tac-toe, but in theory even Go has such an optimum strategy for all players.

The interesting aspect of the word "credible" in the preceding paragraph is that taken as a whole (disregarding the irreversibility of reaching sub-games) strategies exist which are superior to subgame perfect strategies, but which are not credible in the sense that a threat to carry them out will harm the player making the threat and prevent that combination of strategies. For instance in the game of "chicken" if one player has the option of ripping the steering wheel from their car they should always take it because it leads to a "sub game" in which their rational opponent is precluded from doing the same thing (and killing them both). The wheel-ripper will always win the game (making his opponent swerve away), and the opponent's threat to suicidally follow suit is not credible.

References

1 2 Osborne, M. J. (2004). An Introduction to Game Theory. Oxford University Press.

External links

Topics in game theory

Definitions	Normal-form game Extensive-form game Escalation of commitment Graphical game Cooperative game Succinct game Information set Hierarchy of beliefs Preference

Equilibrium concepts	Nash equilibrium Subgame perfection Mertens-stable equilibrium Bayesian-Nash Perfect Bayesian Trembling hand Proper equilibrium Epsilon-equilibrium Correlated equilibrium Sequential equilibrium Quasi-perfect equilibrium Evolutionarily stable strategy Risk dominance Core Shapley value Pareto efficiency Quantal response equilibrium Self-confirming equilibrium Strong Nash equilibrium Markov perfect equilibrium

Strategies	Dominant strategies Pure strategy Mixed strategy Tit for tat Grim trigger Collusion Backward induction Forward induction Markov strategy

Classes of games	Symmetric game Perfect information Simultaneous game Sequential game Repeated game Signaling game Cheap talk Zero-sum game Mechanism design Bargaining problem Stochastic game n-player game Large Poisson game Nontransitive game Global games Strictly determined game

Games	Prisoner's dilemma Traveler's dilemma Coordination game Chicken Centipede game Volunteer's dilemma Dollar auction Battle of the sexes Stag hunt Matching pennies Ultimatum game Rock-paper-scissors Pirate game Dictator game Public goods game Blotto games War of attrition El Farol Bar problem Fair division Fair cake-cutting Cournot game Deadlock Diner's dilemma Guess 2/3 of the average Kuhn poker Nash bargaining game Screening game Prisoners and hats puzzle Trust game Princess and monster game Monty Hall problem Rendezvous problem

Theorems	Minimax theorem Nash's theorem Purification theorem Folk theorem Revelation principle Arrow's impossibility theorem

Key figures	Kenneth Arrow Robert Aumann Kenneth Binmore Samuel Bowles Melvin Dresher Merrill M. Flood Drew Fudenberg Donald B. Gillies John Harsanyi Leonid Hurwicz David K. Levine Daniel Kahneman David M. Kreps Harold W. Kuhn Eric Maskin Jean-François Mertens Paul Milgrom Oskar Morgenstern Hervé Moulin Roger Myerson John Nash John von Neumann Ariel Rubinstein Thomas Schelling Reinhard Selten Herbert Simon Lloyd Shapley John Maynard Smith Jean Tirole Albert W. Tucker Amos Tversky William Vickrey Robert B. Wilson Peyton Young

See also	Tragedy of the commons Tyranny of small decisions All-pay auction List of games in game theory Confrontation analysis List of game theorists Combinatorial game theory Alpha–beta pruning Bertrand paradox Bounded rationality No-win situation Coopetition

This article is issued from Wikipedia - version of the Friday, October 30, 2015. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.

Subgame perfect equilibrium

Example

Finding subgame-perfect equilibria

See also

References

External links