Intermediate Microeconomics Module 17 Game Theory

GAME THEORY 391 CHAPTER 17 Game Theory THE POLICY QUESTION DO WE NEED TO REGULATE BANKS TO SAVE THEM FROM THEMSELVES ?

In the real estate and banking crisis that caused the United States to fall into the worst recession since the Great Depression , banks were seen to have engaged in reckless and risky behavior that was against their . Part of the risky behavior was attributed to the relaxation of banking , particularly those that separated commercial banks from investment banks . But the question of why banks would engage in behavior in the first place is one that puzzles many observers who have a background in economics and knows that free markets often direct individual action toward the good of society . One possible explanation for this disconnect is the possibility that the banking industry is much more strategic than policy makers understood . The strategic incentives to take risks could be a lot more than generally appreciated . The nature of this strategic environment and the incentives it provides are essential to understand to be able to make appropriate and effective policies . EXPLORING THE POLICY QUESTION . What are the strategic incentives for banks to take risks ?

What policy solutions present themselves from this analysis ?

LEARNING OBJECTIVES What Is Game Theory ?

Learning Describe game theory and the types of situations it describes . Single Play Games Learning Describe normal form games , and identify optimal strategies and equilibrium outcomes in such games . Sequential Games Learning Describe sequential move games , and explain how they are solved . 391

392 PATRICK EMERSON Repeated Games Learning Objective Describe repeated games and the difference between finitely repeated games and infinitely repeated games and their equilibrium , Policy Example Do We Need to Regulate Banks to Save Them from Themselves ?

Learning Objective Explain how game theory can be used to understand the banking collapse of 2008 , WHAT IS GAME THEORY ?

Learning Objective Describe game theory and the types of situations it describes . Until this chapter , we have studied economic in situations where an agent payoff is based on their actions alone . In other words , the payoff to an agent actions is known , and the trick is to figure out how to get the highest payoff . But there are many situations in which the payoffs to an agent actions are determined in part by the actions of other agents . Consider this simple example On Saturday , you know there are a number of parties happening in and around your school . How much you will enjoy attending any one party is in large part determined by how many of your friends will be there . In other words , your payoff is a function of not only your decision about which party to attend but also the decisions of your friends . We call these types of interactions strategic interactions , where agents must anticipate the actions of others when making decisions , and we use game theory to model them so that we can think about the outcomes of these interactions just like we think about outcomes in markets without strategic interaction , like the price and quantity outcome in a product market . Game theory is the study of strategic interactions among economic agents . Game theory is extremely useful because it allows us to anticipate the behavior of economic agents within a game and the outcomes of strategic games . Game theory gets its name from actual games . Checkers and chess are strategic games where two players interact , and the outcome of the game is determined by the actions of both players . In economics , game theory is particularly useful in standing imperfectly competitive markets like subject of the next the price and output decisions ofone firm affect the demand and therefore profit function ofthe other firms . But before we can study oligopoly markets , we must first understand games and how to analyze them . In this chapter , we will consider only games , games where the players are not able to negotiate and make binding agreements within the game . An example of a cooperative game might be one where two poker players agree to share winnings no matter who actually wins as a result , their strategies are based on how best to maximize thejoint expected payoff , not individual payoffs . All games have three basic elements players , strategies , and payoffs . The players of the game are the agents actively participating in the game and who will experience outcomes based on the play ofall ers . The strategies are all the possible strategic choices available to each player they can be the same for all players or different for each player . The payoffs are the outcomes associated with every ble strategic combination for each player . Any complete description of a game must include these three elements . In the games that we will study in this chapter , we will assume that each player goal is to maximize their individual payoff , which is consistent with the rational utility maximizing agent that is the foundation of modern economic theory .

GAME THEORY 393 We begin by separating games into two basic types simultaneous games and sequential games . games are games in which players take strategic actions at the same time without knowing what move the other has chosen . A good example of this type of game is the matching coins game where two players each have a coin and choose which side to face up . They then reveal their choices simultaneously , and if they match , one player gets to keep both coins , and if they do match , the other player keeps both coins . Sequential games are games where players take turns and move consecutively . Checkers , chess , and go are all good examples of sequential games . One player observes the move ofthe other player and then makes their play and so on . Games can also be single shot or repeated . games are played once , and then the game is over . Repeated games are simultaneous move games played repeatedly by the same players . A shot game might be a game of rock , paper , scissors played once to determine who gets to sit in the front seat of a car . A repeated game might be repeated plays of rock , paper , scissors , with the first player to win five times getting the right to sit in the front seat of a car . Games can become very complicated when all players do not know all the information about the game . For the purposes of this chapter , we will assume common knowledge . Common knowledge is when the players know all about the players , the strategies , and the know that the other players know , that the other players know that they know , and so on ad . In simpler terms , all participants know everything . 172 SINGLE PLAY GAMES Learning Objective Describe normal form games , and identify optimal strategies and equilibrium outcomes in such games . The most basic of games is the simultaneous , single play game . We can represent such a game with a payoff matrix a table that lists the players of the game , their strategies , and the payoffs associated with every possible strategy combination . We call games that can be represented with a payoff matrix normal form games . Let start with an example of a game between two friends , Lena and Sven , who are competing to be the top student in a class . They have a final exam approaching , and they are deciding whether they should be cooperative and share notes or be uncooperative and keep their notes to themselves . They wo see each other at the end of the day , so they each have to decide whether to leave notes for each other without knowing what the other one has done . If they both share notes , they both will get perfect scores . Their teacher gives a bonus to the top exam score , but only if there is one exam better than the rest , so if they both get top score , there is no bonus , and they both get 100 on their exams . If they both do share , they wo do as well , and they will both receive a 95 on their exams . However , if one shares and the other does , the one who shares will not benefit from the others notes and will only get a 90 , and the one who does share will benefit from the others notes and get the top score and the bonus for a score of 10 . All of these facts are expressed in the payoff matrix in table . Since this is a , game , it is a normal form game , and we can use a payoff matrix to describe it . There are two players Lena and Sven . There are two strategies available to each player . We will assume common both know all this information about the game , and they know that the other knows it , and they know that the other knows that they know it , and so on .

394 PATRICK EMERSON Table The valedictorian ame Note Strategy Sven Payoff Lena Payoff Sven shares Lena shares Neither share Both share The payoff matrix offers a complete description of the game because it lists the three elements players , strategies , and payoffs . It is now time to think about individual strategy choices . We will start by examining the difference between dominant and dominated strategies . A dominant strategy is a strategy for which the payoffs are always greater than any other strategy no matter what the opponent does . A dominated strategy is a strategy for which the payoffs are always lower than any other strategy no matter what the opponent does . Predicting behavior in games is achieved by understanding each rational player optimal strategy , the one that leads to the highest payoff . Sometimes the optimal strategy depends on the strategy choice , but in the case ofa dominant strategy , it does not , and so it follows that a rational player will always play a dominant strategy if one is available to them . It also follows that a rational player will never play a dominated strategy . So we now have ourfirst two principles that can , in certain games , lead to a prediction about the outcome . Let look at the Valedictorian game in table . Notice that for Lena , she gets a higher payoff if she does share her notes no matter what Sven does . If Sven shares his notes , she gets 110 if she share rather than 100 if she does . If Sven does share his notes , she gets 95 if she does share and 90 if she does . It makes sense then that she will never share her notes . Do share is a dominant strategy , so she will play it . Share is a dominated strategy , so she will not play it . The same is true for Sven , as the payoffs in this game happen to be completely symmetrical , though they need not be in games . We can predict that both players will choose to play their dominant strategies and that the outcome of the game will be do share , do chooses do share , and Sven chooses do they both get 95 . This outcome is known as a dominant strategy equilibrium ( an equilibrium where each player plays their dominant strategy . This is a very intuitive equilibrium concept and is the one used in situations where all players have a dominant strategy . Unfortunately , many , or even most , games do not have the feature that every player has a dominant strategy . Let examine the in this game . The most striking feature of this outcome is that there is another outcome that both players would ily switch to share , share . This outcome delivers 100 to each player and is therefore more efficient in the is another outcome where you could make one person better off without hurting anyone else . Games with this feature are known as prisoner dilemma name comes from a classic game of cops and robbers , but the general usage is for games that have this feature . Why do we get this suboptimal result ?

It comes from the fact that each agent is purely all they care about is maximizing their own payoffs , and if they think the other player is going to play share , their best play is to not share . What is particularly interesting about this result is that it overturns the first welfare theorem of economics that says that a competitive equilibrium is efficient . The difference is the strategic nature of the interactions in the game . Here we have much of the same of a competitive market , but because of the strategic nature of the game , one player actions affect the other players payoffs .

GAME THEORY 395 What if a game lacked dominant strategies ?

Let go back to the example of the last section where you are thinking about which party to attend because you want to meet up with friends . Let simplify the example by saying that there are two friends , and Caitlin , who both have been invited to two ties , one sponsored by the college international club and another sponsored by the college debate club . Neither of them has a particular preference about which party they want to go to , but they definitely want to see each other and so want to end up at the same party . They talked earlier in the week , so they know that each is considering the two parties and how much each of them likes the two parties , so there is common knowledge . The problem is that Caitlin mobile phone battery has run out of charge , and they ca communicate . When asked how much they would enjoy the parties , Caitlin and gave similar answers , and we will represent them as payoffs in the payoff matrix in table . Table The part Caitlin Debate ( This matrix shows Caitlin strategies on the left in a column and strategies in a row on top . Each of them has exactly two strategies international club and debate club . For each , their payoffs are shown in the boxes that correspond to each strategy pair . For example , in the boxes for international club , the payoffs are 10 and 10 . The first payoff corresponds to Caitlin , and the second corresponds to . We now have to determine each player best response function one player optimal strategy choice for every possible strategy choice of the other player . For Caitlin , her best response function is the lowing ame , version International Club ( IC ) Debate Club ( Play IC if plays IC . Play if plays . For , her best response function looks similar Play IC if Caitlin plays IC . Play if Caitlin plays . Since the best response changes for both players depending on the strategy choice ofthe other player , we know immediately that neither one has a dominant strategy . What then ?

How do we think about the outcome ofthe game ?

The solution concept most commonly used in game theory is the Nash equilibrium concept . A Nash equilibrium is an outcome where , given the strategy choices of the other players , no individual player can obtain a higher payoff by altering their strategy choice . An equivalent way to think about Nash equilibrium is that it is an outcome of a game where all players are simultaneously playing a best response to the others strategy choices . The equilibrium is intuitive if , when placed in a certain outcome , no player wishes to unilaterally deviate from it , which means equilibrium is are no forces within the game that would cause the outcome to change . In the party game above , there are two outcomes where the best responses correspond both players choosing IC and both players choosing . If Caitlin shows up at the international club party and finds there , she will not want to leave there and go to the debate club party . Similarly , if shows up at the international club party and finds Caitlin there , she will not want to leave Caitlin there and go to the debate club party . So the outcome ( IC , describes Caitlin choice and a Nash equilibrium . The outcome ( is also a Nash equilibrium for the same reason .

396 PATRICK EMERSON This example illustrates the strengths and weaknesses of the Nash equilibrium concept . intuitively , if they show up at the same party , both women would be content , and neither one would want to leave to the other party if the other is staying . However , there is nothing in the Nash equilibrium concept that gives us guidance as to predicting at which party the women will end up . In general , a normal form game can have zero , one , or multiple Nash . Consider this different version of the party game , where Caitlin really does want to go to the club party , so much so that she prefers attending the debate club party without to attending the international club party with . Table The pan ame , version Caitlin Debate Club ( Now is a dominant strategy for Caitlin . knows Caitlin does not like the international club party and will correctly surmise that she will attend the debate club party no matter what . So both Caitlin and will go to the debate club party , and ( is the only Nash equilibrium . In this case , the Nash equilibrium concept is satisfying it gives a clear prediction of the unique outcome of the game and makes sense . Another possibility is a game that has no Nash equilibrium . Consider the game matching pennies . In this game , two players , Ahmed and , each have a penny . They decide which side of the penny to have facing up and cover the penny until they are both revealed simultaneously . By agreement , if the pennies match , Ahmed gets to keep both , and if the two pennies do match , keeps both . The players , strategies , and payoffs are given in the payoff matrix in table . International Club ( IC ) Debate Club ( Table The ame Ahmed Play Play Heads Tails , Heads Heads Tails Tails Tails Heads , Ahmed best response function is to play heads if plays heads and to play tails if plays tails . best response is to play tails if Ahmed plays heads and to play heads plays tails . As you can clearly see , there is no correspondence of best response functions , no outcome of the game in which a player would want to unilaterally , and thus no Nash equilibrium . The outcome of this game is unpredictable , and no outcome creates contentment for both players . Finding the Nash equilibrium in normal form games is made relatively easy by following a simple that identifies the best response functions on the payoff matrix itself . To do so , simply underline the maximum payoff for a given opponent strategy . Consider the example below .

GAME THEORY 397 Table The location ame , version 65 , 44 29 , 38 44 , 29 53 35 , 31 19 , 56 30 , 57 41 , 63 72 , 27 For Chris , if Pat plays left , the maximum payoff is 65 , which comes from playing up , so let underline 65 . If Pat plays left , Chris should play up . Moving along the columns , we find that Chris should play down i Pat plays center , and Chris should play down again if Pat plays right . Switching perspective , if Chris plays up , Pat gets a maximum payoff from playing left , so we underline Pat payoff , 44 , in that box . Continuing on , if Chris plays middle , Pat should play right , and if Chris plays down , Pat should play center . So now that we have identified each player best response functions , all that remains is to look for outcomes where the best response functions correspond . Such outcomes are those where both payoffs are underlined . In this game , the two Nash are ( up , left ) and ( down , center ) If we change the payoffs in the game to what is shown below , notice that each player has a dominant strategy , as seen by the three underlines all in the row Down for Chris and three underlines all in the column Center for Pat . Down is always the best strategy choice for Chris no matter what Pat chooses , and center is always the right strategic choice for Pat no matter what Chris chooses . Table The location ame , version 30 , 41 29 , 44 44 , 24 53 33 35 , 56 19 , 39 65 , 57 41 , 63 72 , 27 Note also that the dominant strategy equilibrium ( down , center ) also fulfills the requirements of a Nash equilibrium . This will always be true of dominant strategy all dominant strategy are Nash . From the example above , however , we know the reverse is not true not al Nash are dominant strategy . So dominant strategy are a of Nash , or to put it in another way , the Nash equilibrium is a more general concept than the dominant strategy equilibrium . Mixed Strategies So far we have concentrated on pure strategies where a player chooses a particular strategy with certainty . We now turn our attention to mixed strategies , where a player across gies according to a set of probabilities they choose . For an example of a mixed strategy , let return to the matching pennies game in table . As was noted before and as we can see by using the underline strategy to illustrate best responses , there is no Nash equilibrium of this game in pure strategies . What about mixed strategies ?

A mixed is a strategy itself for example , Ahmed might decide that he will play heads 75 percent of the time and tails 25 percent of the time . What is best response to this strategy ?

Well if plays tails with certainty , he will win 75 percent of the time . Ahmed best response to playing tails is to play tails with certainty , so Ahmed mixed strategy is not a Nash equilibrium strategy . How about 398 PATRICK EMERSON Ahmed choosing a mixed strategy of playing heads and tails , each with a 50 percent ping the this be a Nash equilibrium strategy ?

The answer is yes , which is evident when we think of best response to this mixed strategy . can play either heads or tails with certainty or the same mixed strategy with equal can expect to win half the time . We know that the pure strategies have the best responses as given in the matrix above , so only the mixed strategy is a Nash equilibrium . If Ahmed decides to flip his coin , best response is to flip his too . And if is flipping his coin , Ahmed best response is to do the same . So this game , which did not have a Nash equilibrium in pure strategies , does have a Nash equilibrium in mixed strategies . Both players randomize over their two strategy choices with probabilities and . SEQUENTIAL GAMES Learning Objective Describe sequential move games , and explain how they are solved . There are many situations where players ofa game move sequentially . Checkers is such a game one player moves , the other player observes the move and then responds with their own move , and so on . Sequential move games are games where players take turns making their strategic choices one player observes their opponent choice prior to making their own strategic choice . We describe these games by drawing a game tree , a diagram that describes the players , their turns , their choices at every turn , and the payoffs for every possible set of strategy choices . We have another name for this description of sequential games extensive form games . Consider a game where two Indian food carts located next to each other are competing for many of the same customers for their tikka masala . The first cart , called Ashok , opens first and sets its price the second cart , called , opens second and sets its price after observing the price set by Ashok . To keep it simple , let suppose there are three prices possible for both carts high , medium , low . The extensive form , or game tree , representation of this game is given in figure . The game tree describes all the principal elements of the game the players , the strategies , and the payoffs . The players are described at each decision node of the game , each place where a player might potentially have to choose a strategy . From each node , branches extend , representing the strategy choices of a player . At the end of the final set of branches are the payoffs for every possible outcome of the game . This is the complete description of the game . There are also within the full game . are all the subsequent strategy decisions that follow from one particular node .

GAME THEORY 399 Figure 77 . The curry pricing game In this game , Ashok is at the first decision node , so they get to move first . is at the second set of decision nodes , so they move second . How will the game resolve itself ?

To determine the outcome , it is necessary to use backward induction to start at the last play of the game and determine what the player with the last turn of the game will do in each situation and then , given this deduction , determine what the payer with the turn will do at that turn and continue this way until the first turn is reached . Using backward induction leads to the perfect Nash equilibrium of the game . The perfect Nash equilibrium ( is the solution in which every player , at every turn ofthe game , is playing an individually optimal strategy . For the curry pricing game illustrated in figure , the is found by first determining what will do for each possible play by Ashok . is only concerned with his payoffs in red and will play medium plays high and thus will get 410 , will play low plays medium and will get 360 , and will play low if Ashok plays low and will get 310 . Because of common knowledge , knows this as well and so has only three possible outcomes . Ashok knows that if they play high , will play medium , and Ashok will get 340 if they play medium , will play low , and Ashok will get

400 PATRICK EMERSON 210 and if they play low , will play low , and Ashok will get 320 . Since 340 is the best of the outcomes , Ashok will pick high . Since Ashok picks high , will pick medium , and the game ends . Backward induction will always lead to the of a sequential game . Credible and Threats Let consider a famous game where there is an established incumbent firm in a market and another entrepreneur who is thinking of entering the market and competing with the incumbent , who we will call the potential entrant . Suppose , for example , that there isjust one pizza restaurant in a commercial offa university campus that sells pizza slices to the students of the university , let call it Gino . Since they face no direct competition , they can sell a slice of pizza for , and they make 400 a day in revenue . But there is a pizza maker named Vito who is considering entering the market by setting up a pizza shop in an empty down the street from Gino . When facing the potential arrival of Vito pizza restaurant , Gino has two choices accommodate Vito by keeping prices higher ( say , or fighting Vito by selling his slices below cost in the hope of preventing Vito from opening . The game and the payoffs are given below in the normal form game in Table . In Table , we see that if we follow the underlining strategy to identify the best responses , this game has two Nash ( accommodate , enter ) and ( fight , do enter ) Note that for Gino , both accommodate and fight result in the same payoff if Vito chooses do enter , so we underline one is equally a best response . Table The market entry ame Vito ( Potential Entrant ) Accommodate 200 300 400 ( Fight 200 400 Table Nash equilibrium in the market Vito ( Potential Entrant ) Accommodate 200 300 ' Fight 200 But there is something unsatisfying about the second Nash this is a simultaneous game , both players are picking their strategies simultaneously . Thus Gino is picking fight if Vito does no enter , and so Vito best choice is not to enter . But would Vito really believe tha Gino would fight if he entered ?

Probably not . We call this a threat a strategic choice to dissuade a rival that is against the best interest of the player and therefore not rational . A better description of this game is therefore a sequential one , where Vito first chooses to open a pizza restaurant and Gino has to decide how to respond .

GAME THEORY 401 , 300 200 Vito Enter 400 Figure The sequential market entry game In this version of the game , if Vito decides not to enter , the game ends , and the payoffs are for Vito and 400 for Gino . If Vito decides to enter , then Gino can either fight and get or accommodate and get 200 . Clearly , the only individually rational thing for Gino to do if Vito enters is to accommodate , and since Vito knows this , he will enter .

402 PATRICK EMERSON , Gino 300 , 200 Vito Enter 400 Figure The market entry game The of this game is ( enter , accommodate ) What this version of the game does is eliminate the equilibrium based on a threat . Vito knows that if he decides to open up a pizza shop , it is irrational for Gino to fight because Gino will make himself worse off . Since Vito knows that Gino will accommodate , the best decision for Vito is to open his restaurant . REPEATED GAMES Learning Objective Describe repeated games and the difference between finitely repeated games and infinitely repeated games and their equilibrium . Any game can be played more than once to create a larger game . For example , the game rock , paper , scissors , where two players simultaneously use their hands to form the shape of a rock , a piece of paper , or scissors can be played just once or can be repeated multiple example , playing best of three , where the winner is the first player to win two rounds of the game . This is a normal form game in each round but a larger game when taken as a whole . This raises the possibility that a larger strategy could be example , one contingent on the choice of the opponent in the last round . Let return to the valedictorian game from section . Recall that this game was a prisoners dilemma because of individual incentives , they find themselves in a collectively suboptimal outcome . In other words , there is an outcome that they both prefer , but they fail to reach it because of the individual strategic incentive to try to do better for themselves . But if the same game was repeated more than once over the course of the school year , it is quite reasonable to ask if such repetition would lead the ers to a different outcome . If the players know they will face the same situation again , will they be more inclined to cooperate and reach a mutually beneficial outcome ?

GAME THEORY 403 Finitely Repeated Games If we played the valedictorian game twice , then the strategies for each player would entail their strategy choices for each round of the game . In other words , a strategy for a repeated game is the complete set of strategic choices for every round of the game . So let ask if playing the valedictorian game twice would alter the outcome in an individual round . Suppose , for example , the two talked before the game and acknowledged that they would both be better off cooperating and sharing . In the repeated game , is cooperation ever a Nash equilibrium strategy ?

To answer this question , we have to think about how to solve the game . Since this game is repeated a finite number of times , in our case two , it has a final round , and similar to a sequential game , the method of solving the game is through backward induction to find the perfect Nash . In repeated games , at each round , the subsequent games are a of the overall game . So in our case , the second and final round of the game is a . So to solve the game , we have to first think about the outcome of the final round . Well , this final play of the game is the simple normal form game we have already solved , a , simultaneous play game with one Nash equilibrium ( share , do share ) Now that we know what will happen in the final round of the game , we have to ask ourselves , What is the Nash equilibrium strategy in the first round of play ?

Since they both know that in the final round of play , the only outcome is for both to not share , they also know that there is no reason to share in the first round either . Why ?

Well , even if they agree to share , when push comes to shove , not sharing is ter individually , and since not sharing is going to happen in the final round anyway , there is no way to create an incentive to share in the first round through a final round punishment mechanism . In essence , after the last period is revealed to be a prisoner dilemma game , the period becomes a prisoner dilemma game as well because there is nothing in the last round that can alter the incentives in the round , so the game is identical . In fact , as long as there is a final round , it does matter how many times we repeat this game because of backward induction , it simply becomes a series of games with the Nash equilibrium gies being played every time . Infinitely Repeated Games Things change when normal form games are repeated infinitely because there is no final round , and thus backward induction does not work there is nowhere to work backward from . This aspect of the games allows space for reward and punishment strategies that might create incentives under which tion becomes a Nash equilibrium . To see this , let alter the scenario of our valedictorian game . Suppose that Lena and Sven are now adults in the workplace , and they work together in a company where their pay is based partly on their performance on a monthly aptitude test . For simplicity , we assume that their payoffs are the same as in the valedictorian game , but this time , they represent cash bonuses . The key here is that they foresee working together for as long as they can imagine . In other words , they each perceive the possibility that they will keep playing this game for an indeterminate amount is no determined last round of the game and therefore no way to use backward induction to solve it . Players have to look ahead to determine the optimal strategies . So what would a strategy to induce cooperation look like ?

Suppose Lena says to Sven , I will share with you as long as you share with me , but as soon as you do share , I will stop sharing with you 404 PATRICK EMERSON ever call this the cooperate strategy . Sven , in response , says , OK , I will do the same . I will share with you until such time as you do share , and then I stop sharing altogether . We must then ask , Is the act of both players playing these strategies a Nash equilibrium ?

To answer this question , we have to figure out the best response to the strategy Is it to play the same strategy , or is there a better strategy to play in response ?

To determine the answer to this question , think about playing the same strategy and alternate strategies and their payoffs . If Lena claims she will play the cooperate strategy , what is Sven outcome if he plays the cooperate strategy in response ?

Well , in the first period , Sven will get 100 because they both share , and since they both shared in period one , theywill both share in period two , and so Sven will get 100 , and it will continue like this forever . To put a value on future earnings , we discount , so Sven earnings stream ( the payoff from a cooperate strategy ) looks as follows What is the payoff from not cooperating ?

Well , in the period in which Sven decides not to share , Lena will still be sharing , and so Sven will get 110 , but then after that , Lena will not share , and Sven knows this , so he will not share as well , and he will therefore get 95 for every round after . Let call this strategy deviate . Thus his earning stream ( the payoff from a deviate strategy ) looks like the following Note that we are only comparing the two strategies from the moment Sven decides to deviate , as the two payoff streams are identical up to that point and therefore cancel themselves out . Is to cooperate the best response to the cooperate strategy ?

Yes , if Rearranging , we get ( 10 This says that cooperation is better as long as the extra five points a cooperating player gets for every subsequent period after the first is better than the extra ten the deviating player gets in the first period . To determine if this is true , we have to use the result that , or ( 10 10 ( 10 . You can think of as a measure of how much the players care about future payoffs , and so this says that as long as they care enough about the future payoffs , they will cooperate . In other words , then playing cooperate is a best response to the other player playing cooperate and vice versa the pair ( cooperate , cooperate ) is a Nash equilibrium for the infinitely repeated game . This type of strategy has a name in economics a trigger strategy . strategy is one where play continues until an opponent deviates and then ceases permanently or for a specified ber of periods . An alternate strategy is the strategy , where a player simply plays the same

GAME THEORY 405 strategy their opponent played in the previous round . strategies can also be a Nash , and in fact , in infinitely repeated games where there are often many Nash , the trigger strategy identified above isjust one of many . POLICY EXAMPLE DO WE NEED TO REGULATE BANKS TO SAVE THEM FROM THEMSELVES ?

Learning Objective Explain how game theory can be used to understand the banking collapse of 2008 . In the , banks in the United States found themselves struggling to satisfy a tremendous demand for mortgages from the market for securities securities that were created from bundles of residential or commercial mortgages . This , along with the rate policy of the Federal Reserve , led to a tremendous housing boom in the United States that evolved into a speculative investment bubble . The bursting of this bubble led to the housing market crash and , in 2008 , to a ing crisis the failure of major banking institutions and the unprecedented government bailout of banks . These twin crises led to the worst recession since the Great Depression . Interestingly , this banking crisis came relatively soon after a series of reforms of banking regulations in the United States that gave banks much more freedom in their operations . Most notably was the 1999 repeal of the provisions ofthe Act , enacted after the beginning of the Great Depression in 1933 , which prohibited commercial banks from engaging in investment activities . Part of the argument at the time of the repeal was that banks should be allowed to innovate and be more flexible , which would benefit consumers . The rationale was that increased competition and the discipline of the market would inhibit excessive , so stringent government regulation was no longer necessary . But the discipline of the market assumes that rewards are absolute , meaning that returns are not based on relative performance or that the environment is not strategic . Is this an rate description of modern banking ?

Probably not . In everything from stock prices to CEO pay , relative performance matters , and if one bank were to rely on a strategy while others were engaging in higher reward strategies , both the stock price and the compensation of the CEO might suffer . We can describe this in a very model where there are two banks , and they can engage in either or strategies . This scenario is described in table , where we have two players , Big Bank and Huge Bank the two gies for each and the payoffs ( in millions ) Table The risky Huge Bank 30 30 22 45 45 22 25 25 We can see from the normal form game that both banks have dominant strategies high risk . This is because the rewards are relative . Being a bank when your competitor is a bank brings a big reward the relatively high returns are compounded by the reward from the stock market . In the end , both banks end up choosing high risk and are in a worse outcome than if they had chosen a risk strategy because of the increased likelihood of negative events from the strategy . Astute observers will recognize this game as a prisoner dilemma , where behavior based on the individual of

406 PATRICK EMERSON the banks leads them to a outcome . If you include the cost to society of bailing out banks when they fail , the outcome is that much worse . Can policy correct the situation and lead to a mutually beneficial outcome ?

The answer in this case is a resounding yes . If policy makers take away the ability of the banks to engage in strategies , the bad equilibrium will disappear , and only the , outcome will remain . The banks are better off , and because the adverse effects of strategies going bad are taken away , society benefits as well . EXPLORING THE POLICY QUESTION . Why do you think that banks were so willing to engage in risky bets in the early ?

Do you think that government regulation restricting their strategy choices is appropriate in cases where society has to pay for risky bets gone bad ?

REVIEW TOPICS AND RELATED LEARNING OUTCOMES What Is Game Theory ?

Learning Objective Describe game theory and the types of situations it describes . Single Play Games Learning Objective Describe normal form games , and identify optimal strategies and equilibrium outcomes in such games . Sequential Games Learning Objective Describe sequential move games , and explain how they are solved . Repeated Games Learning Objective Describe repeated games and the difference between finitely repeated games and infinitely repeated games and their equilibrium , Policy Example Do We Need to Regulate Banks to Save Them from Themselves ?

Learning Objective Explain how game theory can be used to understand the banking collapse of 2008 , GAME THEORY 407 LEARN KEY TOPICS Terms Strategic interactions Interactions in which agents must anticipate the actions of others when making decisions . Game theory is to model them . Game theory The study of strategic interactions among economic agents . Any complete description of a game must include the following three elements Players The agents actively participating in a game and who will experience outcomes based on the play of all players . Strategies All the possible strategic choices available to each player can be the same for all players , the same for some players , or different for each player . Payoffs The outcomes associated with every possible strategic combination between players . games Games in which the players are not able to negotiate and make binding agreements within the game , most competitive sports . Simultaneous games Games in which players take strategic actions at the same time without knowing what move the other has chosen , tag , rock paper scissors , strategy games . Sequential games Games where players take turns and move consecutively , checkers , chess , a . games Games that are played once and then are over , rock paper scissors to determine who gets to sit in the front seat of the car . Repeated games move games played repeatedly by the same players , rock paper scissors , best out of five . Common knowledge All participants are aware of all components in a game , and are also aware that all participants are aware . Payoff matrix A table that lists the players of the game , their strategies , and the payoffs associated with every possible strategy combination . Normal form games Games that can be represented with a payoff matrix . Dominant strategy A strategy for which the payoffs are always greater than any other strategy no matter what the opponent does . Dominated A strategy for which the payoffs are always lower than any other strategy no matter what the opponent does . Dominant strategy equilibrium ( An equilibrium in which each player plays their dominant strategy . Best response function A player optimal strategy choice for every possible strategy choice of the other player . Nash equilibrium

408 PATRICK EMERSON An outcome where , given the strategy choices of the other players , no individual player can obtain a higher payoff by altering their strategy choice . Pure strategies A strategy a player selects with complete certainty . Mixed strategies A player strategies according to a set of probabilities that they choose . Sequential move games Games where players take turns making their strategic choices . Generally modeled by a game tree . Game tree A diagram that describes the players , their turns , their potential strategies for each turn , and the payoffs for every possible set of . Extensive form games Another name for sequential move games . perfect Nash equilibrium ( The solution in which every player , at every turn of game , is playing an individually optimal strategy . Trigger strategy A strategy where cooperative play continues until an opponent deviates and then ceases permanently or for a number of period . In infinitely repeated games , where there are often many Nash , the trigger strategy isjust one of many . strategy A player simply plays the same strategy their opponent played in the previous be considered a Nash equilibrium . Tables and Figures The valedictorian game The valedictorian arne Lena Payoff Sven Payoff Note Strategy Sven shares Lena sha res Neither share Both share The party game , version Figure The part ame , version International Club ( IC ) Debate Club ( International Club ( IC ) 10 10 Debate Club ( The party game , version

GAME THEORY 409 Figure The pa International Club ( Caitlin Debate Club ( The matching pennies game ame , version International Club ( It ) Debate Club ( Table The ame Ahmed Play Play Heads Tails ' Heads Heads Tails Taxis Heads ' The curry pricing game High 400 , 380 Figure The curry pricing game The market entry game

410 PATRICK EMERSON Nash In the market , Accommodate ( Incumbent ) Fight The sequential market entry game Vito ( Entrant ) 200 , 100 , 300 , 200 Vito Don Enter 400 Figure The marker GAME THEORY 411 , Gino 300 , 200 Vito Don Enter , 400 Figure 773 The market entry game The risky banking game Table The risky ame Payoff from a cooperate strategy Payoff from a deviate strategy Huge Bank 30 303 22 45 45 223 25 25 Equations Comparing the Two Is to cooperate the best response to the cooperate strategy ?

Yes , if Which can be rearranged into ( 10 412 PATRICK EMERSON When applied to the valedictorian game , the equation says cooperation is better that as long as the extra points a cooperating player gets for every subsequent period after the first is better than the extra ten the deviating player gets in the first period . We can test that with the lowing equation Thus ( 100 10 ( 10 The variable can be thought of as a measure of how much the players care about future payoffs . With , we can assume that the players will cooperate due to their concern over future outcomes .