{"id":1115,"date":"2023-06-01T02:08:47","date_gmt":"2023-05-31T17:08:47","guid":{"rendered":"https:\/\/saraheee.com\/?p=1115"},"modified":"2023-06-01T02:57:25","modified_gmt":"2023-05-31T17:57:25","slug":"game-theory-7-chap09-finitely-repeated-game","status":"publish","type":"post","link":"https:\/\/saraheee.com\/ko\/2023\/06\/game-theory-7-chap09-finitely-repeated-game\/","title":{"rendered":"Game Theory 7 \u2013 chap09. Finitely repeated game"},"content":{"rendered":"<p>3. Extensive Form Games<br>3.6 Repeated Games and Reputation (Chapter 22)<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Repeated Interactions<\/h3>\n\n\n\n<p>In many applications, players face the same interaction <em>repeatedly<\/em><\/p>\n\n\n\n<p><mark style=\"background-color:var(--global-color-10)\" class=\"has-inline-color\">Question<\/mark>: How does this affect our predictions of play?<\/p>\n\n\n\n<p><em>Repeated games<\/em> provide a framework for studying <strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-8-color\">long-term relationships<\/mark><\/strong><\/p>\n\n\n\n<p>Suppose that two players play the following normal-form game once:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>1 \\ 2<\/td><td>X<\/td><td>Y<\/td><td>Z<\/td><\/tr><tr><td>A<\/td><td>4, 3<\/td><td>0, 0<\/td><td>1, 4<\/td><\/tr><tr><td>B<\/td><td>0, 0<\/td><td>2, 1<\/td><td>0, 0<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-15-color\">At X, player 1&#8217;s Best Response is A, the BR in Y is B, the BR in Z is A<br>At A, player 2&#8217;s Best Response is Z, the BR in B is Y<\/mark><\/p>\n\n\n\n<p><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-15-color\">pure strategy Nash Equilibrium: (A, Z), (B, Y)<\/mark><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>What if the players interact over two periods?<br>Each player has total 7 information sets (one set in period 1 + six sets in period 2)<br>For this reason, a player strategy in repeated games is <strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-8-color\">history-dependent<\/mark><\/strong><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>We look for a pure-strategy SPE of this repeated game<\/p>\n\n\n\n<p>* SPE(Subgame Perfect Equilibrium)<\/p>\n\n\n\n<p>To this end, recall that SPE requires NE plays in every subgame. Therefore, for a strategy profile s* to be a SPE, (A, Z) or (B, Y) must be played at least in period 2 <em>regardless of the previous history<\/em>.<\/p>\n\n\n\n<p>The problem of identifying SPE then boils down to<\/p>\n\n\n\n<p>(1) what actions the players choose in period 1;<br>(2) whether or not choices in period l can influence their play in period 2<\/p>\n\n\n\n<p>Putting aside (2) for a moment, we can easily find the next 4 SPE:<\/p>\n\n\n\n<p>{((A, Z), (A, Z)), ((A, Z),(B, Y)), ((B, Y),(A, Z)), (B, Y),(B, Y))}<\/p>\n\n\n\n<p>More generally, we have<\/p>\n\n\n\n<p><mark style=\"background-color:var(--global-color-10)\" class=\"has-inline-color\">THEOREM 3.6<\/mark>. Consider any repeated games. Any sequence of stage-Nash profiles is supported as the outcome of a subgame perfect equilibrium.<\/p>\n\n\n\n<p>We look for a pure-strategy SPE of this repeated game<\/p>\n\n\n\n<p>To this end, recall that SPE requires NE plays in every subgame. Therefore, for a strategy profile s* to be a SPE, (A, Z) or (B, Y) must be played at least in period 2 <em>regardless of the previous history.<\/em><\/p>\n\n\n\n<p>The problem of identifying SPE then boils down to<\/p>\n\n\n\n<p>(1) what actions the players choose in period 1;<br>(2) whether or not choices in period 1 can influence their play in period 2<\/p>\n\n\n\n<p>Taking into account (2), we can <em>enlarge the set of SPE outcomes<\/em>. To see this, let&#8217;s consider the following strategy profile:<\/p>\n\n\n\n<p>Play (A, <strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-8-color\">X<\/mark><\/strong>)) in period 1. If no one deviated, play (A, Z) in period 2. If someone deviated, then play (B, Y) in period 2.<\/p>\n\n\n\n<p><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-15-color\">(A, X) is a highest payoff to player 1, second highest payoff to player 2<\/mark><\/p>\n\n\n\n<p>To demonstrate that this is another SPE, we have to check the players&#8217; incentives<\/p>\n\n\n\n<p>For player 1, <mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-15-color\">4 + 1 &gt; 0 + 2<br>((A, X), (A, Z) &gt; (B, X), (B, Y)), payoff is smaller when debated, making this deviation non-profitable<\/mark><\/p>\n\n\n\n<p>For player 2, <mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-15-color\">3 + 4 &gt; 4 + 1<br>((A, X), (A, Z) &gt; (A, Z), (B, Y)), No incentive to deviate<\/mark><\/p>\n\n\n\n<p><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-15-color\">Ensuring that there is no incentive to deviate<\/mark><\/p>\n\n\n\n<p>By relating the second-period actions to past outcomes, even <em>non-stage-Nash profiles<\/em> can be supported as a SPE<\/p>\n\n\n\n<p><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-8-color\">Intuition<\/mark><\/strong> behind the strategy above:<\/p>\n\n\n\n<p>By playing X, P2 can build a <em>reputation<\/em> for cooperating and is rewarded in period 2<br>By deviating, P2 is branded a &#8220;cheater&#8221; and is punished in period 2<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Repeated Prisoners&#8217; Dilemma<\/h3>\n\n\n\n<p>Suppose that two players play the following stage game twice<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>1 \\ 2<\/td><td>C<\/td><td>D<\/td><\/tr><tr><td>C<\/td><td>2, 2<\/td><td>0, 3<\/td><\/tr><tr><td>D<\/td><td>3, 0<\/td><td>1, 1<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>In contrast with the previous example, the stage game has a <strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-8-color\">unique NE<\/mark><\/strong>: (D, D)<br>In period 2, (D, D) must be played regardless of the outcome in the 1st period<br>Choices in period 1 <strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-global-color-8-color\">cannot influence payoffs in period 2<\/mark><\/strong><br>Backward induction implies that both players choose D in period 1<br>Therefore, the unique SPE is that both players <em>always<\/em> play action D<\/p>\n\n\n\n<p><mark style=\"background-color:var(--global-color-10)\" class=\"has-inline-color\">EXAMPLE 3.20 (EXERCISE 4 ON PAGE 308)<\/mark>. If its stage game has exactly one Nash equilibrium, how many subgame perfect equilibria does a two-period, repeated game have? Explain. Would your answer change if there were T periods, where T is any finite integer?<\/p>\n\n\n\n<p><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Reference: Chang-Koo Chi, (25\/50) Game Theory and Applications 7 \u2013 Finitely repeated games, Jul 8, 2020,&nbsp;<a href=\"https:\/\/youtu.be\/GF96ScVGZWk\" rel=\"noopener\">https:\/\/youtu.be\/GF96ScVGZWk<\/a><\/li>\n<\/ul>\n\n\n\n<p><\/p>","protected":false},"excerpt":{"rendered":"<p>Learn about an example of finding a pure-strategy SPE to find the best response of repeated interactions. We will also explore the prisoners&#8217; dilemma for unique NEs.<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[61,4,50,51,62,63],"class_list":["post-1115","post","type-post","status-publish","format-standard","hentry","category-game-theory-and-applications","tag-finitely","tag-game-theory","tag-jun-1-2023","tag-repeated-game","tag-repeated-interactions","tag-repeated-prisoners-dilemma"],"_links":{"self":[{"href":"https:\/\/saraheee.com\/ko\/wp-json\/wp\/v2\/posts\/1115"}],"collection":[{"href":"https:\/\/saraheee.com\/ko\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/saraheee.com\/ko\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/saraheee.com\/ko\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/saraheee.com\/ko\/wp-json\/wp\/v2\/comments?post=1115"}],"version-history":[{"count":10,"href":"https:\/\/saraheee.com\/ko\/wp-json\/wp\/v2\/posts\/1115\/revisions"}],"predecessor-version":[{"id":1132,"href":"https:\/\/saraheee.com\/ko\/wp-json\/wp\/v2\/posts\/1115\/revisions\/1132"}],"wp:attachment":[{"href":"https:\/\/saraheee.com\/ko\/wp-json\/wp\/v2\/media?parent=1115"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/saraheee.com\/ko\/wp-json\/wp\/v2\/categories?post=1115"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/saraheee.com\/ko\/wp-json\/wp\/v2\/tags?post=1115"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}