#### Abstract

In many strategic settings comparing the payoffs obtained by players under full cooperation to those obtainable at a sequential (Stackelberg) equilibrium can be crucial to determine the outcome of the game. This happens, for instance, in repeated games in which players can break cooperation by acting sequentially, as well as in merger games in which firms are allowed to sequence their actions. Despite the relevance of these and other applications, no full-fledged comparisons between collusive and sequential payoffs have been performed so far. In this paper we show that even in symmetric duopoly games the ranking of cooperative and sequential payoffs can be extremely variable, particularly when the usual linear demand assumption is relaxed. Not surprisingly, the degree of strategic complementarity and substitutability of players’ actions (and, hence, the slope of their best replies) appears decisive to determine the ranking of collusive and sequential payoffs. Some applications to endogenous timing are discussed.

#### 1. Introduction

Standard game-theoretic settings dealing with the emergence of cooperation usually weight the stream of players’ payoffs colluding a finite or infinite number of periods to those obtained by defecting one period and then playing simultaneously *à la* Nash (noncooperatively) afterward. The possibility that players defect from the collusive outcome as leaders or followers in every stage game is usually not considered. An exception to this approach is contained, for instance, in Mouraviev and Rey [1], who study the role of price (or quantity) leadership in facilitating firm collusion in an infinitely repeated setting. They show that, under price competition and, to a much lesser extent, under quantity competition, the possibility that players sequence their actions in every stage may help to sustain collusion. This happens because the presence of a deviating leader makes it easy for the follower to punish such defection.

In general, the focus on the link between timing and collusion is not entirely new within the economic literature. For instance, in some classical contributions on cartels and mergers under oligopoly, colluding firms are assumed to act as Stackelberg leaders [2–6]. Moreover, a few recent papers on mergers and R&D agreements consider different timing structures, where groups of firms can either act as leaders or followers (e.g., [7–10]). In these and other potentially interesting economic applications, it is crucial to compare the payoff under collusion to those under noncooperative sequential play to determine the outcome of the game.

While the literature comparing leader and follower’s (as well as simultaneous Nash) payoffs has a long-standing tradition (see [11, 12] or [13] for references), the number of papers that compares collusive and sequential outcomes even in a simple duopoly framework appears, at the best, scant. If, on the one hand, it has been proved that in regular symmetric duopoly games with single-valued best-replies and monotone payoffs on rivals’ actions (denoted * monotone spillovers*), when actions are *strategic complements,* the follower’s payoff dominates which of the leader and the opposite holds under *strategic substitutes* (e.g., [13–15]. In particular, by relaxing the assumption of complements or substitutes actions, [13] proves that either the leader’s payoff dominates that of the follower (which is also dominated by the simultaneous Nash) or, in turn, is dominated by the follower’s. Dowrick [16], Amir [17], Amir and Grilo [18], Amir et al. [15], Currarini and Marini [19, 20], and Von Stengel and Zamir [21] all present various leader-follower payoff comparisons between single players or coalitions. On the other hand, the relationship between fully cooperative and sequential payoffs has been scarcely explored. To the best of our knowledge, in an oligopoly setup with quantities acting as strategic substitutes, Levin [6, 22] has provided a comparison between prices, quantities, and social welfare in Cournot, Stackelberg, and monopoly equilibria. In a symmetric setting, Figuières et al. [23] have considered, in turn, symmetric conjectural, simultaneous Nash and Pareto-optimal interior equilibria. However, their model assumes symmetric conjectures for players, and, therefore, their main results do not apply to the analysis of a Stackelberg equilibrium, which is naturally asymmetric.

Our paper considers a class of symmetric duopoly games and shows that the ranking of cooperative and sequential payoffs can be extremely variable. In particular, when actions are *strategic substitutes* and * spillovers negative*, it is shown that, rather surprisingly, the leader can earn in some cases a higher profit than the equal-split cooperative (efficient) payoff, and this occurs, in particular, when players’ best replies are very (and negatively) sloped. This is because the leader can exploit in full her first-mover advantage when the follower strongly reduces his strategy in response. Exactly the reverse occurs in a game with *strategic substitutes* and *positive spillovers*. Here the leader can do better than under symmetric collusion when the follower is not very reactive. A similar but opposite reasoning applies to the case of *strategic complements*: with *negative spillovers*, equal-split cooperative payoffs are lower than follower’s payoff when best replies are very flat, and the opposite under *positive spillovers*. In this paper we also provide a taxonomy of all feasible ranking of payoffs and actions of players arising in simultaneous, sequential, and collusive equilibria when actions are either strategic complements or substitutes.

At the end of the paper we discuss some possible implications of our results. To this aim, we introduce an elementary endogenous timing game in which players can decide the timing of their cooperative or noncooperative strategies. Thus, we show that when binding agreements among players are allowed, intertemporal cooperation is in general more vulnerable to defection than cooperation occurring at just one stage.

The paper is organized as follows. The next section introduces the basic setup of the paper. Section 3 presents some results concerning players’ equilibrium strategies and payoffs. To understand the forces at work, some simple examples of price and quantity competition are briefly presented. Section 4 applies some of the paper results to the issue of endogenous intertemporal cooperation Section 5 concludes.

#### 2. The Setup

We assume two players with identical strategy sets and symmetric payoffs , that is, such that, for every profile , . We restrict payoffs to be either strictly positive or strictly negatively monotone on rival’s strategy. We talk, in turn, of *positive* (PS) and *negative spillovers* (NS). Moreover, players’ actions are defined *strategic complements* (*substitutes*) if and only if, for every and , the payoff exhibits increasing (decreasing) differences in , that is, () for every with . It is well known that, with smooth players’ payoffs, increasing (decreasing) differences hold if and only if [24]. We will assume, in what follows, strictly increasing or strictly decreasing differences of players’ payoffs, which, in turn, imply strictly increasing or strictly decreasing players’ best-replies.

We can now define the behaviour of players in the different scenarios. Under perfect collusion, players are assumed to set cooperatively their strategy profile
where, for every th player,
The above formulation implies that the two players possess transferable utilities. No side payments are explicitly allowed and, therefore, payoff allocation only depends on the strategies played by the two players at the (efficient) profile (1). In the following analysis we will assume a *symmetric* cooperative solution, namely, and, therefore, . We show in Appendix that, for a large class of games (such as games with strict quasiconcave payoff functions and convex strategy sets), the cooperative solution is symmetric. (See also [25, 26].) Depending on the model applications such solution can be interpreted, in turn, as the formation of a merger (or a cartel), or as tacit collusion. When players are assumed to move simultaneously and noncooperatively, they play *à la* Nash, and the equilibrium strategy profile is
where, for every and
By symmetry, if the Nash equilibrium of the duopoly game is unique, it must be symmetric: . Finally, when players act sequentially, we assume that the relevant equilibrium concept is the Stackelberg (subgame perfect Nash) equilibrium, that is, the profile
where, for the leader (henceforth player )
and, for the follower (henceforth player ), such that
Note that if players’ payoffs are continuous and strictly quasiconcave, best replies are continuous and single valued. In addition, if players’ strategy sets are compact and convex, Brower’s fixed-point theorem ensures the existence of a Nash equilibrium of the simultaneous move game. The existence of a Stackelberg equilibrium requires both the continuity of the leader’s payoff on her action as well as a follower’s continuous best reply, implying that the leader faces a continuous maximization problem over a compact set. In turn, the existence of the cooperative equilibrium does not pose particular problems when players’ payoffs are continuous and strategy sets compact. The uniqueness of equilibria (1)–(5) is, in general, a more demanding property. When not specifically stated differently, we will assume it.

#### 3. Main Results

It is well known that, in symmetric duopoly games with monotone spillovers and single-valued best replies, if actions are strategic substitutes (and best-replies decreasing), players’ payoffs under equilibria ((3)–(5)) respect the following inequality:
where indicates a player’s payoff at the simultaneous Nash equilibrium (3), and and denote, respectively, the leader and the follower’s payoffs at the subgame perfect Nash (Stackelberg) equilibrium (5). Since we have assumed strictly increasing or strictly decreasing players’ best-replies and monotone spillovers, we can exclude the trivial interior equilibria in which and, therefore, . As a result, (8) becomes
When, conversely, players’ actions are strategic complements (and best-replies increasing), it is obtained that
This means that, when (9) holds, since all players prefer to lead and none to follow, in the endogenous timing game *à la* Hamilton and Slutsky [27]—known as *extensive form game with observable delay*—where two players declare simultaneously their intention to play *early* or *late* a given strategic game, there exists a unique pure subgame perfect Nash equilibrium in which players end up playing simultaneously. If, conversely, (10) holds, both sequential (Stackelberg) equilibria, with either order of play among players, are supported as subgame perfect Nash equilibrium of the extended game.

In what follows, some of the results presented do not strictly require the monotonicity of players’ best-replies (implied, in turn, by the property of increasing or decreasing differences of players’ payoffs). However, for simplicity, our main results are characterized for two well-known classes of duopoly games in which actions are, in turn, strategic complements and substitutes. The first result is rather trivial, and it is simply based on (8)–(10) and on the Pareto-efficiency of the symmetric collusive outcome.

Proposition 1. *In all symmetric duopoly games in which players’ actions are strategic complements (substitutes), the symmetric collusive payoff of every player must be higher than leader’s (follower’s) equilibrium payoff at the sequential game, namely, .*

*Proof. *Suppose by contradiction that, if duopoly game actions are strategic complements, . By (10), and using symmetry, , contradicting the efficiency of the cooperative strategy profile . The same occurs when actions are strategic substitutes and .

Corollary 2. *In all symmetric duopoly games in which players’ actions are strategic complements (substitutes), the following payoff ranking arises: ().*

*Proof. *This is obtained by combining symmetry, the results of Proposition 1, and the efficiency of the cooperative allocation.

However, to obtain a complete ranking of players’ payoffs, it remains to be ascertained if, in turn, or for actions that are strategic complements and or for actions that are strategic substitutes. As a first step we focus our attention on games with strategic complements.

##### 3.1. Games with Strategic Complements

We present here some results on the relationship between players’ equilibrium strategies and their payoffs when actions are strategic complements. The next result provides a sufficient condition for the follower’s payoff to overcome the symmetric collusive payoff.

Proposition 3. *In all symmetric duopoly games with strategic complements and negative (NS) (positive (PS)) spillovers, if at the Stackelberg equilibrium the leader plays a strategy that is lower (higher) than that played under collusion, namely, , the following payoff ranking arises: .*

*Proof. *If, at the Stackelberg equilibrium, player ( as leader plays a strategy such as (under NS) and (under PS), thus, for the follower
where the first inequality stems from the Nash property of best-reply and the second from the property of monotone spillovers and the fact that under NS and under PS. Thus, by symmetry, and and, by Proposition 1, it follows that . Example 4 below shows that the condition is only sufficient and, by no means, necessary for the result. Figures 1 and 2 illustrate the two cases of proposition under NS and PS.

*Example 4 (Cournot with strategic complements). *Let two firms face an inverse demand function , where and , and, for simplicity, production costs set to zero. Every firm payoff is , , and it is easy to see that spillovers are negative and quantities act as strategic complements, yielding increasing best replies. Simple computations show that the equilibrium quantities are, respectively, , , , and . Equilibrium payoffs are, , , and . It is straightforward to see that, for , and . Figure 4 illustrates this case. For , there is a switch in the ranking of payoffs and . Note that, for , firm’s best replies are not contraction and, for this range of parameters, a simultaneous (Cournot) pure strategy Nash equilibrium does not exist. However, since and , holds for any level of . This proves that the condition of Proposition 3 is only sufficient and not necessary for inequality to arise. This is illustrated in Figure 4. As in the standard Cournot duopoly, lower isoprofit curves for firm 1 (or isoprofit curves more on the left for firm 2) correspond to higher profit levels.

The next proposition illustrates the relation between leader’s and follower’s strategy at any Stackelberg equilibrium in which the follower obtains a higher payoff than under collusion. Together with Proposition 3, it helps to see that, when strategies are complements (and best-replies increasing), a Stackelberg equilibrium always lies below the 45-degree line under negative externalities and above the 45-degree line under positive spillovers (see Figures 2, 3, and 4).

Proposition 5. *In all symmetric duopoly games with strategic complements, if the follower’s payoff at the Stackelberg equilibrium is higher than the payoff obtained at the symmetric cooperative equilibrium, namely, , the strategy level of the follower is higher (lower) than the leader’s under negative (positive) externalities, namely, under NS and under PS, where .*

*Proof. *Assume that under NS and under PS. Thus,
where the first inequality is due to monotone spillovers and the second to the fact that . Since by symmetry for any strategy profile in which ,
which contradicts the efficiency of .

The next proposition characterizes instead the order of strategies in the standard case in which the collusive agreement yields a higher payoff for a player than playing as a follower the sequential game. Again, to make things simple, we assume that Stackelberg and simultaneous Nash equilibrium differ, that is, .

Proposition 6. *In all symmetric duopoly games with strategic complements, if the symmetric collusive payoff is at least as high as the follower’s payoff at the Stackelberg equilibrium; namely, , the following ranking between equilibrium strategies arises: under NS and under PS, where , for and .*

*Proof. *The fact that under negative spillovers (NS) and under positive spillovers (PS) whenever is directly implied by Proposition 3. The remaining inequalities are standard (see, for instance, Amir et al., [28]): taking player in the role of leader,
where the first inequality is due to the fact that and the second by the Nash property of . Thus, (14) directly implies that under NS and under PS. Given that players’ actions are strategic complements (and best-replies increasing), it also follows that under NS and under PS, since both Stackelberg and simultaneous Nash profiles lie along the increasing follower’s best reply. Finally, since the simultaneous Nash equilibrium is symmetric and lies on the 45-degree line, the latter inequalities ( under NS and under PS) forcefully imply that lies above the 45-degree line under NS and below this line under PS. Hence, under NS and under PS, and this concludes the proof.

So far, we have shown that, in duopoly games with strategic complements, two main strategy-payoff equilibrium combinations are possible in the nontrivial case in which .

Proposition 7. *In all symmetric duopoly games with strategic complements (i) under negative spillovers (NS), if , both payoff rankings may arise as follows: or , while, for , it follows that . (ii) Under positive spillovers (PS), if both payoff-rankings or may arise, while if , the only possible payoff ranking is .*

*Proof. *It follows straightforwardly by Corollary 2 and Propositions 1, 3, and 5.

However, as the next example illustrates, in duopoly games with strategic complements (as, for instance, the classical price duopoly game), the case in which the follower’s payoff overcomes the collusive payoff remains a rather unusual event. When the follower’s best reply is a contraction, it is unlikely that the leader’s equilibrium strategy is so low (high) under NS (PS) for the follower to overcome the symmetric collusive payoff. To obtain this, the (increasing) best replies have to be very flat under NS (see Example 4) and very steep under PS.

*Example 8 (Bertrand with differentiated products and strategic complements). *Let firm ’s () market demand be , where and denote the prices charged by the two firms. Let also , , and let production costs be normalized to zero for both firms. Payoffs are, therefore, simply given by . Note that, for , these payoffs exhibit increasing differences and best replies are increasing (prices act as strategic complements). Externalities are positive. When the game is played simultaneously and noncooperatively, the equilibrium payoffs are , while, when the game is played sequentially, the leader obtains
for
and the follower
for
Finally, when the two firms decide to merge and act as a monopolist, every firm obtains
Simple calculations show that, for all reasonable values of the parameters, the typical payoff ranking is. Moreover, the following ranking of players’ actions (prices) obtains . Figure 5 depicts this case for and . No substantial modifications of the above rankings are obtained by manipulating parameters of the model.

##### 3.2. Games with Strategic Substitutes

When players’ actions are strategic substitutes, it can be shown that there are only two possible rankings of equilibrium strategies and payoffs under either negative or positive externalities. These are characterized in the next proposition.

Proposition 9. *(i) In all symmetric duopoly games with strategic substitutes, the following rankings between equilibrium strategies can arise: either or under NS and or under PS, where , . (ii) Moreover, only two alternative payoff rankings are possible: either or .*

*Proof. *(i) Similarly to Proposition 6 we can write, for player acting as a leader,
where the first inequality stems from the fact that and the second from the property of the Nash equilibrium. Therefore, it follows that under NS and under PS. Moreover, since actions are strategic substitutes, under NS and under PS, given that both profiles and lie along the follower’s (decreasing) best reply. Thus, under NS and under PS. By the symmetry and monotonicity of players’ payoffs and by the efficiency of the cooperative strategy profile, we obtain also that under NS and under PS. We remain, therefore, with the following two inequalities: either or under NS, and or under PS. Both cases may arise. (ii) From Proposition 1 we know that when actions are strategic substitutes. Given that , it follows that only two rankings are possible: either or , as also the numerical example below illustrates.

*Example 10 (Cournot duopoly with strategic substitutes). *Let assume an inverse demand function given by , with , and zero production costs for both firms. The payoffs can be obtained as , for . For payoffs exhibit decreasing differences and, therefore, players best replies are decreasing. Spillovers are negative. When the game is played simultaneously *à la* Nash firms’ equilibrium payoffs are given by . When the game is played *à la* Stackelberg, the leader obtains and the follower , respectively. Finally, when the two firms collude, they obtain each . Simple computations show that for (linear or convex demand), , with the equal sign holding only for . Figure 6 depicts this relation among players’ payoffs. When, instead, (concave demand), the payoff ranking is the following: . Figure 7 illustrates this case. Figure 8 shows instead that the ranking arises when the inverse demand is strongly concave (which occurs for a very low ) and that the dominance of leader’s payoff over the collusive payoff may occur in both cases in which the follower’s strategy is either higher or lower than the collusive strategy.

#### 4. Endogenous Timing and Collusion

In order to check some of the potential consequences of our results, we introduce here a simple setting that extends Hamilton and Slutsky’s [27] endogenous timing game (known as *extended game with observable delay*) by including in this game the possibility for players to commit to full cooperation. The game runs as follows. At an initial stage players announce simultaneously their purpose to play *early* or *late* a duopoly game and their intention to cooperate or not with the rival. The rules of the game are rather simple: when *both* players announce their intention to cooperate, the agreement is binding and players collude at the selected time. Otherwise, they play independently with the timing as prescribed by their own announcement. This game basically requires the *unanimity* of players to cooperate. Note that there exist many real life examples in which the willingness of people to take a joint action and the timing of their action are highly complementary, as for example, friends deciding whether to spend or not a holiday together, firms deciding if signing or not a R&D agreement, and so on. Our aim here is to check for the existence of subgame perfect Nash equilibria (in pure strategies) (SNE) of such *cooperation-timing* duopoly game.

Formally, the game can be described as follows. We let, at a pre-play stage denoted , the two players announce simultaneously their intention to cooperate or not with the rival, as well as the timing they intend to play a given duopoly game. Every player’s announcement set , for and , can be defined as
where the first two announcements express collusive intentions, while the remaining two correspond to the usual (noncooperative) timing choices (*early*, *late*) of Hamilton and Slutsky’s [27] game. Players’ announcement space contains 16 different announcement profiles which, in turn, induce the following set of time-cooperation *configurations *:

Differently from Hamilton and Slutsky [27], here the two players are allowed to cooperate and form an alliance either at period or or across periods. Players are allowed to cooperate either during one period or across time, that is, sequencing their cooperative strategy over time. They are not allowed instead to cooperate twice, once in period 1 and once in period 2. We assume that in order to be signed, a binding agreement endowed with a specific timing requires the *unanimity* of all players. Formally, for , , and ,

The above rule prescribes that, if both players agree to cooperate, they can behave collusively in just one period or alternate their collusive strategy over time. However, if just one player disagrees on cooperation, both players end up playing independently in their own preferred time.

The notion used to define the stability of a given time configuration is simply the Nash equilibrium of the corresponding announcement profile.

*Definition 11 (Nash-stability). *A configuration is Nash-stable if and only if , with possessing the following property:
for any , for all and .

When a timing-configuration is Nash-stable, this implies, in turn, that the profile is a subgame perfect Nash equilibrium (SNE) of the extended game. The only warning is that, in the equilibrium path in which players decide cooperatively, they are assumed to behave as a single maximizing entity. Formally, when the announcement profile induces a collusive behavior, players are assumed to sign a binding agreement. A similar approach is taken in the so called endogenous coalition formation literature (see Ray and Vohra [29, 30], Yi [31], Ray [32], and Marini [33] for surveys.) The next proposition illustrates the main implications of our simple model.

Proposition 12. *The endogenous timing-cooperation game played by two symmetric players can give rise to the following cases: (i) under strategic complements, for , the set of stable configurations is given by*

*(ii) Under strategic complements, for ,*

*(iii) Under strategic substitutes, for ,*

*and (iv) under strategic substitutes, for ,*

*Proof. *(i) When players’ actions are strategic complements and , Proposition 1 proved that the following ranking between players’ payoffs:
Therefore, any cooperative announcement expressed by both players is a Nash equilibrium of the extended time-cooperation game for any , since no player can deviate profitably by announcing either or inducing, in turn, a duopoly played either simultaneously or sequentially. Therefore, all cooperative configurations or are supported as SNE of the extended game. The noncooperative sequential configuration is also a Nash equilibrium announcement, since, by deviating unilaterally, a player can only induce a noncooperative simultaneous play, obtaining, according to (29), a lower payoff. (ii) When , the cooperative configurations and are no longer Nash-stable since each player can profitably deviate as a follower by announcing . Both sequential noncooperative configurations can instead be supported as SNE, since full collusion (at time two) is in this case profitable only for the leader and not for the follower. (iii) When players’ actions are strategic substitutes and , by Proposition 1,
Here all cooperative agreements are Nash equilibrium announcements for any . Also all noncooperative simultaneous configurations are stable, since by deviating unilaterally with an announcement , a player ends up playing sequentially as a follower, receiving a lower payoff. (iv) Finally, when , the cooperative configurations and are not stable since players can deviate by announcing and obtaining a higher payoff as a leader. The simultaneous (noncooperative) configuration played at time 1 is also stable since no player can deviate as a leader, but only as a follower, and the latter deviation is no profitable.

Our simple extension of Hamilton and Slutsky [27] has helped to reach at least one clear-cut conclusion. It is as follows: intertemporal cooperation (or cooperation across time) is, overall, the most vulnerable form of cooperation among players. This is because such type of cooperation may be subject to the objections of players in the role of leaders and followers more frequently than if cooperation takes place just in a single period.

#### 5. Concluding Remarks

This paper has presented a first attempt to connect two usually distinct issues concerning players’ strategic interaction: one dealing with their timing of play and the other with their capacity to collude. We have shown that the nature of interaction between players in the strategic setting (duopoly game) plays a crucial role for the decision of players to sign or not a binding agreement and to sequence or not their strategies.

#### Appendix

Lemma A.1 (existence of a symmetric cooperative equilibrium). *Let players’ payoffs be continuous and strictly quasiconcave and their strategy set be compact and convex. Then, the strategy profile is such that .*

*Proof. *Compactness of each implies compactness of . Continuity of each player’s payoff on implies the continuity of the social payoff function . Existence of an efficient profile directly follows. We prove that, under our assumptions, such a strategy profile is symmetric. Suppose . By symmetry we can derive from a new vector permuting the strategies of players and such that
and hence, by the strict quasiconcavity of all , for all we have that
Since, by the convexity of , the strategy vector , we obtain a contradiction.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

The authors wish to thank Christian Ewerhart, Attila Tasnadi, Jacquelin Morgan, Maria Luisa Petit, George Zaccour, and the participants at the Oligo workshop in Budapest, the MDEF workshop in Urbino, the SING7 conference in Paris, and seminar audience at CREI Roma III and Sapienza University for their useful comments and discussions.