Impulsivity in Binary Choices and the Emergence of Periodicity
Binary choice games with externalities, as those described by Schelling (1973, 1978), have been recently modelled as discrete dynamical systems (Bischi and Merlone, 2009). In this paper we discuss the dynamic behavior in the case in which agents are impulsive; that is; they decide to switch their choices even when the difference between payoffs is extremely small. This particular case can be seen as a limiting case of the original model and can be formalized as a piecewise linear discontinuous map. We analyze the dynamic behavior of this map, characterized by the presence of stable periodic cycles of any period that appear and disappear through border-collision bifurcations. After a numerical exploration, we study the conditions for the creation and the destruction of periodic cycles, as well as the analytic expressions of the bifurcation curves.
In many situations the consequences of the choices of an actor are affected by the actions of other actors, that is, the population of agents that form the social system as a whole. Systems characterized by such a trade-off between individual choices and collective behavior are ubiquitous and have been studied extensively in different fields. Among the different contributions the seminal work by Schelling  stands out on its own as it provides a simple model which can qualitatively explain a wealth of everyday life situations. Indeed, the model proposed in Schelling , and in the successive generalizations, is general enough to include several games, such as the well known -players prisoner's dilemma or the minority games (e.g., ).
As remarked by Granovetter , Schelling  does not specify explicitly the time sequence, even if a dynamic adjustment is implicitly assumed in order to both analyze the time evolution of the fraction of agents that make a binary choice, and provides arguments about existence and stability of equilibrium values. However, this implicit dynamic adjustment fails in describing some important phenomena observed in many real situations, such as oscillations caused by overshooting (or overreaction) of the actors involved in choices repeated over time, as well as problems of equilibrium selection when nonmonotonic payoff curves lead to the presence of several stable equilibria.
Recently Bischi and Merlone  presented an explicit discrete-time dynamic model which is based on the qualitative properties described by Schelling  and simulates an adaptive adjustment process of repeated binary choices of boundedly rational agents with social externalities. This permitted them to study the effects on the dynamic behavior of different kinds of payoff functions as well as the qualitative changes of the asymptotic dynamics induced by variations of the main parameters of the model. Moreover, even with monotonic payoff functions, their model allows them to detect the occurrence of oscillatory time series (periodic or chaotic), an outcome often observed in real economic and social systems (see, e.g., ).
In Bischi and Merlone , the adaptive process by which agents switch their decisions depends on the difference observed between their own payoffs and those associated with the opposite choice in the previous turn, and the switching intensity is modulated by a parameter representing the speed of reaction of agents—small values of imply more inertia, while, on the contrary, larger values of imply more reactive agents.
In this paper we reconsider the model presented in Bischi and Merlone  in order to study the dynamics when tends to infinity, that is, agents immediately switch their strategies even when the difference between payoffs is extremely small. This may be interpreted by saying that agents are impulsive (see, e.g.,  for the meaning of impulsivity in the psychological and psychiatric literature) or it may be referred to the case of an automatic device used to determine a sudden switching, between two different kinds of behavior, according to a discrepancy observed between payoff functions, whatever is the measure of such a discrepancy.
From the point of view of the mathematical properties of the model, the limiting case obtained by setting the parameter to infinity corresponds to a change of the iterated map from continuous to discontinuous. This gives us the opportunity to investigate some particular properties of discontinuous dynamical systems. In this paper we numerically show the gradual changes induced by increasing values of , and in the limiting case we show that the asymptotic dynamics is characterized by the existence of periodic cycles of any period. Moreover, we explain how the periods observed depend on the values of the parameters according to analytically determined regions of the parameters' space, called regions of periodicity, or “periodicity tongues", in literature. These tongues are infinitely many, and their boundaries can be described by analytic equations obtained through the study of border collision bifurcations that cause the creation and destruction of periodic orbits.
The structure of the paper is the following. In Section 2 we summarize the formal dynamic model and its properties when the payoff functions have one single intersection. In Section 3 we analyze the system dynamics as the speed of reaction increases, as the dynamic behavior changes from regular (periodic) to chaotic, and give a formal analysis of the bifurcation curves in the asymptotic case. In Section 4 we analyze the system in the limiting case and provide the analytic expression of the bifurcation curves that bound the periodicity tongues. In fact we will see that whichever are the parameter values only one invariant attracting set can exist: a stable cycle, whose period may be any integer number, and also several different cycles with the same periods can exist. We will show that the analysis of the limiting case (a discontinuous function) is very informative also of the dynamics occurring in the original piecewise continuous model. The last section is devoted to some concluding remarks.
2. The Dynamic Model
Following Schelling , Bischi and Merlone  propose a model where a population of players is assumed to be engaged in a game where they have to choose between two strategies, say and , respectively. They assume that the set of players is normalized to the interval and denote by the real variable the fraction of players that choose strategy . Then the payoffs are functions of , say , , where and represent the payoff associated to strategies and , respectively. Obviously, since binary choices are considered, when fraction is playing , then fraction is playing . As a consequence means that the whole population of players is playing and means that all the agents are playing . The basic assumption modeling the dynamic adjustment is the following: will increase whenever whereas it will decrease when the opposite inequality holds.
Consistently with Schelling , this assumption, together with the constraint , implies that equilibria are located either in the points such that , or in (provided that ) or in (provided that . In the process of repeated binary choices which is considered in Bischi and Merlone , the agents update their binary choice at each time period , and represents the number of players playing strategy at time period . They assume that at time becomes common knowledge, hence each agent is able to compute (or observe) payoffs and . Finally, agents are homogeneous and myopic, that is, each of them is interested to increase its own next period payoff. In this discrete-time model, if at time players are playing strategy and then a fraction of the agents that are playing will switch to strategy in the following turn; analogously, if then a fraction of the players that are playing will switch to strategy . In other words, at any time period agents decide their action for period comparing and according to
where , are propensities to switch to the other strategy; is a continuous and increasing function such that and , is a positive real number. The function modulates how the fraction of switching agents depends on the difference between the previous turn payoffs; the parameters and represent how many agents may switch to and , respectively (when , there are no differences in the propensity to switch to either strategies) and the parameter represents the switching intensity (or speed of reaction) of agents as a consequence of the difference between payoffs. In other words, small values of imply more inertia, that is, anchoring attitude, of the actors involved, while, on the contrary, larger values of can be interpreted in terms of impulsivity. In fact, according to the Clinical Psychology literature  impulsivity can be separated in different components such as acting on the spur of the moment and lack of planning.
Notice that if both the payoff functions are continuous, then also the map is continuous in the whole interval [0,1], and its graph is contained in the strip bounded by two lines, being . However, even if and are smooth functions, the map in general is not smooth in the considered interval, since is not differentiable where the payoff functions intersect. When studying the dynamics, this does not allow us to use the usual approach which relies on the first derivative value in the equilibrium points. As a consequence an approach based on the left and right side slopes in the neighborhood of any interior fixed point is needed.
In this paper we consider payoff functions and with one and only one internal intersection such that . Assume, first, that the strategy is preferred at the right of and is preferred at the left, as in Figure 1(a). This situation is discussed in Schelling  where a vivid example is also provided by assuming that stands for carrying a visible weapon, for going unarmed. One may prefer to be armed if everybody else is, but not if the rest is not (individuals may also be nations). According to the relative position of the two payoff curves, Schelling  concludes that there exist two stable equilibria, namely and , where everybody is choosing and everybody is choosing respectively, whereas the inner equilibrium is unstable. The reasons given by Schelling to prove these statements are based on the following arguments: at the equilibrium , where everybody is choosing , nobody is motivated to choose because in a right neighborhood of , and analogously at , where everybody is choosing , nobody is motivated to choose being in a left neighborhood of ; instead, starting from the inner equilibrium , where both choices coexist, if is displaced in a right neighborhood of by an exogenous force, there and a further increase of will be generated by endogenous dynamics, whereas if is displaced in a left neighborhood of , where , then a further decrease of will be observed. These qualitative arguments of Schelling are confirmed by the following proposition, proved in Bischi and Merlone,  (see, also Figure 1(b)).
Proposition 2.1. Assume that and are continuous functions such that(i)(ii)(iii)there exists a unique such that ,then the dynamical system (2.1) has three fixed points, , , and , where is unstable and constitutes the boundary that separates the basins of attraction of the stable fixed points and . All the dynamics generated by (2.1) converge to one of the two stable fixed points monotonically, decreasing if , increasing if .
The situation is quite different when the payoff functions are switched, that is, and , so that is preferred at the left of the unique intersection and is preferred at the right (see, Figure 2(a)). In this case we have a unique equilibrium, given by the interior fixed point .
Schelling  describes this case as well, and provides some real-life examples of collective binary choices with this kind of payoff functions. Among these examples one concerns the binary choice about whether using the car or not, depending to the traffic congestion. Let represent the strategy “staying at home" and “using the car". If many individuals choose (i.e., is small), then is preferred because of traffic congestion, whereas if many choose (i.e., is large), then is preferred as the roads are empty. This situation can be represented with payoff functions as those depicted in Figure 2(a). Schelling  gives a qualitative analysis of this scenario and classifies it as being characterized by global stability of the unique equilibrium point. Using the words of Schelling [1, page 401] “If we suppose any kind of damped adjustment, we have a stable equilibrium at the intersection”. His argument is based on the fact that on the left of (hence increasing whenever ) and on the right of (hence decreasing whenever ). While this statement of global stability is true when assuming a continuous time scale, in our discrete-time model we can observe oscillations of .
This is shown in Figure 2(b), obtained with , , , , . In this case, increases in the right neighborhood of , and decreases in the left neighborhood of , nevertheless, the unique equilibrium is unstable, and persistent oscillations, periodic or chaotic, are observed around it. The wide spectrum of asymptotic dynamic behaviors that characterize this model is summarized in the bifurcation diagram depicted in Figure 2(c), which is obtained with the same values of parameters and payoff functions as in Figure 2(b) and by considering the parameter that varies in the range . However, Figure 2(c) also shows that for high values of the parameter the asymptotic dynamics settle on a given periodic cycle (of period 3 in this case) according to the values of the parameters and . This can be easily forecasted from the study of the limiting map (3.1), as shown in Section 4. The occurrence of oscillations is typical of a discrete-time process, and is caused when individual players overshoot, or overreact. For example, in the model of binary choice in car usage described above, overshooting occurs for sufficiently large values of (high speed of reaction). This means that whenever traffic congestion is reported, on the following day many people will stay at home; vice versa when no traffic congestion is reported most all of the people will use their car. This kind of reactions generates a typical oscillatory time pattern which is a common situation observed in everyday life (for a discussion about the chaos and complexity in sociology the reader may refer to ). This sort of realistic situation would be completely ruled out when adopting a continuous time one-dimensional dynamic model. However, several of the examples proposed in literature are characterized by decisions that cannot be continuously revised, and lags between observations and decisions are often finite. As a consequence decision processes typically occur in a discrete-time setting. The reader may also refer to Schelling [1, chapter 3] for several qualitative descriptions of overshooting and cyclic phenomena in social systems.
Concerning the condition for stability of the unique equilibrium , when considering the discrete-time dynamic model (2.1) we realize that the slope of the function at the steady state may be positive or negative. More precisely, assuming that and are differentiable functions, since , both the left and right tangents and are less than :
Hence is stable (indeed, globally stable) as far as and , and it may become unstable when at least one of these slopes decrease below (see, e.g., [9, 10]). However, if and , then the fixed point is still globally stable, because in this case any initial condition taken on the right of generates a decreasing trajectory that converges to , whereas an initial condition taken on the left of has the rank- image , after which convergence to follows (see, Figure 3(a)). The same argument holds, just reversing left and right, if and . Instead, if and then the stability of depends on the product , being it stable if , otherwise it is unstable with a stable cycle (or a chaotic attractor) around it (see, Figure 3(b)).
The results of our discussion can be summarized as follows.
Proposition 2.2. If and are differentiable functions such that(i)(ii)(iii)there exists a unique such that ,then the dynamical system (2.1) has only one fixed point at , which is stable if .
It is worth to note that both the slopes and decrease as or or increase, that is, if the impulsivity of the agents and/or their propensity to switch to the opposite choice increase.
3. Impulsivity in Agents' Reaction
In this section we examine what happens when the parameter increases, because this corresponds to the case in which agents are impulsive. Indeed, impulsivity is an important construct in the psychological and psychiatric literature (see, ) and, as a matter of fact, is directly mentioned in the DSM_IV diagnostic criteria. (The Fourth edition of the Diagnostic and Statistical Manual of Mental Disorders presents the descriptions of diagnostic categories of mental disorders coded on different axes. It is used in the United States and around the world by clinicians researchers health insurance companies and policy markers). In order to obtain an insight on the effect of increasing values of , in the following we study the limiting case obtained as This is equivalent to consider if and if , as a consequence the switching rate only depends on the sign of the difference between payoffs, no matter how much they differ. In this case the dynamical system assumes the following form
Such a limiting situation may appear as rather extreme, because the map becomes discontinuous at the internal equilibria defined by the equation . However, a study of the global properties of gives some insight into the asymptotic properties of the continuos map (2.1) for high values of and emphasizes the role of the parameters and .
For example, when the payoff functions satisfy the assumptions of Proposition 2.2, increasing values of cause the loss of stability of the equilibrium via a flip bifurcation that opens the usual route to chaos through a period doubling cascade. However, as shown in the bifurcation diagram of Figure 2(c), such a chaotic behavior can only be observed for intermediate values of the parameter , as the asymptotic dynamics settles on a stable periodic cycle for sufficiently high values of . This can be numerically observed for many different values of the parameters and , the only difference being the period of the stable cycle that prevails at high values of . In order to have a complete understanding of the dependence on and of the periodicity that characterizes the asymptotic dynamics of impulsive agents, we will study the discontinuous map (3.1), to which the continuous map (2.1) gradually approaches for increasing values of , see Figure 4. It is also interesting to observe how the corresponding two-dimensional bifurcation diagram in the parameters' plane evolves as increases. The different colors shown in the three pictures of Figure 5, obtained with , , respectively, represent the kind of asymptotic behavior numerically observed: convergence to the stable fixed point or a stable periodic cycle of low period when the parameters are chosen in the blue regions (with different blue shades representing different periods) or the convergence to a chaotic attractor, or periodic cycle of very high period, when the parameters are chosen in the red regions. It can be seen that chaotic behavior becomes quite common at intermediate values of whereas periodic cycles of low period prevail for very high values of . However, it is worth to remark that the set of parameters' values corresponding to chaotic attractors is given by the union of one-dimensional subsets in the two-dimensional space of parameters shown in Figure 5, whereas the regions related to attracting cycles of different periods are open two-dimensional subsets.
3.1. The Analysis of the Impulsive Agents Limit Case
respectively, where the parameter represents the discontinuity point located at the interior equilibrium, that is, , and the parameters , are subject to the constraints , . It is worth noticing that the value of the map in the discontinuity point, , is not important for the analysis which follows, therefore it will often be omitted.
Let us first consider the map . It has a discontinuity in the point with an “increasing” jump, that is, , see Figure 6. In this case, whichever is the position of the discontinuity point , the dynamics are very simple: there are two stable fixed points, the boundary steady states and , with basins of attraction separated by the discontinuity point: any initial condition will converge to the fixed point while any initial condition will generate a trajectory that converges to the fixed point .
Quite different is the situation for the map , where the discontinuity point has a “decreasing" jump, that is, . In this case we will see that periodic cycles of any period may occur. A first example is shown in Figure 7, where a stable cycle of period 2 is shown.
In Figure 8 we show another example to illustrate that several different cycle of the same period may exist: in Figure 8(a), a 7-cycle (cycle of period 7) has 2 points in the left branch and 5 in the right one, while in Figure 8(b) (obtained with different values of and ) another 7-cycle has 5 periodic points in the left branch and 2 in the right branch. We will see that it is even easy to find 7-cycles having 3 points on the left branch and 4 in the right one, or 4 points on the left and 3 in the right as well. Indeed, for any given period, all the possible combinations may occur depending on the values of the parameters and
We will also prove that, given and , and consequently the slopes of the left branch andthe right branch respectively, the map has only one attractor, a stable cycle of some period , and any initial condition gives a trajectory converging to such -cycle. Before giving a proof of this statement, we prefer to show first a numerical computation of a two-dimensional bifurcation diagram, in the plane of the parameters and , by using different colors to denote the regions where stable cycles of different periods characterize the asymptotic dynamics. The analytic computation of the bifurcation curves that bound these regions will be given later.
In Figure 9(a) we show the parameter plane covered by regions of different colors, often called “periodicity tongues" (due to their particular shape), each characterized by a different period (indicated by a number in some of the tongues, only the larger ones). Figure 9(a) has been obtained fixing the discontinuity point at and changing the parameter and between and . Figure 9(b) shows a bifurcation diagram which gives the asymptotic behavior of the state variable as the parameter is fixed at the value , whereas the parameter decreases from to , that is, the parameter increases from up to . It can be seen that between a cycle of period and a cycle of period there is a region where a cycle of period exists. Moreover, zooming in the scale of the horizontal axis it is possible to see that between the regions of the 2-cycle and the 3-cycle, there exist infinitely many other intervals of existence of cycles of period for any integer and any integer . The reason for this will be clarified later. The analytic study of the different regions of periodicity in the parameters' plane is the goal of the next sections. However, let us first remark that the existence of the cycles of any period is not substantially influenced by the position of the discontinuity point, in the sense that all the bifurcation curves continue to exist for different values of the discontinuity as well, only showing slight modifications of their shape. For example, in Figure 10 we show the periodicity tongues numerically obtained for and for respectively. Notice that the colors of the periodicity tongues are practically the same, and are also similar to those shown in Figure 9, obtained with .
3.2. Analytic Expressions of the Boundaries of the Periodicity Tongues
The study of the dynamic properties of iterated piecewise linear maps with one or more discontinuity points has been rising increasing interest in recent years, as witnessed by the high number of papers and books devoted to this topic, both in the mathematical literature (see e.g., [11–16]) and in applications to electrical and mechanical engineering ([17–26]) or to social sciences ([27–31]).
The bifurcations involved in discontinuous maps are often described in terms of the so called border-collision bifurcations, that can be defined as due to contacts between an invariant set of a map with the border of its region of definition. The term border-collision bifurcation was introduced for the first time by Nusse and Yorke  (see also ) and it is now widely used in this context. However the study and description of such bifurcations was started several years before by Leonov [34, 35], who described several bifurcations of that kind and gave a recursive relation to find the analytic expression of the sequence of bifurcations occurring in a one-dimensional piecewise linear map with one discontinuity point. His results are also described and used by Mira [36, 37]. Analogously, important results in this field have been obtained by Feigen in 1978, as reported in di Bernardo et al. .
We now apply the methods suggested by Leonov [34, 35], see also Mira [36, 37] to the map , in order to show that it is possible to give the analytical equation of the bifurcation curves that we have seen in Figures 9 and 10. As we will see, the boundaries that separate two adjacent periodicity tongues are characterized by the occurrence of a border-collision, involving the contact between a periodic point of the cycles existing inside the regions and the discontinuity point. To better formalize and explain our results it is suitable to label the two components of our map as follows:
where and are the slopes of the two linear branch on the left and on the right of the discontinuity point respectively.
First of all, notice that all the possible cycles of the map of period are always stable. In fact, the stability of a -cycle is given by the slope (or eigenvalue) of the function ( times) in the periodic points of the cycle, which are fixed points for the map so that, considering a cycle with points on the left side of the discontinuity and on the right side, the eigenvalue is given by which, in our assumptions, is always positive and less than .
To study the conditions for the existence of the periodic cycles we limit our analysis to the bifurcation curves of the so-called “principal tongues", or “main tongues" ([14, 17–19, 21, 22]) or “tongues of first degree" ([34–37]), which are the cycles of period having one point on one side of the discontinuity point and points on the other side (for any integer ). Let us begin with the conditions to determine the existence of a cycle of period having one point on the left side and points on the right side . The condition (i.e., the bifurcation) that marks its creation is that the discontinuity point is a periodic point to which we apply, in the sequence, the maps . In the qualitative picture shown in Figure 11(a) we show the condition for the creation of a 3-cycle, that is, , given by, Then the -cycle with periodic points numbered with the first point on the left side, satisfies and this cycle ends to exist when the last point ( merges with the discontinuity point, that is, which may be stated as the point is a periodic point to which we apply, in the sequence, the maps . In the qualitative picture in Figure 11(b) we show the closing condition related with the 3-cycle, that is, . Notice that both these conditions express the occurrence of a border collision bifurcation, being related to a contact between a periodic point and the boundary (or border) of the region of differentiability of the corresponding branch of the map. Of course, at the bifurcation the discontinuity point, which is a fixed point according to the definition of the map, represents a stable equilibrium as any trajectory converging to the stable cycle is definitely captured by the fixed point as it coincides with a periodic point at the bifurcation. However, this only happens at the bifurcation points, that is, it represents a structurally unstable situation, as any slight changes of a parameter with respect to the bifurcation value, that is, just before or just after a bifurcation situation, the fixed point is unstable. So, as previously stated, we can neglect such nongeneric stability conditions of the fixed point that only represent bifurcation situations. In general, for a cycle of period , the equation of one boundary of the corresponding region of periodicity is
while the other boundary, that is, the closure of the periodicity tongue of the same cycle, is given by
The proof of these two equations is reported in the appendix. Thus the -cycle exists for and in the range
and the periodic points of the -cycle, say where and for , can be obtained explicitly as:
It is plain that we can reason symmetrically for the other kind of cycles (with periodic point in the branch and in the branch) just swapping and . So, we can easily get the following expressions for the bifurcation curves that mark the creation of a -cycle:
while the closure of the same periodicity tongue is given by the following expression:
So, the -cycle exists for and in the range
Moreover, the periodic points of the -cycle, (where and for , are obtained from the existence condition, so that we have:
It is easy to see that for the formulas in (3.4) and in (3.8) give the same bifurcation curves, and similarly for the formulas in (3.5) and in (3.9) give the same equations. Instead, for with the formulas in (3.4) and in (3.5) we get all the bifurcation curves in Figure 12(a), below the main diagonal, and with those in (3.8) and (3.9) we get all the bifurcation curves in Figure 12(a), above the main diagonal.
Note that the formulas given in (3.4) and in (3.8) are generic, and hold whichever is the position of the discontinuity point . In Figure 13 we show the bifurcation curves for in the case and respectively. It is worth noticing that following the same arguments it is possible to find the boundaries of the other bifurcation curves as well. In fact, besides the regions associated with the “tongues of first degree" ([34–37]) there are infinitely many other periodicity tongues, with periods that can be obtained from the property that between any two tongues having periods and there exists also a tongue having period (see e.g., the periods indicated in Figure 9).
To be more specific, in the description of the periodicity tongues we can associate a number to each region, which may be called “rotation number", in order to classify all the periodicity tongues. In this notation a periodic orbit of period is characterized not only by the period but also by the number of points in the two branches separated by the discontinuity point (denoted by and resp.,). So, we can say that a cycle has a rotation number if a -cycle has points on the side and the other on the side. Then between any pair of periodicity regions associated with the “rotation number" and there exists also the periodicity tongue associated with the “rotation number" (also called Farey composition rule , see e.g., ).
Then, following Leonov [34, 35] (see also [36, 37]), between any pair of contiguous “tongues of first degree", say and we can construct two infinite families of periodicity tongues, called “tongues of second degree" by the sequence obtained by adding with the Farey composition rule iteratively the first one or the second one, that is, and so on, that is:
and that is:
which give two sequences of tongues accumulating on the boundary of the two starting tongues.
Clearly, this mechanisms can be repeated: between any pair of contiguous “tongues of second degree", for example and we can construct two infinite families of periodicity tongues, called “tongues of third degree" by the sequence obtained by adding with the composition rule iteratively the first one or the second one. And so on. All the rational numbers are obtained in this way, giving all the infinitely many periodicity tongues.
Besides the notation used above, called method of the rotation numbers, we may also follow a different approach, related with the symbolic sequence associated to a cycle. In this notation, considering the principal tongue of a periodic orbit of period constituted by one point on the side and on the side, we associate to the cycle the symbolic sequence . Then the composition of two consecutive cycles is given by:
that is, the two sequences are just put together in file (and indeed this sequence of bifurcations is also called “boxes in files" in ), and the sequence of maps to apply in order to get the cycle are listed from left to right. More generally, it is true that given a periodicity tongue associated with a symbolic sequence (consisting of letters and giving the cycle from left to right) and a second one with a symbolic sequence then also the composition of the two sequences exists, associated with a periodicity tongue with symbolic sequence
Finally, we notice that all the tongues are disjoint, that is, they never overlap, and this implies that coexistence of different periodic cycles is not possible. In other words, we can have only a single attractor for each pair of parameters and .
In this paper we have considered an adaptive discrete-time dynamic model of a binary game with externalities proposed by Bischi and Merlone  and based on the qualitative description of binary choice processes given by Schelling . We focused on the case of a switching intensity that tends to infinity, a limiting that may be interpreted as agents' impulsivity, that is, actors that decide to switch the strategy choice even when the discrepancy between the payoffs observed in the previous period is extremely small. This may even be interpreted as the automatic change of an electrical or mechanical device that changes its state according to a measured difference between two indexes of performance.
In this limiting case the dynamical system is represented by the iteration of a one-dimensional piecewise linear discontinuous map that depends on three parameters, and whose dynamic properties and the analytically computed border collision bifurcations allowed us to give a quite complete description of existence, uniqueness and stability of periodic cycles of any period. In fact, for this piecewise continuous map with only one discontinuity point we could combine and usefully apply some geometric and analytic methods taken from the recent literature, as well as some results proposed several years ago but not sufficiently known in our opinion. How close the bifurcation curves of the limiting case are to those of the original continuous model, with a high value of the parameter can be deduced comparing Figure 5(c) with Figure 9(a).
We have obtained the analytic expression of the border collision bifurcation curves that bound the periodicity tongues of first degree in the parameters' plane.
The results obtained show that the limiting case of impulsive agents is always characterized by convergence to a fixed point or to a periodic cycle, whereas for intermediate values of the switching parameters chaotic motion can be easily observed as well.
The methods followed to obtain such analytic expressions are quite general and can be easily generalized to cases with several discontinuities and with slopes different from the ones considered in the model studied in this paper. Indeed, in Schelling  also the case with two intersections between the payoff curves has been discussed, see also Granovetter, . This gives rise to a model with two discontinuity points in the limiting case of impulsive agents. The bifurcation diagrams obtained in this case are studied in the paper Bischi et al. , and the same arguments can be applied in order to extend the discussion to the case where even more intersections (hence more discontinuities) occur.
The condition of existence of a -cycle with periodic points , having one point on the side and points in the side (also called principal orbits), is obtained by considering the fact that a periodic cycle is created in the form of a critical orbit, that is with a periodic point in the discontinuity point, for example, and then . From this condition we get:
and the condition for a -cycle is given by:
Rearranging we obtain (for any ):
The cycle exists until a periodic point has a contact with the discontinuity point, , at which we apply, in the sequence, the maps Thus we obtain the following expressions:
and the condition for a -cycle is:
which, rearranged, gives (for any )
The authors thank the participants to the Workshop MDEF-2008 in Urbino for their interesting comments and suggestions, in particular Fabio Tramontana for useful discussions during the preparation of this paper. We also thank the two referees for their useful suggestions and remarks. The usual disclaimers apply.
T. C. Schelling, “Hockey helmets, concealed weapons and daylight saving,” Journal of Conflict Resolution, vol. 17, no. 3, pp. 381–428, 1973.View at: Google Scholar
D. Challet and Y. C. Zhang, “Emergence of cooperation and organization in an evolutionary game,” Physica A, pp. 246–407, 1997.View at: Google Scholar
M. Granovetter, “Threshold models of collective behavior,” The American Journal of Sociology, vol. 83, no. 6, pp. 1420–1443, 1978.View at: Google Scholar
G. I. Bischi and U. Merlone, “Global dynamics in binary choice models with social influence,” Journal of Mathematical Sociology, vol. 33, pp. 1–26, 2009.View at: Google Scholar
J. B. Rosser, “On the complexities of complex economic dynamics,” Journal of Economic Perspectives, vol. 13, pp. 169–172, 1999.View at: Google Scholar
F. G. Moeller, E. S. Barratt, D. M. Dougherty, J. M. Schmitz, and A. C. Swann, “Psychiatric aspects of impulsivity,” American Journal of Psychiatry, vol. 158, pp. 1783–1793, 2001.View at: Google Scholar
J. H. Patton, M. S. Stanford, and E. S. Barratt, “Factor structure of the Barratt impulsiveness scale,” Journal of Clinical Psychology, vol. 51, pp. 768–774, 1995.View at: Google Scholar
R. A. Eve, S. Horsfall, and M. E. Lee, Eds., Chaos, Complexity, and Sociology: Myths, Models, and Theories, Sage Publications, London, UK, 1997.
R. L. Devaney, Chaotic Dynamical Systems, Perseus Books, Reading, Mass, USA, 2nd edition, 1989.
C. Robinson, Dynamical Systems: Stability, Symbolic Dynamics, and Chaos, Studies in Advanced Mathematics, CRC Press, Boca Raton, Fla, USA, 2nd edition, 1999.View at: MathSciNet
I. Sushko, A. Agliari, and L. Gardini, “Bifurcation structure of parameter plane for a family of unimodal piecewise smooth maps: border-collision bifurcation curves,” Chaos, Solitons & Fractals, vol. 29, no. 3, pp. 756–770, 2006.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
Yu. L. Maĭstrenko, V. L. Maĭstrenko, and L. O. Chua, “Cycles of chaotic intervals in a time-delayed Chua's circuit,” International Journal of Bifurcation and Chaos in Applied Sciences and Engineering, vol. 3, no. 6, pp. 1557–1572, 1993.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
Yu. L. Maĭstrenko, V. L. Maĭstrenko, S. I. Vikul, and L. O. Chua, “Bifurcations of attracting cycles from time-delayed Chua's circuit,” International Journal of Bifurcation and Chaos in Applied Sciences and Engineering, vol. 5, no. 3, pp. 653–671, 1995.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. Banerjee and C. Grebogi, “Border-collision bifurcations in two-dimensional piecewise smooth maps,” Physical Review E, vol. 59, no. 4, pp. 4052–4061, 1999.View at: Google Scholar
S. Banerjee, M. S. Karthik, G. Yuan, and J. A. Yorke, “Bifurcations in one-dimensional piecewise smooth maps—theory and applications in switching circuits,” IEEE Transactions on Circuits and Systems I, vol. 47, no. 3, pp. 389–394, 2000.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. Banerjee, P. Ranjan, and C. Grebogi, “Bifurcations in two-dimensional piecewise smooth maps—theory and applications in switching circuits,” IEEE Transactions on Circuits and Systems I, vol. 47, no. 5, pp. 633–643, 2000.View at: Google Scholar
O. Feely, D. Fournier-Prunaret, I. Taralova-Roux, and D. Fitzgerald, “Nonlinear dynamics of bandpass sigma-delta modulation. An investigation by means of the critical lines tool,” International Journal of Bifurcation and Chaos, vol. 10, no. 2, pp. 303–327, 2000.View at: Google Scholar
Z. T. Zhusubaliyev and E. Mosekilde, Bifurcations and Chaos in Piecewise-Smooth Dynamical Systems, vol. 44 of World Scientific Series on Nonlinear Science. Series A: Monographs and Treatises, World Scientific, River Edge, NJ, USA, 2003.View at: MathSciNet
Z. T. Zhusubaliyev, E. Mosekilde, S. Maity, S. Mohanan, and S. Banerjee, “Border collision route to quasiperiodicity: numerical investigation and experimental confirmation,” Chaos, vol. 16, no. 2, Article ID 023122, 11 pages, 2006.View at: Publisher Site | Google Scholar | PubMed | Zentralblatt MATH | MathSciNet
L. Gardini, T. Puu, and I. Sushko, “A goodwin-type model with a piecewise linear investment function,” in Business Cycles Dynamics. Models and Tools, T. Puu and I. Sushko, Eds., Springe, New York, NY, USA, 2006.View at: Google Scholar
L. Gardini, I. Sushko, and A. Naimzada, “Growing through chaotic intervals,” Journal of Economic Theory, vol. 143, pp. 541–557, 2008.View at: Google Scholar
T. Puu, L. Gardini, and I. Sushko, “A Hicksian multiplier-accelerator model with floor determined by capital stock,” Journal of Economic Behavior and Organization, vol. 56, pp. 331–348, 2005.View at: Google Scholar
F. Tramontana, L. Gardini, and T. Puu, “Duopoly games with alternative technologies,” Journal of Economic Dynamic and Control, vol. 33, pp. 250–265, 2008.View at: Google Scholar
N. N. Leonov, “Map of the line onto itself,” Radiofisica, vol. 3, no. 3, pp. 942–956, 1959.View at: Google Scholar
C. Mira, Chaotic Dynamics: From the One-Dimensional Endomorphism to the Two-Dimensional Diffeomorphism, World Scientific, Singapore, 1987.View at: MathSciNet
B. L. Hao, Elementary Symbolic Dynamics and Chaos in Dissipative Systems, World Scientific, Teaneck, NJ, USA, 1989.View at: MathSciNet
G. I. Bischi, L. Gardini, and U. Merlone, “Periodic cycles and bifurcation curves for one-dimensional maps with two discontinuities,” Journal of Dynamical Systems and Geometric Theory. In press.View at: Google Scholar