Research Article | Open Access
A Crossing Lemma for Annular Regions and Invariant Sets with an Application to Planar Dynamical Systems
We present a topological result, named crossing lemma, dealing with the existence of a continuum which crosses a topological space between a pair of “opposite” sides. This topological lemma allows us to obtain some fixed point results. In the works of Pascoletti et al., 2008, and Pascoletti and Zanolin, 2010, we have widely exposed the crossing lemma for planar regions homeomorphic to a square, and we have also presented some possible applications to the theory of topological horseshoes and to the study of chaotic-like dynamics for planar maps. In this work, we move from the framework of the generalized rectangles to two other settings (annular regions and invariant sets), trying to obtain similar results. An application to a model of fluid mixing is given.
In 1883-1884, Poincaré [1, 2] introduced a generalization of the Bolzano theorem to continuous vector fields defined on a hypercube of . Such result, usually known as the Poincaré-Miranda theorem [3–5], in dimension two, reads as follows.
Theorem 1. Let be a planar rectangle, and let be a continuous vector field such that changes its sign from the left to the right side of and changes its sign from the lower to the upper side of . Then, there exists at least one point such that .
A heuristic proof of this result, “pour faire comprendre comment on peut démontrer ce théorème,” quoting Poincaré’s words , can be described as follows. (The more formal proof in  makes use of Kronecker integral, a forerunner of topological degree theory (see [5, 6]). We also recommend the recent article  for a modern perspective about this topic.) The “curve” starts at some point of the left side , and it ends at some point of the right side . Similarly, the “curve” starts at some point of the lower side , and it ends at some point of the upper side . Hence, these “curves” must intersect at some point of the rectangle. Clearly, in modern language, using in this context the term “curve” may be a little misleading, although it well explains the geometry of the problem. Yet the argument of the proof is safe if we note that the set contains a continuum joining the left to the right side and, similarly, the set contains a continuum joining the lower to the upper side. The existence of at least one intersection point between these continua follows from a result of plane topology (see Lemma 7).
In order to prove the existence of such continua, one can observe that the set crosses any path from the lower to the upper side of the rectangle (and the same happens for the set with respect to the paths connecting the left to the right side of the rectangle). In  we called such kind of results as crossing lemmas and proposed new applications to the study of the dynamics of some planar maps. In an abstract setting we can describe these results as follows. We start from a closed set which cuts all the paths connecting two given sets, and we look for a closed connected subset of with the same cutting property. In many applications, it turns out that the set crosses the original domain “from one side to the other.” A typical example in this direction is presented in Lemma 10 in the framework of topological rectangles, which are topological spaces which are homeomorphic to a planar rectangle.
Important theorems, where some forms of these crossing properties are considered, appear in dimension theory with the results of Hurewicz and Wallman , in topological games [10, 11], and in proofs of the existence of solutions to nonlinear differential equations .
In some applications, typically the set is a set of solutions of a nonlinear equation depending on a parameter (or equivalently a set of fixed points for a family of parameter-dependent operators). From this point of view, results in this direction, in spite of the fact that they may look quite elementary, present a great usefulness in different areas of nonlinear analysis, especially in connection with bifurcation theory (see [12–15]).
When the operators whose fixed points correspond to the element of have some special symmetries, it is likely that some of these symmetries are inherited by the set itself. In this case, it would be desirable to prove that also the continuum inherits the symmetries of .
In the present paper we move from the framework of generalized rectangles already discussed in previous articles [8, 16] to two other settings, namely, the study of annular regions and the case of invariants sets. More precisely, for the former case, we just collect in Section 2 some classical separation results already applied in [8, 16] to prove the existence of fixed points, periodic points, and chaotic dynamics for planar dynamical systems. In Section 3 and Section 4, respectively, we discuss the variants to annular regions and invariant sets, and, as a possible application of our results, we reconsider in Section 5 an example of planar map arising in fluid mixing previously studied by Kennedy and Yorke in .
We conclude this introduction with some preliminary results which will be used in what follows. Throughout the paper, by a path in a topological space , we mean a continuous map , with . We also set . Any homeomorphic image of will be referred to as an arc. The sets and are, respectively, the open and the closed balls of center of origin and radius in . In the plane (usually identified with ) with the Euclidean norm, we denote by the closed unit disc and by its boundary.
Slightly modifying an analogous definition of Berarducci et al. [18, Definition 2.1], we give the following.
Definition 2. Let be a topological space, and let be two nonempty disjoint sets. Let also . One says that cuts the paths between and if , for every path such that and .
In order to simplify the statements of the next results, we write to express the fact that cuts the paths between and . If is a singleton, we write instead of . Similar notation is used if is a singleton. In order to have Definition 2 meaningful, we implicitly assume that there exists at least a path in connecting with (otherwise, we could take or any subset of ). Clearly, if a set satisfies the cutting property of Definition 2, then also its closure cuts the paths between and . Therefore, in the sequel and without loss of generality, we usually assume is closed. Such an assumption is also well suited for proving the existence of minimal (closed) sets satisfying Definition 2. Indeed, we have the following.
Lemma 3. Let be a topological spac,e and let be two nonempty disjoint sets which are connected by at least one path in . Let be a (nonempty) closed set which cuts the paths between and . Then there exists a nonempty, closed set which is minimal with respect to the property of cutting the paths between and .
Proof. The proof is a standard application of Zorn’s lemma. Let be the set of all the nonempty closed subsets of such that , with the elements of ordered by inclusion. Clearly, is nonempty for at least . Let be a totally ordered subset of . We claim that . Indeed, let be a path such that and . The family of compact sets has the finite intersection property, and, therefore, . This proves our claim, and the conclusion follows from Zorn’s lemma.
In , Dolcher studied a similar minimality problem, dealing with closed sets separating two points. The definition of separation is the standard one; that is, a set separates two points (or, in general, two nonempty sets) if the two points belong to different components of the complement . In this respect, we reconsider the following example from . Let , with the topology of the plane, be defined by with and .
Let , and . Clearly, , and also separates and in . As shown in , there is no subset of which is minimal for the property of separating and in . On the other hand, is the minimal subset of which cuts the paths between and .
In general, a set satisfying , even if minimal with respect to such property, need not be connected. For an elementary example, one can take (with the topology of the plane), , and . In this case, is a closed set, minimal with respect to the property of cutting the paths between and , which is not connected. The connectivity of (or of a minimal subset of it) is, however, an important property for the proof of the existence of fixed points or of zeros for maps in Euclidean spaces. Such connectivity properties have been employed recently in [20–22] in connection with the theory of topological horseshoes. In order to recall some main results from the above quoted papers and to propose some further developments, we introduce, in the next section, some main definitions which play a crucial role in our approach.
2. Generalized Rectangles
Definition 4. A topological space is called a generalized rectangle if it is homeomorphic to the unit square .
For a generalized rectangle and a homeomorphism , the set is independent of the choice of the homeomorphism . We call the set the contour of and denote it by . Clearly, for a generalized rectangle embedded in , the contour of coincides with the boundary of .
Definition 5. An oriented rectangle is a pair such that is a generalized rectangle and is the union of two disjoint arcs and . One says that and are, respectively, the left- and the right-hand sides of the (generalized) rectangle . Sometimes one will also write .
Remark 6. Given an oriented rectangle, , we can choose a homeomorphism in such a manner that (this can be proved using the Schoenflies theorem ). Then we can also introduce the sets which are called the bottom and the top sides of and define Observe that, for any homeomorphism such that , it follows that . Thus, the choice of determines also the choice of (which is also the closure of ). Given a pair , the order in which we choose to call as “right” and “left” to the two components of (as well as to label the two components of ) is completely irrelevant for what follows. As a consequence of such remark, we have that, to each oriented rectangle , a “dual” oriented rectangle is associated with and with as the -set for .
2.1. Crossing Properties for Generalized Rectangles
The next (classical) result guarantees the fact that continua connecting opposite sides of an oriented rectangle must cross each other. It can be proved as a consequence of the Jordan curve theorem, and the proof is omitted (see  for the details and also  for an application to ordinary differential equations).
Lemma 7. Let be an oriented rectangle, and let be closed connected sets such that Then .
The connectedness of and is not enough to guarantee the existence of a nonempty intersection (see [25, Example 10.4]).
We present now some results about sets separating the opposite faces of an oriented rectangle. We have shown their role in the proof of the existence of fixed points and periodic points for continuous maps in [8, 16, 26]. Some of these results can be extended to higher dimension using the topological degree, the fixed point index, or other index theories (see  and the references therein). Since the applications in the present paper will be all related to planar maps, we prefer to confine ourselves to the use of a more direct tool: Alexander’s lemma. Such result, named after Alexander [27, 28], as shown both in Newman’s book  and in Sanderson’s article , is quite useful in proving a broad range of theorems of plane topology. Quoting Smith  “this lemma, the proof of which requires but a few lines, is shown [⋯] to be one of the sharpest tools in the theory of separation, if skilfully handled.” Results based on applications of Alexander’s lemma or to other related theorems in  have been fruitfully applied to differential equations by Hastings [32–34], McLeod and Serrin , Turner , and others. For more recent applications see [15, 37, 38].
The following version of Alexander’s lemma will be used in our next results. The proof requires only an elementary modification of the standard one  and, therefore, is omitted.
Lemma 8. Let be an oriented rectangle, and let be closed disjoint subsets of . Assume that there exist two paths , with and such that Then, there exists a path , with and such that .
Remark 9. The original version of Alexander’s lemma is a variant of Lemma 8 in which we assume that all the paths have the same initial point and the same end point .
The next result is perhaps one of the most classical and useful consequences of the previous lemma (see ) and is usually expressed by the fact that “if a closed set separates the plane, then some component of this set separates the plane” [34, page 131].
Lemma 10. Let be an oriented rectangle, and let be a closed set such that . Then, there exists a compact, connected set such that .
Proof. By Lemma 3 there exists a closed set such that , with minimal with respect to the cutting property. Suppose, by contradiction, that is not connected, and let be two closed nonempty disjoint sets with . Since is minimal and are proper subsets of , there exist two paths in which connects to , such that avoids (for ). Then, by Lemma 8, there exists a path with and with , contradicting the assumption that .
The cutting property for obtained in Lemma 10 can be equivalently expressed as follows.
Lemma 11. Let be an oriented rectangle, and let be a closed connected set. Then, if and only if .
Proof. If , then, necessarily, must cut the upper and the lower sides of which are the images of particular paths connecting to . On the other hand, if is any path with and , then and are two continua connecting the opposite sides of the oriented rectangle and, therefore, by Lemma 7. This proves that .
The combination of Lemma 10 and Lemma 11 gives the so-called Crossing Lemma asserting the fact that if a closed set intersects all the paths from the left to the right side in an oriented rectangle, then it contains a continuum connecting the two other sides. Note also that such a continuum can be taken as irreducible between and (by using some classical results from [13, 40]). See  for a recent survey on this subject and its connections with various different results of plane topology, as well as for a different proof based on Whyburn’s lemma.
3. Annular Regions
In this section, we are moving our attention from generalized rectangles to planar annuli, trying to develop analogous results of Section 2 in this new setting. First of all, we present some basic definitions.
A closed planar annulus (of inner radius and outer radius ) is the set
Definition 12. A topological space is called a topological annulus if it is homeomorphic to a planar annulus.
Let be a topological annulus, and let be a homeomorphism. As a consequence of the Schoenflies theorem, the set is independent of the choice of the homeomorphism . We call the set the contour of and denote it by . Clearly, for a topological annulus embedded in , the contour of coincides with the boundary of . The contour of consists of two connected components which are closed arcs (the Jordan curves) since they are homeomorphic to . We call such closed arcs and . For a planarly embedded topological annulus, they could be chosen as the inner and the outer boundaries of the annulus. In such a special case, the bounded component of turns out to be an open simply connected set with and homeomorphic to the closed unit disc. On the other hand, in the general setting, speaking of inner and outer boundaries is meaningless, yet we keep this terminology. Finally, we define the interior of as
In the sequel, we use the standard covering projection of onto , defined by the polar coordinates In the space , we consider also the translation
3.1. Crossing Properties for Annular Regions
Our aim now is to reconsider the results obtained for topological rectangles in Section 2 and adapt them to a form which may be better suited to deal with the new setting of topological annuli. We start with a version of Alexander’s lemma which reads as follows.
Lemma 13. Let be a topological annulus, and let be closed subsets of such that is connected (possibly empty). Assume that there exist two paths , with and such that Then, there exists a path , with and such that .
We say that a set is essentially embedded in if the inclusion is not homotopic to a constant map.
Lemma 14. Let be a topological annulus, and let be a closed set. Then, is essentially embedded in if and only if .
Proof. Up to a homeomorphism defining the annulus , we can assume with
In this case, and .
Suppose that , and let be the connected component of containing the origin. By the assumption, is closed and Assume, by contradiction, that is not essentially embedded in , and, therefore, the inclusion is homotopic in to a constant map, say , for all , for a suitable point . From this, it follows immediately that the mapping defined by is homotopic to a constant, which is inessential. Then, by [41, Theorem 4-5], there exists a continuous and inessential extension of with defined on . We define now the map by which is continuous. Thus, we are led to a contradiction since turns out to be a retraction of onto .
Suppose now that is essentially embedded in , and also assume, by contradiction, that there exists a path with and that , for all . Without loss of generality (taking possibly an arc inside ), we can suppose that is one to one and that for each .
Passing to the covering space of , we have that the path lifts to a family of paths with and that , for all and every . By the properties of we have that is one to one and, moreover, for (because is one to one). We have thus obtained an arc connecting the lines and and avoiding such that intersects the line exactly at one point and the same happens with respect to . Furthermore, Let , and . Note that . Let be the Jordan curve obtained by joining (in the counterclockwise sense) the point to along the line , the point to along , the point to along the line , and, finally, the point to along . The curve is the boundary of an open bounded domain with homeomorphic to the unit square . Roughly speaking, is the set of all the points of the strip between and , with the boundary arcs included. Let be a homeomorphism mapping the left side of to , the lower side of to the segment , the right side of to , and the upper side of to the segment . By the construction of the topological rectangle and since , we have that the set is mapped homeomorphically onto by the covering projection . Now we choose sufficiently small such that and we also introduce the set By construction, the set is a topological rectangle contained in and containing the set . The continuous map restricted to provides a homotopy between the identity and a constant map. This contradicts the assumption that is essentially embedded in , and the proof is complete.
A variant of the above proof has been suggested by the referee, and we wish to report it here, since it may be more interesting from a geometrical point of view. The argument is as follows.
Having obtained (as above) which is one to one, avoids the set , and intersects the inner and the outer boundaries of only at its extreme ends and , we consider a homeomorphism of the annulus onto itself such that , and . Moreover, the segment avoids the set . We lift the segment to sequence of parallel vertical lines which avoid the set . Now the topological rectangle of the preceding part of the proof turns out to be just the standard rectangle , and the set (which is mapped homeomorphically by onto ) is actually contained in for some and sufficiently small. Now we conclude precisely as before by showing that is homotopic to a constant in the rectangle .
A version of Lemma 10 for a topological annulus reads as follows.
Lemma 15. Let be a topological annulus, and let be a closed set such that . Then, there exists a compact, connected set such that (and, therefore, is essentially embedded in ).
Proof. The proof follows the same argument of the one of Lemma 10. We give the details for completeness. By Lemma 3, there exists a closed set such that , with minimal with respect to the cutting property. Suppose, by contradiction, that is not connected, and let be two closed nonempty disjoint sets with . Since is minimal and are proper subsets of , there exist two paths in which connect to such that avoids (for ). Then, by Lemma 13, there exists a path with and with , contradicting the assumption that . The continuum is also essentially embedded in by Lemma 14.
The result in Lemma 15 has been proved using a minimality argument. In some cases, the minimality of the set may be useful for the proof of some topological properties of the continuum. An example in this direction is given in the next lemma.
Lemma 16. Let be a topological annulus, and let be a compact connected set which is minimal with respect to the property of cutting all the paths in from to . Let be a nonconstant continuous function. Then, for every there exist at least two points with such that .
Proof. Without loss of generality, we can assume that and changes sign on . The existence of at least a zero for follows from Bolzano’s theorem. Suppose, by contradiction, that there is only one point say such that . Consider the two nonempty compact sets and . By the assumption, we have that and as well as . By the assumption of minimality of , it follows that there exists a path connecting to in and avoiding and, similarly, there exists a path connecting to in and avoiding . From Lemma 13 we know that there exists a path in connecting to and avoiding . This contradicts the cutting property of .
We observe that the existence of two solutions is not guaranteed if the minimality of the set is not assumed (see [42, Example 2.8]).
In the case of topological rectangles, there is a complete symmetry between the fact that a set cuts the paths between a given pair of opposite sides or it cuts the paths connecting a complementary pair of opposite sides. Thus, once we have achieved a result like Lemma 11, also its dual version, involving the other pair of sides, is guaranteed. In the case of topological annuli, the situation is different. We have just proved a result which expresses the fact that a compact set which crosses all the paths from the inner to the outer boundary must contain a continuum which nontrivially winds around the annulus. A dual result should express the fact that if a compact set intersects all the nontrivial loops of the annulus, then it must contain a continuum joining the inner and the outer boundaries of the annulus. This is precisely the content of the next lemma. To this end, we first recall some basic facts from homotopy theory. Let be a loop, which is a continuous path such that . We say that is (homotopically) trivial in if it is homotopic in to the constant loop with . Since a loop in (up to a change in the parameter) may be also seen as a continuous map , triviality of can be also expressed by the fact that there is a continuous extension with . We say that a loop in is nontrivial if it is not homotopically trivial in . Then we have the following.
Lemma 17. Let be a topological annulus, and let be a closed set such that for each nontrivial loop in . Then, there exists a compact, connected set such that
Proof. Without loss of generality (up to a homeomorphism), we suppose that with , so that has inner boundary and outer boundary . By the assumption of crossing the nontrivial loops, we know that and also .
Suppose, by contradiction, that does not contain any compact connected set satisfying (21). Then, by the Kuratowski-Whyburn lemma [13, 40], it follows that splits as the disjoint union of two compact sets with and . We pass now to the covering space of and consider the closed subsets of , By definition, . Moreover, , and both such sets are invariant with respect to the translation defined in (10). We define It is clear that , and it is actually a minimum (this follows from a standard compactness argument, using the periodicity). Then, we define the two closed -tubular neighborhoods of and as and , for We modify now a pigeonhole argument used in the proof of Theorem 1 in  as follows. Let us fix a positive integer and consider the rectangle The sets are closed and disjoint. The lower edge is the image of a path connecting the left to the right side of and avoiding the set . Similarly, via the upper edge we find a path connecting the left to the right side of and avoiding the set . Alexander’s lemma (Lemma 8) guarantees the existence of a path with and , such that for all . For each , let so that and the -tuple of points in is well defined. Clearly, by the choice of such that , there exists at least a pair of points with such that . Since we conclude that the segment joining the points and does not intersect the set (of course, such statement is trivial if ). We can now define the pathwhich takes values in and is such that Hence, the projection is a nontrivial loop in (in fact, it corresponds to in the fundamental group of ) and, by construction, . This contradicts the hypothesis, and hence, the conclusion follows.
Our last result in this section can be seen as a continuous version of the no-tie theorem for the Hex game on the annulus. See  for a discrete version of this result.
Lemma 18. Let be a topological annulus, and let be closed connected sets such that Then, .
Proof. Assume, by contradiction, that , and let . In a -neighborhood of , we can find the image of a path with and . By construction, , for all . This proves that it is not true that , and therefore (by Lemma 14) is not essentially embedded in , thus contradicting one of our assumptions.
4. A Crossing Lemma for Invariant Sets
Let be a topological space, and let be a homeomorphism. Our first result is a version of Lemma 3 for -invariant sets. Indeed, we have the following.
Lemma 19. Let be two nonempty disjoint sets which are connected by at least one path in . Let be a closed set which satisfies and is invariant for . Then, there exists a nonempty, closed set which is minimal with respect to the property of cutting the paths between and and is invariant for .
Proof. Let be the set of all the nonempty closed subsets of such that and , with the elements of ordered by inclusion. Let be a totally ordered subset of , and define . From for all , it follows that . The proof that is the same as that of Lemma 3. Thus, we obtain , and the conclusion follows from Zorn’s lemma.
Our goal now is to develop a result analog of Lemma 10 in the frame of -invariant sets. Note that if in Lemma 10 we have a continuum which is also -invariant, then by Lemma 11 we also have an -invariant continuum intersecting and .
In order to fix the ideas and before moving to the class of generalized and oriented rectangles, we consider for a moment a planar rectangle oriented in the standard manner and suppose that is a homeomorphism. Let also be a compact set which intersects all the paths in joining to such that . We are looking for the existence of a continuum with and . It is not difficult to see that, in general, the answer is negative, as shown by the following elementary example.
Example 20. Let and . Clearly, has the property of intersecting all the paths in joining the left edge to the right edge. Moreover, consistently with Lemma 10, contains two continua and connecting the lower and the upper sides of . However, if we take as a homeomorphism , that is, the symmetry with respect to the -axis, we have that , but there is no connected subset of which is invariant under .
Observe that in Example 20 the set cannot be split as the union of two disjoint closed (nonempty) subsets which are invariant. This property is also expressed by saying that , (although not connected) is invariantly connected (see [43, Definition 4.2]). If we are allowed to replace the word “connected” with “invariantly connected,” we can get a full extension of Lemma 10, as follows.
Lemma 21. Let be an oriented rectangle, let be a homeomorphism, and let be a closed set such that Then, there exists a compact, invariantly connected set such that
Proof. By Lemma 19 there exists a closed set such that , with invariant for and minimal with respect to the cutting property. Suppose, by contradiction, that is not invariantly connected, and let be two closed nonempty disjoint sets with and for . Now we conclude as in the proof of Lemma 10. Indeed, since is minimal and are proper subsets of , there exist two paths in which connect to , such that avoids (for ). Then, by Lemma 8, there exists a path with and with , contradicting the assumption that .
In order to have the connectedness of the set , we propose a partial extension of Lemma 10 by adding a further assumption on which prevents the possibility of a situation like the one described in Example 20. For simplicity in the exposition, we confine ourselves to the case of a planar rectangle . Here, we do not require to be a homeomorphism.
Lemma 22 (-invariant crossing lemma). Let , and let be a continuous map such that
Suppose that there exists a path with and such that .
Assume that there exists a compact set which cuts the paths between and and satisfies Then, there exists a compact connected set such that (i),(ii),(iii) cuts the paths between and .
Proof. As a first step, we apply Lemmas 10 and 11 which guarantee the existence of a continuum contained in which joins the lower and the upper sides of the rectangle and cuts the paths from the left to the right side in . We call such a continuum . Note that is not necessarily invariant.
In order to obtain an invariant set, we define a sequence of continua by naming Since , we also know that . By the cutting property of , we have that so that there exists with . Clearly, . On the other hand, by the hypothesis on , there exists such that and . Proceeding by induction and using step by step the hypothesis on , we obtain a monotone sequence in such that . Let . Then, passing to the limit in and , we obtain where is the set of all the points such that for every open neighborhood of it holds that for each large enough. Therefore, by a classical result from [40, Theorem 6, Chapter 5, Section 47,II], we have that is a nonempty continuum (where is the set of all the points such that for every open neighborhood of it holds that for infinitely many ). Recall that if and only if there exists a sequence with for an increasing sequence of indexes such that . Then, , with , and, therefore, . Thus, we have proved that . Conversely, for and , as above, let us fix , and, from , let us take such that . By compactness, has a convergent subsequence. Let us set . By definition, we have that . On the other hand, . This proves that .
Since we know that , we have From this, by induction, we obtain that and then, by compactness, we conclude that . The fact that is proved in the same manner. Having proved that is a continuum intersecting the horizontal edges of the rectangle, we conclude that it cuts all the paths between and .
Remark 23. Observe that the same result holds true (with an obvious modification in the proof) if we replace condition (35) with
Remark 24. By the assumption in (35), we have that where is a suitable continuous function. It easily follows that if is monotone nondecreasing, then the path satisfies the hypothesis of Lemma 22. A similar observation holds for . Hence, we easily obtain the following.
Corollary 25. Let be as in Lemma 22, and let be a continuous map satisfying (35), and suppose also that at least one between and is monotone nondecreasing. Assume that there exists a compact set which cuts the paths between and and satisfies . Then, the same conclusion of Lemma 22 holds.
Notice that in Example 20 the function is decreasing along both horizontal edges of the rectangle.
A useful property of the continua connecting two compact disjoint sets is the minimality, often named as irreducibility . Indeed, a stronger version of Lemma 10 holds, guaranteeing the existence of compact connected set which is irreducible between and (see [13, Proposition 3]).
Then, as a next step, we look for the existence of irreducible invariant continua in this new setting. Such a result, indeed, is of general nature and independent of the fact that in the present paper we consider only the case of planar continua.
Lemma 26. Let be a compact Hausdorff space, and let be a homeomorphism. Assume that are closed disjoint sets which are invariant for , and let be a continuum such that Then, there exists satisfying (45) and minimal with respect to such property.
Proof. Let be the family of all the continua which are invariant for the homeomorphism and intersect both and , with ordered by inclusion. The family is nonempty since . The existence of a minimal subcontinuum of satisfying (45) will be ensured by Zorn’s lemma.
Given any chain in , we observe that for every finite subset of indices . Hence, by compactness, is nonempty. Moreover is compact and intersects both and . Using the fact that is a homeomorphism, we obtain the invariance of . Thus, if we prove that is connected, we have that , and Zorn’s lemma allows to conclude the proof.
Assume, by contradiction, that is not connected. Then, there exist nonempty compact sets such that and . Then, there are also two open disjoint sets with and .
We claim that there exists an index such that the set . Otherwise, it would happen that which implies that . The family is a family of closed sets with the finite-intersection property, and, therefore, we obtain This is a contradiction to .
To conclude, we observe that with a connected set. Since with and , we have that and , which contradicts the fact that is connected (in fact, and are disjoint).
We conclude this paper by presenting a possible application of the above-described classical separation results to an example which is inspired by a model arising from the theory of fluid mixing previously considered by Kennedy and Yorke in . Following [17, Section 2], we consider a planar map which is the composition of a squeeze map and a rotation map . In , these two maps are defined as follows: In order to define the map we pass to the polar coordinates and require that is a counterclockwise rotation which leaves all the concentric circumferences invariant and keeps all the points of the plane with still, and, moreover, where is the angular displacement performed by on the point .
In , under the hypotheses that is a diffeomorphism and that , with not an odd multiple of , the authors prove the existence of a Smale horseshoe if is sufficiently large. In particular, there exists an invariant Cantor set on which the map is conjugate to an -shift.
We are going to prove a result which, although not so sharp like that in , makes use of weaker conditions. To be more specific, from now on, the following assumptions are made.
Let be a continuous map with which satisfies the following properties:(i) for , and for , where with we denote the th closed quadrant of the plane,(ii) and , with for ,(iii) and , with for .
Plainly speaking, leaves the quadrants invariant and moves the points of the -axis away from the origin, while it pushes the points of the -axis toward the origin. In the sequel it will be convenient to express the map (restricted to ) via its lifting to the covering space as with and continuous functions which are -periodic in the -variable. Note that the assumption , for , reflects the fact that As a second map, we consider a continuous counterclockwise rotation around the origin such that and for . We also express (restricted to ) by means of polar coordinates through its lifting with and continuous functions which are -periodic in the -variable, and assume the following conditions.
There exist and such that (i), (ii).
According to the above hypotheses, the map leaves the circumferences of center the origin and radius invariant. Moreover, the points with are rotated in the counterclockwise sense by an angle larger or equal to , while the points with are kept still.
Under the previous assumptions on and , the following result holds.
Theorem 27. Let be a homeomorphism of the annulus onto itself, and suppose also that . Then, the map has at least four fixed points in the interior of the annulus. Such result is stable with respect to small continuous perturbations of the map .
Proof. Let us denote by and the inner and outer boundaries of . We also restrict the map to the annulus and consider its lifting the covering space as
with and continuous functions which are -periodic in the -variable. By the above positions for and we have that
We also introduce a set defined as
where is the standard covering projection associated with the polar coordinates. The set is a compact subset of the annulus consisting of the points which are rotated by an angle of exactly under the action of .
Suppose that is a path with and . We express the points of in polar coordinates as and consider the angular displacement for the map along the points of , using the function By the assumptions, and . Now we apply the map to the points of . Using condition (51), we have that the angular displacement along the curve can be expressed as where is a continuous function satisfying Recalling the properties of , we find and, therefore, by the continuity of , we can conclude that . Now we can apply Lemma 15 which ensures the existence of a compact connected set which is essentially embedded into . It is also clear that (as well as ) is contained in the interior of .
Let us consider now the intersection of with the first quadrant . The boundary of such intersection consists of two segments and two arcs . We also define The set is a topological rectangle for which we give an orientation by setting By the assumptions, we see that Hence, on each path with values in connecting with there is some point where . Lemma 11 ensures the existence of a continuum with , and , for each .
We are now in a position to apply Lemma 18 which guarantees that