This paper considers a new class of additive neural networks where the neuron activations are modelled by discontinuous functions with nonlinear growth. By Leray-Schauder alternative theorem in differential inclusion theory, matrix theory, and generalized Lyapunov approach, a general result is derived which ensures the existence and global asymptotical stability of a unique periodic solution for such neural networks. The obtained results can be applied to neural networks with a broad range of activation functions assuming neither boundedness nor monotonicity, and also show that Forti's conjecture for discontinuous neural networks with nonlinear growth activations is true.
1. Introduction
The stability of neural networks, which includes the stability of periodic solution and the stability of equilibrium point, has been extensively studied by many authors so far; see, for example, [1–15]. In [1–4], the authors investigated the stability of periodic solutions of neural networks with or without time delays, where the assumptions on neuron activation functions include Lipschitz conditions, bounded and/or monotonic increasing property. Recently, in [13–15], the authors discussed global stability of the equilibrium points for the neural networks with discontinuous neuron activations. Particularly, in [14], Forti conjectures that all solutions of neural networks with discontinuous neuron activations converge to an asymptotically stable limit cycle whenever the neuron inputs are periodic functions. As far as we know, there are only works of Wu in [5, 7] and Papini and Taddei in [9] dealing with this conjecture. However, the activation functions are required to be monotonic in [5, 7, 9] and to be bounded in [5, 7].
In this paper, without assumptions of the boundedness and the monotonicity of the activation functions, by the Leray-Schauder alternative theorem in differential inclusion theory and some new analysis techniques, we study the existence of periodic solution for discontinuous neural networks with nonlinear growth activations. By constructing suitable Lyapunov functions we give a general condition on the global asymptotical stability of periodic solution. The results obtained in this paper show that Forti's conjecture in [14] for discontinuous neural networks with nonlinear growth activations is true.
For later discussion, we introduce the following notations.
Let , where the prime means the transpose. By (resp., ) we mean that (resp., ) for all . denotes the Euclidean norm of . denotes the inner product. denotes 2-norm of matrix , that is, , where denotes the spectral radius of .
Given a set , by we denote the closure of the convex hull of , and denotes the collection of all nonempty, closed, and convex subsets of . Let be a Banach space, and denotes the norm of , . By we denote the Banach space of the Lebesgue integrable functions : equipped with the norm . Let be a locally Lipschitz continuous function. Clarke’s generalized gradient [16] of at is defined by
where is the set of Lebesgue measure zero where does not exist, and is an arbitrary set with measure zero.
The rest of this paper is organized as follows. Section 2 develops a discontinuous neural network model with nonlinear growth activations, and some preliminaries also are given. Section 3 presents the proof on the existence of periodic solution. Section 4 discusses global asymptotical stability of the neural network. Illustrative examples are provided to show the effectiveness of the obtained results in Section 5.
2. Model Description and Preliminaries
The model we consider in the present paper is the neural networks modeled by the differential equation
where is the vector of neuron states at time ; is an matrix representing the neuron inhibition; is an neuron interconnection matrix; , , represents the neuron input-output activation and is the continuous -periodic vector function denoting neuron inputs.
Throughout the paper, we assume that
: has only a finite number of discontinuity points in every compact set of . Moreover, there exist finite right limit and left limit at discontinuity point .
has the nonlinear growth property, that is, for all
where , are constants, and .
: for all , where is a constant.
Under the assumption , is undefined at the points where is discontinuous. Equation (2.1) is a differential equation with a discontinuous right-hand side. For (2.1), we adopt the following definition of the solution in the sense of Filippov [17] in this paper.
Definition 2.1. Under the assumption , a solution of (2.1) on an interval with the initial value is an absolutely continuous function satisfying
It is easy to see that : is an upper semicontinuous set-valued map with nonempty compact convex values; hence, it is measurable [18]. By the measurable selection theorem [19], if is a solution of (2.1), then there exists a measurable function such that
Consider the following differential inclusion problem
It easily follows that if is a solution of (2.5), then defined by
is an -periodic solution of (2.1). Hence, for the neural network (2.1), finding the periodic solutions is equivalent to finding solutions of (2.5).
Definition 2.2. The periodic solution with initial value of the neural network (2.1) is said to be globally asymptotically stable if is stable and for any solution , whose existence interval is , we have .
Lemma 2.3. If is a Banach space, is nonempty closed convex with and is an upper semicontinuous set-valued map which maps bounded sets into relatively compact sets, then one of the following statements is true: (a)the set is unbounded; (b)the has a fixed point in , that is, there exists such that .
Lemma 2.3 is said to be the Leray-Schauder alternative theorem, whose proof can be found in [20]. Define the following:
then is a class of norms of , , and are Banach space under the norm .
If is (i) regular in [16]; (ii) positive definite, that is, for , and ; (iii) radially unbounded, that is, as , then is said to be C-regular.
Lemma 2.4 (Chain Rule [15]). If is C-regular and is absolutely continuous on any compact interval of , then and are differential for a.e. , and one has
3. Existence of Periodic Solution
Theorem 3.1. If the assumptions and hold, then for any , (2.1) has at least a solution defined on with the initial value .
Proof. By the assumption , it is easy to get that : is an upper semicontinuous set-valued map with nonempty, compact, and convex values. Hence, by Definition 2.1, the local existence of a solution for (2.1) on , , with , is obvious [17].
Set . Since is a continuous -periodic vector function, is bounded, that is, there exists a constant such that , . By the assumption , we have
By , we can choose a constant , such that when ,
By (2.4), (3.1), (3.2), and the Cauchy inequality, when ,
Therefore, let , then, by (3.3), it follows that on . This means that the local solution is bounded. Thus, (2.1) has at least a solution with the initial value on . This completes the proof.
Theorem 3.1 shows the existence of solutions of (2.1). In the following, we will prove that (2.1) has an -periodic solution.
Let for all , then is a linear operator.
Proposition 3.2. is bounded, one to one and surjective.
Proof. For any , we have
this implies that is bounded.
Let . If , then
By the assumption ,
Noting , we have
By (3.6),
Hence . It follows . This shows that is one to one.
Let . In order to verify that is surjective, in the following, we will prove that there exists such that
that is, we will prove that there exists a solution for the differential equation
Consider Cauchy problem
It is easily checked that
is the solution of (3.11). By (3.12), we want , then
that is,
By the assumption , is a nonsingular matrix, where is a unit matrix. Thus, by (3.14), if we take as
in (3.12), then (3.12) is the solution of (3.10). This shows that is surjective. This completes the proof.
By the Banach inverse operator theorem, is a bounded linear operator.
For any , define the set-valued map as
Then has the following properties.
Proposition 3.3. has nonempty closed convex values in and is also upper semicontinuous from into endowed with the weak topology.
Proof. The closedness and convexity of values of are clear. Next, we verify the nonemptiness. In fact, for any , there exists a sequence of step functions such that and a.e. on . By the assumption (1) and the continuity of , we can get that is graph measurable. Hence, for any , admits a measurable selector . By the assumption (2), is uniformly integrable. So by Dunford-Pettis theorem, there exists a subsequence such that weakly in . Hence, from [21, Theorem 3.1], we have
Noting that is an upper semicontinuous set-valued map with nonempty closed convex values on for a.e. , . Therefore, . This shows that is nonempty.
At last we will prove that is upper semicontinuous from into . Let be a nonempty and weakly closed subset of , then we need only to prove that the set
is closed. Let and assume in , then there exists a subsequence such that a.e. on . Take , , then By the assumption (2) and Dunford-Pettis theorem, there exists a subsequence such that weakly in . As before we have
This implies , that is, is closed in . The proof is complete.
Theorem 3.4. Under the assumptions and , there exists a solution for the boundary-value problem (2.5), that is, the neural network (2.1) has an -periodic solution.
Proof. Consider the set-valued map . Since is continuous and is upper semicontinuous, the set-valued map is upper semicontinuous. Let be a bounded set, then
is a bounded subset of . Since is a bounded linear operator, is a bounded subset of . Noting that is compactly embedded in , is a relatively compact subset of . Hence by Proposition 3.3, is the upper semicontinuous set-valued map which maps bounded sets into relatively compact sets.
For any , when , by (3.1) and the Cauchy inequality,
Arguing as (3.2), we can choose a constant , such that when ,
Therefore, when , by (3.21),
Set
In the following, we will prove that is a bounded subset of . Let , then , that is, . By the definition of , there exists a measurable selection , such that
By (3.23) and (3.25), . Otherwise, . By , we have . Since is continuous, we can choose , such that
Thus, there exists a constant , such that when , . By (3.23) and (3.25),
This is a contradiction. Thus, for any . Furthermore, we have
This shows that is a bounded subset of .
By Lemma 2.3, the set-valued map has a fixed point, that is, there exists such that , . Hence there exists a measurable selection , such that
By the definition of , . Moreover, by Definition 2.1 and (3.29), is a solution of the boundary-value problem (2.5), that is, the neural network (2.1) has an -periodic solution. The proof is completed.
4. Global Asymptotical Stability of Periodic Solution
Theorem 4.1. Suppose that and the following assumptions are satisfied.
: for each , there exists a constant , such that for all two different numbers , for all and for all
: