Nonlinear Systems: Asymptotic Methods, Stability, Chaos, Control, and Optimization
View this Special IssueResearch Article  Open Access
ChingHung Lee, FengYu Chang, "Interval Type2 Recurrent Fuzzy Neural System for Nonlinear Systems Control Using Stable Simultaneous Perturbation Stochastic Approximation Algorithm", Mathematical Problems in Engineering, vol. 2011, Article ID 102436, 21 pages, 2011. https://doi.org/10.1155/2011/102436
Interval Type2 Recurrent Fuzzy Neural System for Nonlinear Systems Control Using Stable Simultaneous Perturbation Stochastic Approximation Algorithm
Abstract
This paper proposes a new type fuzzy neural systems, denoted IT2RFNSA (interval type2 recurrent fuzzy neural system with asymmetric membership function), for nonlinear systems identification and control. To enhance the performance and approximation ability, the triangular asymmetric fuzzy membership function (AFMF) and TSKtype consequent part are adopted for IT2RFNSA. The gradient information of the IT2RFNSA is not easy to obtain due to the asymmetric membership functions and interval valued sets. The corresponding stable learning is derived by simultaneous perturbation stochastic approximation (SPSA) algorithm which guarantees the convergence and stability of the closedloop systems. Simulation and comparison results for the chaotic system identification and the control of Chua's chaotic circuit are shown to illustrate the feasibility and effectiveness of the proposed method.
1. Introduction
In the past few decades, the fuzzy neural network (FNN) which provides the advantages of both neural network and fuzzy system is successfully applied to nonlinear system identification and control [1–4]. In the FNN, the symmetric and fixed membership functions (MFs) are commonly adopted to simplify the design procedure. However, a large number of fuzzy rules should be used to achieve the specified performance [5, 6]. Thus, an asymmetric fuzzy membership function (AFMF) has been proposed to solve this problem. The AFMF is discussed and analyzed that it can effectively improve the accuracy and reduce the fuzzy rules [7, 8].
Recently, the type2 fuzzy sets (T2 FSs) are gaining more and more in popularity [9, 10]. The T2 FSs are described by MFs that are characterized by more parameters than the type1 fuzzy sets (T1 FSs). Hence, the T2 FSs provide us with more design degree of freedom. Nevertheless, due to the computational complexity of using the T2 FS, most people only the interval type2 fuzzy sets (IT2 FSs) are proposed [10]. The computations associated with IT2 FSs are very manageable which makes it quite practical [11]. In our previous research [12–15], we proposed a type2 fuzzy neural network with asymmetric membership function (T2FNNA) which combines interval type2 fuzzy logic system with neural network. Then, in order to improve the efficiency of the T2FNNA, we proposed an interval type2 fuzzy neural system with AFMFs (IT2FNSA) which utilizes several enhanced techniques such as TakagiSugenoKang fuzzy logic system (TSK FLS) and embedded typereduction network layer [16]. These modifications not only improve the approximation accuracy of the T2FNNA, but also achieve the specific performance with fewer fuzzy rules. However, a major drawback of the IT2FNSA is that its application domain is limited to static problem due to its feedforward network structure. Thus, using IT2FNSA to process dynamic problems is inefficient. Many results have been shown that recurrent system can learn and memorize information to provide better performance [2, 17–20]. In this paper, we propose an interval type2 recurrent fuzzy neural system with AFMFs (IT2RFNSA) which provides the memory elements and extends the basic ability of the IT2FNSA to include the dynamic problems. In addition, since the feedback layer captures the dynamic response of the system, the approximation accuracy of the network is improved.
In training neural networks, the backpropagation (BP) algorithm is widely used. However, the differential information of system is difficult to obtain due to the piecewise continuous property of triangular AFMFs and since there are many adjustable parameters in the IT2RFNSA. Herein, we adopt the simultaneous perturbation stochastic approximation (SPSA) algorithm to derive the update laws of the proposed IT2RFNSA. The SPSA algorithm is based on the approximation to gradient information from the measurements of the objective function [21–23]. Hence, a great deal of computational effort is saved. However, due to the stochastic characteristic of SPSA algorithm, we cannot guarantee that every searching step length is appropriate which may lead to the invalid search. To overcome this situation, we employ the Lyapunov stability analysis to derive the optimal learning step length for guaranteeing the stability of the closedloop system. In addition, the efficient training is also ensured.
The remainder of this paper is organized as follows. In Section 2, the construction of triangular AFMFs and the SPSA algorithm are introduced. Section 3 illustrates the proposed IT2RFNSA and the stable SPSA learning algorithm. The simulation results on chaotic system identification and control of the Chua’s chaotic circuit are shown in Section 4. Finally, the conclusion is given.
2. Preliminaries
In this section, we briefly introduce some prerequisite material including the interval type2 asymmetric fuzzy membership function (IT2 AFMF) and simultaneous perturbation stochastic approximation (SPSA) algorithm.
2.1. Interval Type2 Asymmetric Fuzzy Membership Function (IT2 AFMF)
The interval type2 membership function (IT2 MF) is considered to be a special case of a general type2 membership function (T2 MF) which simplifies the computational effort significantly [10, 11]. In general, the symmetric MF is used for simplification. However, the symmetric MF only holds either uncertain mean or uncertain variance. In addition, tuning the parameter of MFs symmetrically may result in low precision. The AFMF can treat these problems.
In this paper, the triangular fuzzy MFs are used to construct the interval type2 asymmetric fuzzy membership functions (IT2 AFMFs) due to their lower computational effort. Each IT2 AFMF consists of upper and lower MFs, as shown in Figure 1. The upper MF is defined as where , , and denote the positions of three corners satisfying . Similarly, the lower MF is defined as where , , and denote the positions of three corners satisfying and denotes the magnitude of lower MF which should be limited between 0.5 and 1 to avoid the invalid result (a small firing strength). As above description, the following restrictions should be constrained to avoid unreasonable IT2 AFMFs: , , , , .
2.2. Simultaneous Perturbation Stochastic Approximation (SPSA) Algorithm
This section introduces the SPSA algorithm briefly. The detailed description can be found in literature [23]. Consider the optimization problem with an objective function , the SPSA algorithm updates by where is the estimated gradient result of objective function with respect to W, that is, . denotes the learning step length which is decreased over iterations with , where , , and are positive configuration coefficients [23]. The SPSA approach estimates the gradient, , using the following method. Assume that the dimension of parameter is . Let be a dimensional vector whose element is mutually independent zeromean random variable. Then, the estimation of the gradient at kth iteration can be computed by where is gain sequence that is also decreased with , where and are nonnegative configuration coefficients [23]. Obviously, all elements of are perturbed simultaneously and only two measurements of the objective function are needed to estimate the gradient. In addition, is usually obtained using Bernoulli distribution with equal probability for each value.
In general, the gradient information of neural fuzzy system is not easy to obtain due to the piecewise continuous property of AFMFs and large number of adjustable parameters. Herein, we adopt the SPSA algorithm to derive the stable learning for guaranteeing the convergence and stability of the closedloop systems.
3. Interval Type2 Recurrent Fuzzy Neural System with Asymmetric Membership Function (IT2RFNSA)
3.1. Fuzzy Reasoning of IT2RFNSA
The proposed IT2RFNSA realizes the fuzzy inference into the network structure. Assume that an IT2RFNSA system has rules and inputs, the th rule can be expressed as where is input linguistic variable of the th rule, are interval type2 antecedent fuzzy sets, are consequent interval fuzzy set, is the network input, and is the output of the th rule. Note that the input linguistic variable has the system input term and the past information which is introduced in Section 3.2. As the above description of T2 FLSs, the membership grade is an interval valued set which consists of the lower and upper membership grades, that is, and the consequent part is where denotes the center of and denotes the spread of . Therefore, using the product tnorm, the firing strength associated with the th rule is where and . Thus, the consequent part of the th rule is By applying the Extension principle [24], the output of the FLS is To compute , we need to compute its two endpoints and by typereduction operation. Karnik and Mendel developed an iterative algorithm which is known as KM algorithm to compute these two endpoints [24, 25]. A type reducer combines all firedrule output sets in some way, just like a type2 defuzzifier combines the type1 rule output sets, which leads to a T1 FS that is called a typereduced set. Herein, we need to compute the leftend point and rightend point by utilizing the KM algorithm [24, 25]. In the KM algorithm, the leftend and rightend points are represented as Then, we have to find the proper switch point value and by iterative procedure where more detail can be referred to [24, 25]. However, this iterative procedure for finding switch point values is time wasting. Hence, in the proposed IT2RFNSA, a simple weightaverage method is used to approximate the and so that the iterative procedure is unnecessary. That is, we can calculate the leftmost and rightmost point of firing strength by where , , , and are adjustable weights. Then, we can obtain the following leftend point and rightend point of the output of interval type2 fuzzy inference system Note that the above simplified typereduction technique is adopted in layer 4 (leftmost and rightmost layer) and feedback layer of IT2RFNSA system. This simplifies the computational effort in typereduction procedure. Finally, we defuzzify the typereduced set to get a crisp output, that is,
3.2. Network Structure of IT2RFNSA
The proposed IT2RFNSA consists of six feedforward layers and a feedback one. Layer 1 accepts input variables. Layer 2 is used to calculate the IT2 AFMF grade. The feedback layer embedded in Layer 2 is used to store the past information. Layer 3 forms the fuzzy rule base. Layer 4 introduces the simplified typereduction scheme, called leftmost and rightmost layer. The TSKtype consequent part is implemented into Layer 5. Layer 6 is the output layer.
Next, we indicate the signal propagation and the operation functions of the node in each layer. For convenience, the multiinputsingleoutput case is considered here. The schematic diagram of the proposed IT2RFNSA is shown in Figure 2. In the following description, denotes the ith output node in layer l.
Layer 1: Input Layer
For the ith node of layer 1, the net input and output are represented as
where represents the th input to the th node. The nodes in this layer only transmit input to the next layer directly.
Layer 2: Membership Layer
In this layer, each node performs a triangular IT2 AFMF, that is,
where the subscript indicates the th term of the th input and is an IT2 AFMF as shown in Figure 1 and (3.2). Note that the output of layer 2 and the feedback weight are interval values. According to the above description and the results of literature [26], the type reduction is embedded in the network. Herein, the output of feedback layer is expressed as
where and denote the link weight of the feedback layer. Clearly, the input of this layer contains the memory terms and which store the past information of the network.
Layer 3: Rule Layer
This layer is used for computing firing strength of fuzzy rule. From (3.4), we obtain
where and are the lower and upper membership grades. Therefore, the operation function in this layer is
Layer 4: LeftMost & RightMost layer
Similar to the feedback layer, the type reduction is integrated into the network structure by calculating their leftmost and rightmost values. That is, the complicated typereduction method such as KM algorithm can be reduced as
where the link weights are , , , and . These link weights are adjusted by the proposed stable SPSA learning algorithm. Note that and .
Layer 5: TSK Layer
From (3.5), the TSKtype consequent part is
Then, the output of this layer is
Layer 6: Output Layer
Layer 6 is the output layer which is used to implement the defuzzification operation. Therefore, the crisp output is
Obviously, the total design parameters of IT2RFNSA are , , , , , , λ, , , , , , and . These parameters are adjusted by the proposed stable SPSA learning algorithm which guarantees the convergence of IT2RFNSA systems.
3.3. Training of IT2RFNSA by the Stable SPSA Algorithm
Consider the nonlinear control problem, our goal is to generate a proper control sequence such that the system output follows the desired trajectory , where is the discretetime index. The IT2RFNSA with the stable SPSA algorithm plays the role of controller for nonlinear plant, the adaptive control scheme is shown in Figure 3. For convenience, we consider the singleoutput case and the tracking error is defined as Then, we define the objective function (error cost function) as The control objective is to generate the control signal such that the tracking error approaches to zero, that is, to minimize the objective function . From the wellknown gradient descent method, the parameter update law can be written as where is the tuning parameters of IT2RFNSA. Then, Herein, we adopt the SPSA algorithm to reduce the computational complexity. The parameters update laws can be represented as where where denotes the tracking error between the desired output and system output resulted by the IT2RFNSA with perturbed tuning parameters. Note that (3.25) does not calculate the system sensitivity or gradient functions; this simplifies the computational effort.
Note that, in training neural networks, it may not be possible to update all estimated parameters with a single gradient approximation function (3.25). Thus, we should partition the estimated parameters into several parts, that is, each kind of parameter has its corresponding estimated parameter (e.g., as the estimated link weight of feedback layer). Then, the estimated parameters are updated separately by the SPSA algorithm.
Remark 3.1. As the previous results of [1, 2, 4], the adaptive control laws can be obtained by multiplying system sensitivity , that is, where is the control input produced by the IT2RFNSA, that is, . Hence, the gradient of the IT2RFNSA should be calculated. However, an additional identifier (using a FNN or an IT2RFNSA) should be developed to find the unknown system’s sensitivity (details can be found in [1, 2]). In this way, the approximation accuracy should be guaranteed for training the IT2RFNSA controller and the computational effort is complex and huge. Therefore, an approximation term of and the optimal learning step length are derived to enhance the efficiency and guarantee the stability, where denotes and for continuous and discrete time case, respectively.
Remark 3.2. Our proposed approach is also valid for the nonlinear system identification. The seriesparallel architecture shown in Figure 4 is adopted. Hence, the inputs of IT2RFNSA are and and the IT2RFNSA output is the estimated output . The parameters of IT2RFNSA are tuned by the proposed stable SPSA algorithm. Thus, the parameter update law is where denotes the output of the IT2RFNSA with perturbed tuning parameters.
3.4. Stability Analysis
In this section, the convergence theorem for selecting appropriate learning step length is introduced. The choice of learning step length is very important for convergence. If a small value is given for the learning step length, then the convergence of the IT2RFNSA is guaranteed. However, the convergent speed may be slow. On the other hand, if a large value is selected, then the system may be unstable. Hence, we employ the Lyapunov stability approach to have the condition for convergence and find the optimal learning step length for IT2RFNSA.
Theorem 3.3. Let be the learning step length of tuning parameters for the IT2RFNSA controller. Consider the nonlinear control problem using IT2RFNSA (shown in Figure 3), the asymptotic convergence of the closedloop system is guaranteed if the learning step length is chosen satisfying where is the gradient estimation using SPSA approach. In addition, the faster convergence can be obtained by the following optimal timevarying learning step length
Proof. First, we define the discretetime Lyapunov function as follows: where represents the tracking error. Then, the change of the Lyapunov function is According to the Lyapunov stability theorem, if the change of the positive definite Lyapunov function, denoted , satisfies the condition , for all , then the asymptotical stability is guaranteed [1, 2, 27]. Hence, our objective is to select the proper learning step length such that , for all . This implies that will converge to zero when approaches to infinity. By [1, 2, 28], the error difference can be represented as where denotes the change of . From (3.22) and (3.24), we obtain Thus, Note that is positive for all , and let . Thus, Recall that the asymptotical stability of the IT2RFNSA is guaranteed if , for all . Thus, should be positive such that , for all . Therefore, we obtain the stability condition for : The asymptotic stability is guaranteed if is chosen to satisfy (3.36). In addition, we would like to find a condition for that guarantees the fast convergence. From (3.34) and (3.35), we have The minimum of is achieved when . Hence, the timevarying optimal learning step length is
For the system identification problem, a similar convergence theorem can be obtained.
Theorem 3.4. Let be the learning step length of tuning parameters for the IT2RFNSA. Consider the nonlinear identification problem by seriesparallel architecture using IT2RFNSA (shown in Figure 4), and the parameters update laws are shown in (3.27). The asymptotic convergence of the IT2RFNSA system is guaranteed if the chosen learning step length is satisfied: where is the gradient estimation of IT2RFNSA by SPSA approach. In addition, the faster convergence can be obtained by using the following optimal timevarying learning step length:
Proof. Herein, we omitted it due to that the proof of Theorem 3.4 is similar to the proof of Theorem 3.3. Only the express of the estimated gradient function is replaced by .
Remark 3.5. As above description, the SPSA algorithm has the stochastic property in the estimation of gradient functions and due to the random values and . Therefore, the stability conditions (3.28) and (3.39) are important for training. In addition, the timevarying optimal learning step lengths and , shown in (3.29) and (3.40), have the ability of guaranteeing the highspeed convergence. This reduces the effect of random values. Simulation results in Section 4 demonstrate the performance of our approach.
4. Simulation Results
Simulation results and comparisons, including the nonlinear system identification and the control of nonlinear system, are introduced to verify the performance of our proposed approach.
4.1. Example 1: Nonlinear System Identification of Chaotic System
Consider a nonlinear system described as where denotes the input, is the output, and are positive integers, and is the unknown function . Our purpose is to identify the nonlinear system (4.1) using IT2RFNSA with the proposed stable SPSA algorithm. From literature [2], the chaotic system is described as where and and produces a chaotic strange attractor as shown in Figure 5(a). We first choose 1000 pairs training data randomly from the system over the interval [−1.5 1.5] and the initial point is set to. Then, the IT2RFNSA is used to approximate the chaotic system using the stable SPSA algorithm with the following coefficients listed in Table 1. After training for 100 epochs, the phase plane of the chaotic system is shown in Figure 5(b). In order to show the superiority of using optimal learning step length, the same simulation is done without using optimal learning step length for comparison. In addition, we also compare it with other neural networks such as fuzzy neural network (FNN) [1], recurrent fuzzy neural network (RFNN) [2], and interval type2 fuzzy logic system with asymmetric membership function (IT2FNSA) [16]. For statistical analysis, the learning process is repeated for 10 independent runs. The descending trend of the mean square error (MSE) is shown in Figure 6, solidblack line: IT2RFNSA with the optimal learning step length ; solidred line: IT2RFNSA without the optimal learning step length; dashed line: IT2FNSA; dotted line: RFNN; dashdotted line: FNN. The worst, average, and best MSE that each neural network achieved are shown in Table 2. Obviously, the IT2RFNSA with optimal learning step length achieves the best performance and if we focus on using optimal learning step length or not, then we can find that there is a great improvement. From Figure 6, we can observe that using optimal learning step length results in better performance in convergence. Hence, we accumulate the number of epochs that MSE decreased in 100 epochs and listed in Table 3. The result, evidently, shows that the optimal learning step length can guarantee the efficient training of IT2RFNSA.



(a)
(b)
4.2. Nonlinear System Control of Chua’s Chaotic Circuit
Consider an nthorder nonlinear dynamic system in the companion form or controllability canonical from where and are the control input and output of the nonlinear system, and are unknown nonlinear and continuous functions, and is the external disturbance or system uncertainty. Our purpose is to develop an IT2RFNSA controller to generate the proper control signal such that the system output can follow a given reference trajectory y_{r}.
In this paper, we consider the typical Chua’s chaotic circuit which consists of one inductor, two capacitors, one linear resistor, and one piecewiselinear resistor [29, 30]. It has been shown that this circuit holds very rich nonlinear dynamics such as chaos and bifurcations. The dynamic equation of Chua’s circuit are described as where voltages , and current are state variables, is a constant, and denotes the nonlinear resistor which is a function of voltage across two terminals of . is defined as a cubic function as According to [30], (4.4) can be transferred into the canonical form as where , , and is the external disturbance and is assumed to be a squarewave with amplitude and period . Herein, the objective is to track the reference trajectory . We choose the initial state value as and sampling time as 0.01 second.
For comparison, the same simulations are done by using IT2FNSA and the case without optimal learning step length. The used coefficients are listed in Table 4. The simulation results of trajectories are shown in Figure 7. Figure 7(a) shows the phase plant trajectory after being controlled; Figures 7(b)–7(d) shows the state trajectories , , and , respectively (solid line: actual system output; dashed line: reference trajectory). Figure 8 depicts the control effort of the IT2RFNSA controller. We can observe that the proposed method is valid to control a nonlinear dynamic system. The comparison results are shown in Table 5 which is obtained by 10 independent runs. From Table 5, we can easily find that the IT2RFNSA performs better than others. This result shows that the IT2RFNSA has ability to cope with dynamic problems. Observe the performance of the case with optimal learning step length from Table 5, we again demonstrate that adopting optimal learning step length guarantees the efficient training of IT2RFNSA.


(a)
(b)
(c)
(d)
5. Conclusion
In this paper, we have proposed an interval type2 recurrent fuzzy neural system with triangular asymmetric membership functions (IT2RFNSA) and its training scheme using the proposed stable SPSA algorithm. We adopt the Lyapunov theorem to derive the appropriate range of learning step length for SPSA to guarantee the stability of the closedloop system for nonlinear control and guarantee the convergence of IT2RFNSA for system identification. In addition, we also obtain the optimal learning step length that ensures the efficient training for IT2RFNSA. The feasibility and the effectiveness of the proposed method have been demonstrated by two illustration examples. The simulations on the chaotic system identification and the control of the Chua’s chaotic circuit are done, and both of them show the following advantages of proposed approach, (a) the IT2RFNSA having few rules can achieve the specific performance or even better; (b) the IT2RFNSA can catch the dynamic response of the system; that is, it is capable of coping with dynamic problems; (c) by using the proposed stable SPSA algorithm, the gradient information is unnecessary. In other words, a great deal of computational effort is saved; (d) for control problems, the proposed method avoids approximating the system sensitivity which leads to inaccuracy; (e) adopting optimal learning step length improves the performance of training IT2RFNSA.
Acknowledgments
The authors would like to thank the Associate Editor and anonymous reviewers for their insightful comments and valuable suggestions. This work was partially supported by the National Science Council, Taiwan, under contract no: NSC972221E155033MY3.
References
 Y. C. Chen and C. C. Teng, “A model reference control structure using a fuzzy neural network,” Fuzzy Sets and Systems, vol. 73, no. 3, pp. 291–312, 1995. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 C. H. Lee and C. C. Teng, “Identification and control of dynamic systems using recurrent fuzzy neural networks,” IEEE Transactions on Fuzzy Systems, vol. 8, no. 4, pp. 349–366, 2000. View at: Publisher Site  Google Scholar
 Y. Gao and M. J. Er, “Online adaptive fuzzy neural identification and control of a class of MIMO nonlinear systems,” IEEE Transactions on Fuzzy Systems, vol. 11, no. 4, pp. 462–477, 2003. View at: Publisher Site  Google Scholar
 R. J. Wai and P. C. Chen, “Intelligent tracking control for robot manipulator including actuator dynamics via TSKtype fuzzy neural network,” IEEE Transactions on Fuzzy Systems, vol. 12, no. 4, pp. 552–559, 2004. View at: Publisher Site  Google Scholar
 A. Lotfi and A. C. Tsoi, “Learning fuzzy inference systems using an adaptive membership function scheme,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 26, no. 2, pp. 326–331, 1996. View at: Publisher Site  Google Scholar
 C. H. Lee and C. C. Teng, “Fine tuning of membership functions for fuzzy neural systems,” Asian Journal of Control, vol. 3, no. 3, pp. 216–225, 2001. View at: Google Scholar
 P. Z. Lin and T. T. Lee, “Robust selforganizing fuzzyneural control using asymmetric Gaussian membership functions,” International Journal of Fuzzy Systems, vol. 9, no. 2, pp. 77–86, 2007. View at: Google Scholar
 C. H. Lee and H. Y. Pan, “Performance enhancement for neural fuzzy systems using asymmetric membership functions,” Fuzzy Sets and Systems, vol. 160, no. 7, pp. 949–971, 2009. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 L. A. Zadeh, “The concept of a linguistic variable and its application to approximate reasoning1,” Information Sciences, vol. 8, no. 3, pp. 199–249, 1975. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 Q. Liang and J. M. Mendel, “Interval type2 fuzzy logic systems: theory and design,” IEEE Transactions on Fuzzy Systems, vol. 8, no. 5, pp. 535–550, 2000. View at: Publisher Site  Google Scholar
 J. M. Mendel, “On the importance of interval sets in type2 fuzzy logic systems,” in Proceedings of the Joint 9th IFSA World Congress and 20th NAFIPS International Conference, pp. 1647–1652, Vancouver, BC, Canada, July 2001. View at: Google Scholar
 C. H. Lee, J. L. Hong, Y. C. Lin, and W. Y. Lai, “Type2 fuzzy neural network systems and learning,” International Journal of Computational Cognition, vol. 1, no. 4, pp. 79–90, 2003. View at: Google Scholar
 C. H. Lee, Y. C. Lin, and W. Y. Lai, “Systems identification using type2 fuzzy neural network (type2 FNN) systems,” in Proceedings of the IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA '03), vol. 3, pp. 1264–1269, 2003. View at: Publisher Site  Google Scholar
 C. H. Lee and Y. C. Lin, “Control of nonlinear uncertain systems using type2 fuzzy neural network and adaptive filter,” in Proceedings of the IEEE International Conference on Networking, Sensing and Control, vol. 2, pp. 1177–1182, March 2004. View at: Google Scholar
 C. H. Lee and Y. C. Lin, “An adaptive type2 fuzzy neural controller for nonlinear uncertain systems,” Control and Intelligent Systems, vol. 12, no. 1, pp. 41–50, 2005. View at: Google Scholar
 C. H. Lee, F. Y. Chang, and C. T. Lee, “Speciesbased hybrid of electromagnetismlike mechanism and backpropagation algorithms for an interval type2 fuzzy system design,” in Proceedings of the International MultiConference of Engineers and Computer Scientists (IMECS '10), Lecture Notes in Engineering and Computer Science, pp. 140–145, Hong Kong, March 2010. View at: Google Scholar
 G. C. Mouzouris and J. M. Mendel, “Nonsingleton fuzzy logic systems: theory and application,” IEEE Transactions on Fuzzy Systems, vol. 5, no. 1, pp. 56–71, 1997. View at: Publisher Site  Google Scholar
 J. Zhang and A. J. Morris, “Recurrent neurofuzzy networks for nonlinear process modeling,” IEEE Transactions on Neural Networks, vol. 10, no. 2, pp. 313–326, 1999. View at: Publisher Site  Google Scholar
 C. F. Juang, “A TSKtype recurrent fuzzy neural network for dynamic systems processing by neural network and genetic algorithm,” IEEE Transactions on Fuzzy Systems, vol. 10, no. 2, pp. 155–170, 2002. View at: Publisher Site  Google Scholar
 J. B. Theocharis, “A highorder recurrent neurofuzzy system with internal dynamics: application to the adaptive noise cancellation,” Fuzzy Sets and Systems, vol. 157, no. 4, pp. 471–500, 2006. View at: Publisher Site  Google Scholar
 J. C. Spall, “Multivariate stochastic approximation using a simultaneous perturbation gradient approximation,” IEEE Transactions on Automatic Control, vol. 37, no. 3, pp. 332–341, 1992. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 J. C. Spall and J. A. Cristion, “Model free control of nonlinear stochastic systems with discretetime measurements,” IEEE Transactions on Automatic Control, vol. 43, no. 9, pp. 1198–1210, 1998. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 J. C. Spall, Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control, John Wiley & Sons, Hoboken, NJ, USA, 2003.
 N. N. Karnik and J. M. Mendel, “Centroid of a type2 fuzzy set,” Information Sciences, vol. 132, no. 1–4, pp. 195–220, 2001. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 J. M. Mendel, Uncertain Rulebased Fuzzy Logic Systems: Introduction and New Directions, PrenticeHall, Upper Saddle River, NJ, USA, 2001. View at: Zentralblatt MATH
 J. R. Castro, O. Castillo, P. Melin, and R. Díaz, “A hybrid learning algorithm for a class of interval type2 fuzzy neural networks,” Information Sciences, vol. 179, no. 13, pp. 2175–2193, 2009. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 J. J. E. Slotine and W. Li, Applied Nonlinear Control, PrenticeHall, Upper Saddle River, NJ, USA, 1991.
 T. Yabuta and T. Yamada, “Learning control using neural networks,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '91), pp. 740–745, Sacramento, Calif, USA, April 1991. View at: Google Scholar
 Y. H. Joo, L. S. Shieh, and G. Chen, “Hybrid state space fuzzy model based controller with dualrate sampling for digital control of chaotic systems,” IEEE Transactions on Fuzzy Systems, vol. 7, no. 4, pp. 394–408, 1999. View at: Publisher Site  Google Scholar
 C. H. Wang, T. C. Lin, T. T. Lee, and H. L. Liu, “Adaptive hybrid intelligent control for uncertain nonlinear dynamical systems,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 32, no. 5, pp. 583–597, 2002. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2011 ChingHung Lee and FengYu Chang. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.