Abstract
For large-scale distributed systems, the evolution of system dynamics is dominated by current states and boundary conditions simultaneously. This work describes a distributed consensus filtering for a class of large-scale distributed systems with unknown boundary conditions, which are monitored by a set of sensors. Because of the difference of spatial positions among the sensor network, only the single state variables or both the states and outside input jointly could be estimates with Kalman information filtering, respectively. On diffusion processing, we fuse the common state estimations of the local information filters using consensus averaging algorithms and algebraic graph theory. Stability and performance analysis is provided for this distributed filtering algorithm. Finally, we consider an application of distributed estimation to a heat conduction process. The performance of the proposed distributed algorithm is compared to the centralized Kalman filtering.
1. Introduction
Large-scale systems have been studied extensively in the cutting-edge technology-based social sectors, ranging from ocean, atmospheric, and hydrological sciences [1, 2] and oil reservoir simulations [3] to intelligent transportation systems [4–6]. The large-scale systems are usually formulated with a set of partial differential equations to express their distributed, multiparameter coupled dynamical behaviors. In recent years, more attention has been given to cyber-physical systems, in which the physical plants usually are described with large-scale systems [1, 4, 7].
State estimate of large-scale systems is a challenging task, since the evolution of the large-scale systems usually codominated by the current system states and the outside boundary conditions. The troublesome problem is the boundary conditions are often unknown or inaccessible in advance in some applications. Two kinds of approaches have been developed in recent years to solve this problem. One method assumes that the boundary conditions are random walking variables and then estimates these variables as extended system states [8]. Another method treats these boundary conditions as outside system input and estimates system states and unknown input simultaneously based on the iterating two-step or multistep Kalman filtering [9, 10].
In this work, we present a distributed simultaneous state and input estimate method for a class of large-scale systems with unknown boundary conditions which are monitored by a sensor network. Based on the spatial positions of sensor nodes, the large-scale system is firstly decomposed into low-dimensional subsystems. If the sensor nodes are located at the boundary grids, information filtering for simultaneous state and input estimate is developed. Then consensus strategy fuses state estimations which are common among the local information filters using the consensus averaging algorithms [11].
The aims of this paper are (1) to decompose the large-scale distributed parameter system into spatial subsystems with reduced observation models; locations of the sensor group throughout the spatial domain significantly affect the outcome and quality of state estimation; we model sensors placed in different locations with different output operators, (2) to develop the information filtering algorithm for simultaneous state and boundary condition estimation for local sensor groups and design consensus estimator for every sensor so that the overall state can be estimated via local exchange of messages among neighboring nodes, and (3) to present a stability analysis distributed Kalman consensus filtering algorithm.
The subsequent sections are organized as follows. Some background on centralized and decentralized observation models is provided in Section 2. State-space partition of large-scale system is formulated in Section 3. In Section 4, we present the information filtering for simultaneous state and input estimate. Distributed Kalman consensus filters for large-scale systems with unknown boundary conditions are introduced in Section 5.1. Stability analysis is provided in Section 5.2. Simulation results and performance comparisons for a 1D heat conduction process are presented in Section 6. Conclusions and future work are discussed in Section 7.
2. Problem Statement
2.1. Spatially Distributed Processes
Consider the spatially distributed physical process represented by the following convection-diffusion equation:where , , and is the length of one spatial dimension. is the given outside environment, is the small diffusion coefficient, and is the convection coefficient.
Assume that the initial conditions of (1) are given by where is a given function. And the boundary conditions are imposed on both edges as where , are outside input functions.
When the initial and boundary conditions (2)-(3) are compatible, (1) is well posed in the sense that it has a unique solution .
2.2. Spatiotemporal Discretization
The above PDEs could be solved numerically on a spatial uniformed mesh grid with the finite-difference discretization method. The central approximations of the first- and the second-order derivative are, respectively, where is the value of the random field at the th location of the spatial grid and is the length of the spatial grid.
Temporal discretization approximates the time derivative of PDEs (1) by using the forward Euler method. For those boundary grids whose outer grids are missing, the temporally discretized boundary conditions , are represented as discrete variable , where , is the discrete-time instant.
In general, the spatiotemporal discretization of the PDEs (1) is formulated by the following discrete-time state-space model: where the state vector is the collection of the sorted variables , by, for example, using the lexicographic ordering. Unknown input is the discretized boundary condition, and is the model approximation error assumed to be mutually uncorrelated, zero-mean, white random signals with known covariance matric . , are system state matrix and boundary input matrix, respectively.
Remark 1. For the system matrix of the discrete-time model (6), nonzero element means that the state representing the value of the spatial grid is affected directly by the outside boundary input ; otherwise, zero element of means that represents the inside grid.
2.3. Distributed Observation Model
We assume that system (6) is monitored by a network of sensors, in which the boundary information is not accessible directly. Then the local observations at sensor at time are where is the local observation matrix, is the number of simultaneous observations made by sensor at time , and is the local observation noise assumed to be mutually uncorrelated, zero-mean, white random signals with known covariance matric .
Remark 2. The local measurement may be temperature or some other physical attribute at local sensor . The observation matrix is particular to the spatial position (corresponding to the nonzero element in ) of the local sensor , in the uniformed mesh grid.
We collect all observations in the network to get the global observation model. Let be the total number of observations at all sensors. Let the global observation vector, , the global observation matrix, , and the global observation noise vector, , be
Then the global observation model is given by Since the observation noises at the different sensors are independent, we can combine the local observation noise covariance matrices at each sensor into the global observation noise covariance matrix, , as
For large-scale systems with unknown boundary conditions, centralized and distributed filtering for simultaneous input and state estimation are discussed, respectively. No prior information about the unknown boundary input, , in the system model (7) is available or accessible in advance.
3. Partitioned Large-Scale Systems
In this section, we partition the large-scale system into subsystems based on the different spatial positions of the local sensors. Each sensor has the capability to generate its own estimate using locally available measurements.
Case 1. The local sensor is placed at the boundary grids of the spatiotemporal discretization model (6), . is the corresponding index set.
In this case, , . We select submatrices containing the elements taken from the full-order matrix with indices belonging to , where the index set , , , and , such that where is an -dimensional vector composed of the components of selected by .
Then, the local subsystem models available to the sensor can be defined as. In order to estimate all boundary inputs , we further assume that .
Case 2. The local sensor is placed at the inside grids of the spatiotemporal discretization model (6); .
In this case, the elements of matrix corresponding to the inside grids are zeroes; that is, . Then, we define the local submatrices as and extract the local subsystem models as
Example 3. Consider the one-dimensional distributed parameter heat conduction model on a rod. Spatial discretization results in the grid shown in Figure 1. A number of sensors are located on the specified grid points and each sensor measures the specified temperature. Unknown boundary conditions on the end of the rod are , and the boundary system matrix isWhen the sensor is located at the grid point 1, the local observation matrix should be . Then, is obtained as a submatrix including the first column of the full-order boundary matrix ; that is, We define the input as .
When the sensor location is at the grid point 2, or the other inside grids, the local observation matrix should be . In this case, , and we define . The subsystem models are not including outside input.
4. Information Filtering for Simultaneous Input and State Estimation
In this subsection, we extend the classical Kalman information filtering for simultaneous input and state estimation. Recursive equations of information filtering for subsystems (14) (omit index ) can be written aswith weighted sensor data and information matrix . The error covariance matrices are defined as , , where , , with .
For subsystems (12) with unknown input, two-step optimal filtering for simultaneous input and state estimation has been developed in [9, 10]. The main purpose is to estimate input from the innovation by least-squares estimation. Recursive state and input filters are as follows: where represents input estimate and and represent the state prediction with and without the input information, respectively.
The optimal gain matrices are obtained as where , , , and .
The error covariance matrices are updated according to where , denotes the identity matrix, and .
Recall from (23) that the Kalman gain can be written as
Defining the equation of the Kalman gain matrix can be equivalently expressed as and the error covariance matrix can be expressed as
Defining , we further have Derivation details of (29) and (30) are omitted here for conciseness.
Using the matrix inversion lemma, Equation (29) can be written as
Substituting the definition of into the state equation (21) gives
Defining the weighted sensor data and the information matrix as the information filtering for simultaneous input and state estimation can be restated as
5. Consensus Based Information Filtering
5.1. Consensus Based Filtering Algorithm
A distributed sensor network consisting of sensor nodes is adopted to monitor a large-scale system with unknown boundary conditions. The nodes are connected to each other in some network topology. The set of neighbors of node including node itself is denoted by the set .
Consensus information filtering for system (6) can be expressed as where , , and are calculated from (17) or (36) according to the sensor node lying in the outside grids (Case 1) of the large-scale system or inside grids (Case 2), respectively.
The choice of consensus gain is related to the estimation variance of local sensor ; that is, where is the Frobenius norm of a matrix and is a relatively small constant.
The local boundary condition estimate for .
In construction of subsystems, we require , which means that the global boundary conditions are covered by a set of local estimates. Therefore, we can reconstruct the estimate of boundary conditions by choosing the corresponding components from the local estimate:, where is the th component of the estimate vector .
5.2. Convergence Analysis
Stability of estimation is often formulated in terms of stabilizability and detectability conditions. However, these conditions are not sufficient to guarantee stability in the more complicated simultaneous state and input estimations. Following the results in [12], we present stability analysis for distributed estimation of large-scale systems with unknown boundary conditions.
Lemma 4. For the information filter (36), , and with Moreover, if is positive definite, then is positive definite as well.
Lemma 5. Suppose that information matrix is positive definite. Then, the error dynamics of the discrete-time information filter (36) is globally asymptotically stable with a Lyapunov function .
Proofs of Lemmas 4 and 5 are deduced from (30), (32) and with
Theorem 6. Consider the distributed filter (37) with consensus gain and : Suppose that the information matrix is positive definite for all . Then, the error dynamics of the distributed Kalman consensus filter (37) is globally asymptotically stable for a sufficient small . Furthermore, all estimators asymptotically reach a consensus on state estimates; that is, .
Proof. The error dynamics (without noise) of the consensus filter can be written as Using the Lyapunov function in Lemma 5 and calculating the change we have with The first term in (45) is negative semidefinite from Lemma 4, and the second term can be designed negative semidefinite using the quadrtic property of graph Laplacians [12, 13], by setting the consensus gain: The last term in the expression of is positive semidefinite, while we could choose sufficiently small so that the sum of the first and third terms is negative semidefinite. The following proof is analogous to the Theorem 2 in [14].
6. Example: A Heat Conduction Process
Consider a rod with length and cross section radius ; see Figure 1. The density, heat capacity, and thermal conductivity of the material are denoted by , , and , respectively. Using the energy balance equation, we get the following partial differential equation: where is the temperature of the rod, the temperature of the environment, the heat transfer coefficient of the surface of the rod, the spatial coordinate of the length, the perimeter of the rod, and the area of the longitudinal section.
For the distributed parameter system (48), we assume that the initial condition is , and the boundary conditions , are unknown inputs, respectively.
Employing the central approximation (4), (48) becomes the ordinary differential equation with being the node index corresponding to the grid point index increasing from the left to the right and where is the distance between each grid.
Using the temporal Euler approximation (time increment assumed to be less than for convergence), the state equation is discretized to get the discrete-time linear equation with state vector , unknown boundary conditions , and model approximation error with the covariance matric .
In this simulation, the boundary conditions are taken as where is a normal Gaussian variable. Suppose that no information about , is available for use.
The model and simulation parameters are shown in Table 1. Three local sensor groups are located separately at the left, central, and right grids of the rod. The simulation final time is 80 seconds and the consensus gains are . All sensor groups are fully connected.
We get the following three subsystem observation matrices as
The simulations are performed in MATLAB 7.0 environment using an Intel 2.40 GHz processor with 512 MB of RAM and under Microsoft Windows XP operating systems. The simulations have been repeated 50 times, and averagely the distributed information filtering takes about 1.07 seconds while the simulation time of the optimal Gillijins-De Moor algorithm requires about 2.60 seconds.
We compare the estimation error between the distributed information filtering and the Gillijins-De Moor algorithm. The state estimation results for grids 1, 2, and 10 are shown in Figures 2–4, and left and right boundary condition estimations are shown in Figures 5-6. It may be seen that the distributed filtering provides a relatively satisfied estimation for both states and boundary inputs. However, compared with the Gillijins-De Moor algorithm, the developed filtering slightly reduces the accuracy of estimation within about 8 percent. An obvious improvement (with simple model magnitude) is the fact that the algorithm speed is faster than using the Gillijins-De Moor algorithm.
Following Olfati-Saber and Shamma [15] on the appropriate measure of the disagreement of the estimates, we use the following disagreement measure: where
The evolution of the disagreement term is depicted in Figure 7, which shows that a relatively high disagreement at the beginning is bounded asymptotically.
7. Conclusions
The concept of consensus filters is applied to distributed parameter systems with unknown boundary conditions. The local sensor groups have different reduced observation models according to their spatial locations, and we decompose the whole large-scale distributed parameter systems into different local subsystems. Local information filtering algorithms are developed to estimate the state and the boundary condition simultaneously and extended to the distributed Kalman consensus filter through a penalty term that enforces consensus. A 1-dimensional heat conduction process model with two known boundary conditions is used to illustrate the spatially distributed consensus filter with three sensor groups.
Future work will consider applications of the distributed consensus filtering estimation to some concrete distributed parameter systems, such as the networks of traffic flows with changing traffic demands, and hydrological or atmospheric transportation models.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgment
This work was partially supported by the National Science Foundation of China (NSFC) under Grant no. 61374076.