About this Journal Submit a Manuscript Table of Contents
ISRN Communications and Networking
Volume 2011 (2011), Article ID 860936, 10 pages
http://dx.doi.org/10.5402/2011/860936
Research Article

Self-Aware Distributed Consensus Building for Sensor Networks

School of Engineering, The University of Vermont, Burlington, VT 05405, USA

Received 9 August 2011; Accepted 15 September 2011

Academic Editors: M. Maier and R. Montemanni

Copyright © 2011 Lei Chen and Jeff Frolik. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Distributed consensus building promises to improve the robustness and reliability of sensor networks and thus is an active topic of research. Whereas extensive study has been done on the theoretical analysis of the asymptotic behavior of consensus building, one important issue that is crucial to the practical implementation of sensor networks was rarely explored, namely, the criteria to determine whether consensus has been attained. In this paper, we propose an approach that allows each node in a network to make the decision by itself, based on the second derivatives of its own state. The approach does not rely on the states of other nodes, leads to substantial saving of communication resources, and is resilient to connection failure. We perform a systematic analysis of the approach and, as a consequence, derive the optimal parameters that minimize the upper bound of the number of required iterations to reach consensus.

1. Introduction

In past decades, sensor networks have been widely applied in civilian, military, and industrial systems. Despite tremendous efforts that have been devoted to sensor techniques, it remains a great challenge to build a sensor system that works reliably and responsively under varying conditions. Distributed consensus building has emerged as an approach to address such shortcomings. Each individual node updates its “state” (e.g., view of local or global sensed values, actions to be taken, and/or network conditions) while exchanging information with others, until consensus of the state is attained. While individual sensors could have unreliable information or be vulnerable to environmental or network dynamics, all sensors in the network, via effective cooperation, can produce decisions that are higher in reliability because of the reached consensus. Since such consensus building enables the network to act locally based on distributed interactions, we contend that this approach can benefit networks that also involve actuation or otherwise interact with the physical world.

In previous work, there has been extensive theoretical study of the distributed consensus building problem. Xiao and Boyd [1] considered the convergence of a distributed averaging problem and proposed to seek the optimal updating weights by solving a semidefinite optimization problem. We note that the derivation in this work was based on the symmetric communication link assumption, which is not always satisfied in real networks. Olshevsky and Tsitsiklis [2] performed a more comprehensive investigation of this problem and derived lower bounds on the worst-case convergence time for different types of distributed consensus methods. Based on the theoretical analysis, they also developed an algorithm whose convergence time can essentially match these bounds. Olfati-Saber et al. [3, 4] developed a theoretical framework of information consensus over a multiagent network. They inspected various theoretical aspects of the problem and established the connections between the spectral properties of complex networks and the convergence rate of the consensus algorithms.

Whereas this previous work has laid down a solid theoretical foundation for the research on distributed consensus, it mostly focused on the analysis of asymptotic behaviors. As a consequence, practical issues, which are equally important to the effectiveness of sensor networks, have received less attention. In this paper, we particularly study one of these issues, namely, how might an individual node determine whether consensus (within a tolerable range) has been attained. This is motivated by the consideration that if the consensus status can be detected as soon as it is reached, the sensor network can then be put to rest earlier, which should lead to considerable energy saving.

Specifically, our goal here is to develop a consensus determining scheme with two desirable properties. First, it is self-aware, namely, each node in the network decides whether this scheme has reached consensus solely based on its own state, without resorting to the communication with other nodes. Compared to the schemes that detect consensus via information exchange with other nodes, a self-aware scheme does not consume extra communication bandwidth and tends to be more responsive. Second, the scheme should be resilient against noise as well as the variation of propagation delay and link weights. Our approach to achieve this target is inspired by the continuous-time work of Barbarossa et al. [57]. In their work, the network consensus is defined with respect to the first derivative of the states, rather than the states themselves. They showed that this new definition can result in improved robustness against noises, delays, and even topology changes. Hence, we adopt this formalism as the basis of our work.

The work presented here extends our earlier work [8] which initiates the basic idea of our approach. In that paper, we derived a discrete-time counterpart of the continuous-time formulation given in [5], making it implementable in physical, discrete-time hardware. We also verified the method through both numerical analysis and hardware implementation. In this paper, we further extend our previous exploration. Particularly, we consider the self-aware criterion given bÿ𝐱(𝑡)𝜀,(1) where 𝐱(𝑡) is the state of a node as a function of time and 𝜀 is the tolerance threshold. With this criterion, we obtain an upper bound of the number of iterations needed to achieve consensus and thereon derive the optimal step coefficient 𝛿 that minimizes this bound. Moreover, we examined how the optimal solution is related to different factors, including the spectrum of the graph Laplacian as well as the tolerance range, via both theoretical analysis and numerical simulation. We note that our analysis is not restricted to symmetric network, as opposed to some previous analysis, such as that in [1].

To sum up, the main contributions of this paper lies in the following aspects. First, we develop a self-aware criterion to detect consensus based on the discrete-time formulation presented in our earlier work [8]. It is simple, cost-effective, and robust to noises as well as network changes. Second, we perform theoretical analysis of the criterion for both symmetric and asymmetric networks and thereon obtain an upper bound of the number of iterations needed to reach consensus. Third, we derive an optimal updating weight and examine its relations to the spectral structure of the network as well as the tolerance threshold.

A brief outline of the rest of the paper follows. In Section 2, we formulate a discrete-time consensus model and analyzes its asymptotic behavior. In Section 3, we obtain an upper bound of the convergence time based on this model and thereon derive the optimal choice of 𝛿. In Section 4, we give some numerical examples, illustrate the influence of 𝜀 to the consensus for both symmetric and asymmetric scenarios, and verify the analytical solution of 𝛿. Finally, Section 5 concludes this work and identifies areas of future research.

2. The Formulation of Consensus Model

In this paper, we consider a sensor network with 𝑁 nodes (e.g., 𝑁=12 in Figure 1). Each node receives input from its sensors, and combines it with the states of its neighboring nodes to adjust its own state. These 𝑁 nodes constitute a dynamical system. Specifically, for each node 𝑖, its dynamical behavior can be described by the following equation:̇𝑥𝑖(𝑡)=𝑦𝑖(𝑡)+𝑗𝒩(𝑖)𝑎𝑖𝑗𝑥𝑗(𝑡)𝑥𝑖(𝑡).(2) Here, 𝑥𝑖 is the state of node 𝑖 as a function of time, 𝑦𝑖 is the corresponding input signal, 𝒩(𝑖) is the set of neighboring nodes of 𝑖, and 𝑎𝑖𝑗 is the coupling coefficient that reflects the contribution of node 𝑗 to the evolution of node 𝑖. Note here that the coupling coefficients need not to be symmetric (𝑎𝑖𝑗=𝑎𝑗𝑖) in general. In this model, the change of 𝑥𝑖 is driven by a linear combination of the input signal and state differences from its neighbors. For simplicity, we assume that the input signals are static, that is, 𝑦𝑖(𝑡)=𝑦𝑖 for each 𝑖=1,,𝑁.

860936.fig.001
Figure 1: Schematic diagram of a sensor network with 𝑁=12 nodes.

The model given in (2) can be rewritten into the following vectorized form:̇𝐱(𝑡)=𝐋𝐱(𝑡)+𝐲.(3) Here, 𝐱(𝑡)=[𝑥1(𝑡),,𝑥𝑁(𝑡)]𝑇, 𝐲=[𝑦1,,𝑦𝑁]𝑇, and 𝐋 denotes the Laplacian matrix of the communication graph whose edge weights are given by the coupling coefficients 𝑎𝑖𝑗. Particularly, we have𝐋(𝑖,𝑗)=𝑗𝒩(𝑖)𝑎𝑖𝑗(𝑖=𝑗),𝑎𝑖𝑗0(𝑗𝒩(𝑖)),(otherwise).(4) We note that 𝐋 is symmetric if and only if the coupling coefficients 𝑎𝑖𝑗 are symmetric. A symmetric system implies that all communication links are bidirectional. However, this is not always the case due to packet drops, and different transmit powers and receiver sensitivities of the hardware.

2.1. Discrete-Time Formulation

To implement (3) on physical, discrete-time hardware, we reformulate the problem under discrete-time setting, via finite difference approximation, aṡ=𝐱(𝑛)=𝐱(𝑛1)+𝛿𝐱(𝑛1)(𝐈𝛿𝐋)𝐱(𝑛1)+𝛿𝐲.(5) We note that the updating at each step is controlled by an updating weight 𝛿. Through recursively expanding the formula above, we find the analytic expression for 𝐱(𝑛), as𝐱(𝑛)=𝚽𝑛𝐱(0)+𝛿𝑛1𝑘=0𝚽𝑘𝐲,(6) where Φ=𝐈𝛿𝐋. From this, we further obtain a discrete version of the first derivative, aṡ𝐱𝛿1(𝑛)𝛿(𝐱(𝑛)𝐱(𝑛1))=𝚽𝑛1(𝐋𝐱(0)+𝐲).(7) Here, ̇𝐱𝛿 refers to the discrete derivative obtained with updating weight 𝛿.

2.2. The Conditions of Convergence

According to Barbarosa’s definition, the consensus is attained when the first derivatives of the states of all nodes converge to stationary values, which we denote by a vector 𝝎, as illustrated by Figure 2. However, as we will show below, convergence is guaranteed only under specific conditions, but not in general.

860936.fig.002
Figure 2: Convergence of the state of the sensor network in Figure 1.

Lemma 1. The first derivatives of the system given by (7) converge to stationary values 𝝎 with arbitrary input 𝐲 if and only if 𝜌(𝚽)1.(8) In this case, Φlim𝑛Φ𝑛 is finite, and the vector of stationary values 𝝎 is given by 𝝎=𝚽𝐋𝐱(0)+𝚽𝐲.(9) In particular, when Φ𝐋=0, one has 𝝎=Φ𝐲, which is independent of the initial states 𝐱(0).

Here, 𝜌(Φ) is the spectral radius of Φ, that is, the maximum absolute value of its eigenvalues.

Proof of Lemma 1. If 𝜌(Φ)1, Φ𝑛 is a convergent sequence and thus so is ̈𝐱𝛿(𝑛) due to continuity of linear operation. Otherwise, if 𝜌(Φ)>1, there exists an eigenvalue 𝜆 of Φ such that |𝜆|>1. Since 𝐲 is arbitrary, we can choose 𝐲 such that 𝐋𝐱(0)+𝐲=𝐞, where 𝐞 is the eigenvector associated with 𝜆. As a result, ̈𝐱𝛿(𝑛)=𝜆𝑛1𝐞, which diverges. Therefore, the system converges for every 𝐲 if and only if 𝜌(Φ)1.
The fact that Φ𝑛 converges implies that Φ is finite. Again, by continuity of linear operation, we obtain lim𝑛𝚽𝑛1=(𝐋𝐱(0)+𝐲)lim𝑛𝚽𝑛1(𝐋𝐱(0)+𝐲)=𝚽(𝐋𝐱(0)+𝐲).(10) This completes the proof of the second statement.

Based on this lemma, we derive the conditions of convergence, which as we will see are closely related to the eigenvalues of 𝐋, denoted by 𝜆1,,𝜆𝑁. Without losing generality, we assume that |𝜆1||𝜆𝑁|. The properties of these eigenvalues are summarized below.(1)rank(𝐋)=𝑁𝐾, where 𝐾 is the number of connected components of the communication graph. The number of null eigenvalues indicates the number of connected components.(2)𝐋 has a null space which contains 𝟏, that is, 𝐋𝟏=𝟎. In particular, when 𝐾=1, the null space is a one-dimensional space spanned by 𝟏.(3)|𝜆𝑁|=𝜌(𝐋), the spectral radius of 𝐋.(4)When 𝐋 is symmetric, 𝜆1,,𝜆𝑁 are nonnegative real values.

The eigenvalues of Φ=𝐈𝛿𝐋 are then given by 1𝛿𝜆1,,1𝛿𝜆𝑁. Hence, the spectral radius of Φ is given by𝜌||(𝚽)=max1𝛿𝜆𝑖||𝑖=1,,𝑁.(11) This immediately leads to an important condition of convergence, as given by the following corollary.

Corollary 2. The system given by (7) converges if and only if ||1𝛿𝜆𝑖||1,𝑖=1,,𝑁.(12) In particular, when 𝐋 is symmetric, all eigenvalues are real, and thus this condition is equivalent to 𝛿𝜆𝑁2.(13)

Proof of Corollary 2. By Lemma 1, the system converges if and only if 𝜌(Φ)1. By (11), this is equivalent to max𝑖=1,,𝑁|1𝛿𝜆𝑖|1, that is, |1𝛿𝜆𝑖|1 for each 𝑖. When 𝐋 is symmetric, all eigenvalues are real; hence, the maximum here can be either |1𝛿𝜆1| or |1𝛿𝜆𝑁|. Recall that 𝜆1=0, thus |1𝛿𝜆1|=1. Therefore, the condition holds if and only if |1𝛿𝜆𝑁|1. Considering that 𝜆𝑁>0, this is equivalent to 𝛿𝜆𝑁2.

Suppose that the condition of convergence given above is satisfied; we have the following discussions in regard to the matrices Φ and Φ.(1)Since 𝐋𝟏=𝟎, we have Φ𝟏=(𝐈𝛿𝐋)𝟏=𝟏, implying that Φ has an eigenvalue 1, which is associated with an eigenvector 𝟏.(2)Suppose that the number of connected components of the communication graph is 𝐾, then the geometric multiplicity of the eigenvalue 1 of Φ is 𝐾, meaning that the dimension of the eigenspace corresponding to the eigenvalue 1 is 𝐾.(3)Φ𝑛𝟏=𝟏 for each 𝑛=1,2,. Taking this sequence to the limit leads to an important result, namely, Φ𝟏=𝟏.

These results provide necessary basis for our later derivation.

2.3. Consensus over Connected Networks

In this paper, we focus on the case where the communication graph is connected and 𝐋 is diagonalizable. For this case, we derive the following results that characterize the asymptotic behavior of the dynamical system.

Lemma 3. Suppose that 𝐋 is the Laplacian matrix of a connected graph and is diagonalizable, Φ=𝐈𝛿𝐋 such that 𝜌(Φ)=1, then 𝚽=𝟏𝜸𝑇,(14) where 𝜸 is a left eigenvector of Φ associated with the eigenvalue 1 that satisfies 𝜸𝑇𝟏=1.

Proof of Lemma 3. Since Φ is diagonalizable, it can be written as 𝚽=𝐏𝐃𝐏1,(15) where 𝐃 is a diagonal matrix with 𝐃𝑖𝑖=1𝛿𝜆𝑖, and 𝐏 is a matrix whose columns are the corresponding eigenvectors. Hence, 𝚽𝑛=𝐏𝐃𝑛𝐏1.(16) Note that 𝐃𝑛 is also a diagonal matrix with 𝐃𝑛𝑖𝑖=(1𝛿𝜆𝑖)𝑛. Under the condition of convergence, as 𝑛, 𝐃𝑛11 remains 1, while all other entries converge to 0. Consequently, 𝚽=(𝐏)1𝐏1𝑇1.(17) Here, we use the notation ()1 to indicate the first column of a matrix. The first column of 𝐏 is the eigenvector associated with the eigenvalue 1𝛿𝜆1=1, which is 𝟏, while the first column of 𝐏1 is a left eigenvector associated with the same eigenvalue, which we denote by 𝜸. Consequently, we can write Φ=𝟏𝜸𝑇. Moreover, as we have discussed above, Φ𝟏=𝟏, thus 𝟏𝜸𝑇𝟏=𝟏, which implies that 𝜸𝑇𝟏=1. The proof is completed.

Following this lemma, we derive the following results that characterize the asymptotic behaviors of the dynamical system on a connected communication network.

Theorem 4. Suppose that the dynamical system given by (7) is on a connected network and the Laplacian matrix 𝐋 is diagonalizable. If 𝛿 is chosen such that 𝜌(Φ)1, then the first derivative of each node converges to a common stationary value 𝜔 given by 𝜔=𝜸𝑇𝐲=𝑁𝑖=1𝛾𝑖𝑦𝑖.(18) Here, 𝜸=[𝛾1,,𝛾𝑁]𝑇 is a left eigenvector of Φ associated with the eigenvalue 1 that satisfies 𝑁𝑖=1𝛾𝑖=1.

Here, convergence to a common stationary value means that all entries of 𝝎 are the same, that is, 𝝎=[𝜔,,𝜔]𝑇. In addition, we can see that the value 𝜔 is a weighted average of the input signals, which reflects the global consensus formed over the sensor network.

Proof of Theorem 4. From Lemma 3, we can see that, under the condition of convergence, Φ𝑛 converges to Φ=𝟏𝜸𝑇 as 𝑛. And since 𝐋𝟏=𝟎, 𝐋Φ=𝐋𝟏𝜸𝑇=𝟎. By Lemma 1, we know that the states converge to stationary values given by 𝝎=𝚽𝐲=𝟏𝜸𝑇𝐲.(19) Let 𝜔=𝜸𝑇𝐲; this can be further rewritten as 𝝎=𝜔𝟏. The proof is completed.

2.4. Determining Consensus

For any practical implementation, the stationary value 𝜔 is not available in advance; hence, one has to resort to other means to determine whether a sensor network has reached consensus. A natural idea is to compare the first derivatives of all nodes and see whether they are close to each other. However, implementation of this strategy might require a centralized process to collect information from every node, which could be expensive or even infeasible in practice.

In this paper, we take a different approach. Instead of relying on the first derivatives to detect consensus, we consider the second derivatives. Based on our discrete-time formulation, we define the vector of second derivatives to bë𝐱𝛿1(𝑛)=𝛿̇𝐱𝛿̇𝐱(𝑛)𝛿(𝑛1)=𝐋𝚽𝑛2(𝐋𝐱(0)𝐲).(20)

Suppose that the dynamical system is on a connected communication network with diagonalizable Laplacian matrix 𝐋; we have 𝐋Φ𝑛𝟎 as 𝑛. It immediately follows thatlim𝑛̈𝐱𝛿(𝑛)=𝟎.(21)

This observation suggests that we may decide whether consensus has been attained by examining whether the second derivatives vanish. Specifically, we devise the following rule. Given a tolerance threshold 𝜀>0, a sensor network is regarded to reach consensus if̈𝐱𝛿(𝑛)<𝜀.(22) Here, denotes the infinity norm. Intuitively, the network is considered to attain consensus when the magnitude of the second derivative at each node is below the given threshold 𝜀.

It is worth noting that this rule is self-aware, meaning that each node can decide whether it meets the condition locally, without talking to other nodes. Compared to other rules, its main advantages are three-fold: (1) simplicity of implementation, (2) no consumption of extra communication energy, and (3) resilience to the changes of network conditions.

3. Convergence Time and Optimal 𝛿

In the previous section, we have derived the conditions under which a sensor network is guaranteed to converge to the consensus status. The next important question is how long does it take to converge? In this section, we are going to seek an answer to this question.

For discrete-time implementations, the convergence time is measured by the number of iterations 𝑛 needed to reach consensus. Generally, it is impossible to obtain the exact value of this number in design stage, as it depends on both the initial states and the input signals. It is nonetheless possible to derive upper bounds, which would provide guidance for us to choose the optimal design.

Recall that we have obtained the analytic expression of the second derivatives, as given bÿ𝐱𝛿(𝑛)=𝐋(𝐈𝛿𝐋)𝑛2(𝐋𝐱(0)𝐲).(23)

Given a tolerance threshold 𝜀, our goal here is to derive an upper bound 𝑀(𝜀) such thaẗ𝐱𝛿(𝑛)𝜀,𝑛>𝑀(𝜀).(24) However, directly working with ̈𝐱𝛿 is difficult in general. Our basic idea is to first seek an upper bound 𝑈(𝑛;𝛿) of ̈𝐱𝛿(𝑛) and then find 𝑀(𝜀) such that𝑈(𝑛;𝛿)𝜀,𝑛>𝑀(𝜀).(25) Note here that we introduce 𝛿 as an argument of 𝑈 for the purpose of emphasizing the fact that such an upper bound is often closely related to the updating weight 𝛿. Since ̈𝐱𝛿(𝑛)𝑈(𝑛;𝛿), the condition given by (25) implies the one given by (24).

3.1. Upper Bound Based on Spectral Analysis

Our approach to obtain an upper bound is based on the concept of induced norm. Given a matrix 𝐀, its induced norm, denoted by 𝐀, is defined as follows:𝐀sup𝐱𝐱1𝐀𝐱.(26) From this definition, we can immediately see that𝐀𝐱𝐀𝐱.(27) The induced norm is related to the spectral radius. In general, we have 𝐀𝜌(𝐀). Particularly, when 𝐀 is symmetric, the equality holds, that is, 𝐀=𝜌(𝐀).

For induced norm, we also have the following result, which is important for our derivation.

Lemma 5. Given a real square matrix 𝐀 and 𝛼0,𝛼1,,𝛼𝐾, one has 𝛼0𝐈+𝐾𝑘=1𝛼𝑘𝐀𝑘𝛼0+𝐾𝑘=1||𝛼𝑘||𝐀𝑘.(28)

This is a well-known result of linear algebra, which states that the induced norm of the matrix obtained by applying a polynomial to a matrix 𝐀 is upper bounded by the corresponding polynomial of 𝐀 with the coefficients replaces by their absolute values.

Coming back to our problem and considering the norm ̈𝐱𝛿(𝑛), we have the following result.

Theorem 6. Let 𝐱 be the states of a dynamical system on a connected network whose Laplacian matrix 𝐋 is diagonalizable. Then, one has ̈𝐱𝛿(𝑛)𝐈𝛿𝐋𝟏𝜸𝑇𝑛2𝐋𝐡.(29) Here, 𝜸 is a left eigenvector of 𝐋 associated with the eigenvalue 1 that satisfies 𝜸𝑇𝟏=1, and 𝐡=𝐋𝐱(0)𝐲.

Proof of Theorem 6. We first rewrite ̈𝐱𝛿(𝑛) as follows: ̈𝐱𝛿(𝑛)=𝐋(𝐈𝛿𝐋)𝑛2𝐡=𝐋𝐈𝛿𝐋𝟏𝜸𝑇+𝟏𝜸𝑇𝑛2𝐡=𝐋𝐈𝛿𝐋𝟏𝜸𝑇𝑛2𝐡.(30) Here, we make use of the fact that 𝐋𝟏𝜸𝑇=𝟎𝜸𝑇=𝟏. With this expression, (29) in this theorem immediately follows from Lemma 5 and (27). The proof is completed.

From this theorem, it is not difficult to show that when𝑛log𝐋+log𝐡+log(1/𝜀)log1/𝐈𝛿𝐋𝟏𝜸𝑇+2.(31) The right-hand side of this inequality gives an upper bound of the number of iterations needed to attain consensus.

3.2. Optimal Choice of 𝛿

To minimize the upper bound given by (31), one can choose the optimal updating weight ̂𝛿 that minimizes 𝐈𝛿𝐋𝟏𝜸𝑇, aŝ𝛿=argmin𝛿0𝐈𝛿𝐋𝟏𝜸𝑇.(32)

3.2.1. Symmetric Cases

We first consider the cases where the underlying communication network is symmetric. In these cases, the Laplacian matrix 𝐋 is symmetric. Let 0=𝜆1𝜆𝑁 be the eigenvalues of 𝐋, which are all nonnegative real values. Since the component 𝟏𝜸𝑇 that corresponds to the eigenvalue 1 of Φ is subtracted, the eigenvalues of 𝐈𝛿𝐋𝟏𝜸𝑇 are 0,1𝛿𝜆2,,1𝛿𝜆𝑁. Since 𝐋 is symmetric, we have𝐈𝛿𝐋𝟏𝜸𝑇=𝜌𝐈𝛿𝐋𝟏𝜸𝑇||=max1𝛿𝜆2||,||1𝛿𝜆𝑁||.(33) Hence, the optimal choice of 𝛿 is given bŷ𝛿=argmin𝛿>0||max1𝛿𝜆2||,||1𝛿𝜆𝑁||=2𝜆2+𝜆𝑁.(34) Note that ̂𝛿2/𝜆𝑁. According to Corollary 2, it follows, that with such an optimal choice, convergence is guaranteed. We also note that Xiao and Boyd [1] obtained similar results in different context.

3.2.2. Generic Diagonalizable Cases

In real applications the communication topology is not always symmetric due to difference of devices and deployment environment. Hence, the spectral radius does not necessarily equal the induced norm, we use the spectral radius in place of the induced norm; leading to the following objective in choosing optimal 𝛿:̂𝛿=argmin𝛿0𝜌𝐈𝛿𝐋𝟏𝜸𝑇.(35) In generic cases, the spectral radius is given by𝜌𝐈𝛿𝐋𝟏𝜸𝑇||=max1𝛿𝜆𝑖||𝑖=2,,𝑁.(36) The eigenvalues here can be complex numbers. When solving this problem, it is important to contain the solution within the domain such that convergence is guaranteed. The domain is defined by||1𝛿𝜆𝑖||1,𝑖=2,,𝑁.(37) Suppose that 𝜆𝑖=𝛼𝑖+𝑖𝛽𝑖; we have that |1𝛿𝜆𝑖|<1 if and only if0𝛿2𝛼𝑖||𝜆𝑖||2.(38) Therefore, the valid range of 𝛿 is0𝛿min𝑖=2,,𝑁2𝛼𝑖||𝜆𝑖||2.(39) We note that there exists no analytic solution to this problem. However, the objective function is a piece-wise quadratic function, which can be readily solved by first delimiting the pieces and then comparing their respective minimum.

The derivation above provides an upper bound of the convergence time and a guideline for choosing the optimal 𝛿. We can see that they are closely related to the spectral characteristics of the Laplacian matrix 𝐋. In general, the network converges rapidly when the eigenvalues of 𝐈𝛿𝐋 (except the one that equals 1) are small.

3.3. More Accurate Analysis of the Convergence Time

As mentioned above, the actual convergence time also depends on the initial states 𝐱(0), and the input signals 𝐲, as well as the tolerance threshold 𝜀. Here, we take a close examination of such dependency.

Suppose that 𝐋 is diagonalizable with eigenvalues 0=𝜆1<𝜆2𝜆𝑁. Let 𝐞𝑗 be the eigenvector associated with the eigenvalue 𝜆𝑖 for each 𝑖=1,,𝑁. Since 𝐋 is diagonalizable, these eigenvectors span the entire state space, and as a consequence, the vector 𝐡=𝐋𝐱(0)𝐲 can be expressed as a linear combination of them, as𝐡=𝑁𝑖=1𝑐𝑖𝐞𝑖.(40) Let (𝐋)={𝐋𝐯𝐯𝑁} be the range space of 𝐋. Since the underlying network is connected, the null space of 𝐋 is one dimensional. Hence, (𝐋) has dimension 𝑁1 and is spanned by 𝐞2,,𝐞𝑁. Clearly, the second derivatives ̈𝐱𝛿(𝑛)=𝐋(𝐈𝛿𝐋)𝑛2𝐡(𝐋) and thus can be expressed to be a linear combination of 𝐞2,,𝐞𝑁, as̈𝐱𝛿(𝑛)=𝑁𝑖=2𝑐𝑖𝜆𝑖1𝛿𝜆𝑖𝑛2𝐞𝑖.(41) We can see that the 𝑖th term decreases geometrically with shrinking ratio |1𝛿𝜆𝑖|. Asymptotically, the term with greatest shrinking ratio, namely, the one that attenuates most slowly, will dominate in a long run.

Let 𝐶(𝐋)(𝐋) be a coordinate transform that maps each vector in (𝐋) to the coefficients with respect to the basis {𝐞2,,𝐞𝑁}. This is a bijective linear map. For each vector 𝐯(𝐋), we define𝐯/𝐶=𝐶(𝐯).(42) It can be easily shown that /𝐶 is a norm on (𝐋). To characterize the relations between /𝐶 and , we define𝜅𝐶sup𝐯(𝐋)𝐯𝐯/𝐶.(43) In other words, 𝜅𝐶 is the greatest real value that satisfies𝐯𝜅𝐶𝐯/𝐶,𝐯(𝐋).(44) By the equivalence of norms on a finite dimensional vector space, we have 0<𝜅𝐶<+; that is, 𝜅𝐶 is a finite positive value. Consider the second derivatives ̈𝐱𝛿(𝑛). To have ̈𝐱𝛿(𝑛)<𝜀, it suffices to havë𝐱𝛿(𝑛)/𝐶<𝜀𝜅𝐶.(45) From the definition of /𝐶 and (41), we geẗ𝐱𝛿(𝑛)/𝐶=max𝑖=2,,𝑁|||𝑐𝑖𝜆𝑖1𝛿𝜆𝑖𝑛2|||.(46) As a result, when𝑛>max𝑖=2,,𝑁𝜅log𝐶||𝑐𝑖𝜆𝑖||/𝜀||log1/1𝛿𝜆𝑖||+2,(47)̈𝐱𝛿(𝑛)<𝜀, implying that the sensor network attains the consensus within the tolerable range. Based on this bound, the optimal choice 𝛿 is given bŷ𝛿=argmin𝛿>0max𝑖=2,,𝑁𝜅log𝐶||𝑐𝑖𝜆𝑖||/𝜀||log1/1𝛿𝜆𝑖||.(48) This result indicates that with the knowledge of input signals, one can derive an improved upper bound, and a proper choice for 𝛿, which relates not only to the underlying graph, but also to the initial states, input signals, and the tolerance threshold 𝜀.

However, directly applying this result in practice is infeasible, as the input signals are unavailable in advance; otherwise, we do not even have to deploy a sensor network to measure them. The true significance of this result lies is that it suggests that we can incorporate domain-specific knowledge to make a better design of the sensor network.

Specifically, while the exact input is unknown before we really perform the measurement, we generally have some rough knowledge about what the input might be, which could be formulated as a prior distribution of the input signals and then be exploited to guide the choice of 𝛿. From such a prior model, one can derive the prior distribution of the coefficients 𝐜=[𝑐2,,𝑐𝑁]𝑇, denoted by 𝑝(𝐜). Then, we obtain an upper bound of the expected convergence time, as𝑈𝑇(𝛿;𝑝)=max𝑖=2,,𝑁𝜅log𝐶||𝑐𝑖𝜆𝑖||/𝜀||log1/1𝛿𝜆𝑖||𝑝(𝐜)𝑑𝐜.(49) With this model, one can choose an optimal 𝛿 that minimizes 𝑈𝑇(𝛿;𝑝). Though it might be difficult to directly solve this problem, one can resort to various techniques to make further approximation.

4. Simulation

In this section, we will illustrate the following key results. First, the consensus rate and the choice of optimal iteration weight 𝛿 are dependent on the self-aware criterion 𝜀 for a sensor network where communication links are symmetric and asymmetric. Second, the analysis of determining the optimal 𝛿 provided in previous section is consistent with the simulation result with various 𝜀’s, which greatly helps designing efficient and energy-saving sensor network for different topologies.

4.1. Symmetric Topology

We first consider the symmetric network shown in Figure 1, which has 12 nodes and 24 links. This network was randomly generated with arbitrarily chosen initial state value 𝐱(𝟎) and input 𝐲 as follows:[],[].𝐱(𝟎)=0,10,20,,110𝐲=30,30,30,30,70,70,70,70,50,50,50,50(50)

The coupling coefficient 𝑎𝑖𝑗 is defined to equal 1 if there is signal transmitted from node 𝑗 to node 𝑖; otherwise, 𝑎𝑖𝑗=0. For the network shown in Figure 1, Figure 3 shows through simulation the number of iterations required to achieve consensus as a function of the weight parameter (𝛿x-axis) and the self-aware criteria (𝜀—various curves). For this network, the best iteration weight found from earlier work by (34) is ̂𝛿=0.3802 (illustrated in Figure 3 by the vertical line). However, we can see from Figure 3 that the three curves with 𝜀=0.001, 𝜀=0.01, and 𝜀=0.1 reach the lowest point at about 0.37, 0.36, and 0.35, which means setting the iteration weight 𝛿 to each of those values would get convergence by fewest iterations based on each network operator 𝜀. Consensus with these values is achieved in significantly fewer iterations, and, most importantly, convergence is determined by local criterion. As 𝜀 increases, the whole curve moves to the left slightly. Though the change in the selection of 𝛿 is comparatively small with different threshold 𝜀, we can find that the minimal iterations for reaching consensus drop largely, from 124 to 85, then fall off to 40. If one uses ̂𝛿=0.3802 as determined by (34) and the criteria presented in [1], the system would require much more than 200 iterations to achieve consensus.

860936.fig.003
Figure 3: Minimal number of iterations for a 𝑁=12 symmetric network with different consensus criteria 𝜀’s.

By solving (41) as a function of criterion 𝜀, we found the relation between 𝜀 and minimal number of iterations and the relation between 𝜀 and optimal 𝛿. As shown in Figures 4 and 5, the analytical results are very consistent with the simulation. we can see that the minimal number of iterations decreases as the threshold 𝜀 increases. When 𝜀 goes from 0.001 to 0.1, the minimal number of iterations keeps dropping from 125 to 40, which shows that achieving consensus with slightly different 𝜀 would make a difference in the number of communication iterations. There is a tradeoff between the consensus precision and the number of communications, or energy consuming. Realizing that, it is desirable to choose a larger criterion 𝜀 to make sensor nodes live longer, as long as it meets the specific application requirement of the sensor network.

860936.fig.004
Figure 4: Minimal number of iterations versus 𝜀 for a symmetric topology.
860936.fig.005
Figure 5: Optimal iteration weight 𝛿 versus 𝜀 for a symmetric topology.
4.2. Asymmetric Topology

Next, we consider another 12-node network shown in Figure 6 with an asymmetric communication topology. Using the same initial value and input as the above example, we show that the optimal iteration weight 𝛿 as well as the minimal number of iterations varies with different network operators 𝜀’s in Figure 7. Similar to the symmetric example, it can be seen that as 𝜀 increases, the corresponding 𝛿 would be reduced slightly, while the minimal number of iterations would decrease in a big way. For this asymmetric network, the theoretical best weight found from (35) is 0.3466, which is also denoted in Figure 7 by the vertical line. Again, this theoretical “best weight" is obviously different with the real practical best choice of 𝛿; applying the “best weight" to the practical systems would yield many more iterations for network to reach consensus. As illustrated by Figures 8 and 9, the performances of minimal number of iterations and optimal 𝛿 with 𝜀 for asymmetric topology present similar behaviors as those of symmetric topology.

860936.fig.006
Figure 6: Schematic diagram of a asymmetric network, 𝑁=12; degree=2.
860936.fig.007
Figure 7: Minimal number of iterations for a 𝑁 = 12 asymmetric network with different consensus criteria 𝜀’s.
860936.fig.008
Figure 8: Minimal number of iterations versus 𝜀 for an asymmetric topology.
860936.fig.009
Figure 9: Optimal iteration weight 𝛿 versus 𝜀 for an asymmetric topology.

5. Conclusion

In this work, the problem of achieving consensus among distributed sensor nodes has been considered. In particular, a potential answer to the question on how do individual nodes “know” when consensus is achieved is presented. The work introduces a local “self-aware” criterion, 𝜀, which in practice is consensus rate of the parameter under consideration. The work illustrates (1) that 𝜀, as expected, will influence the number of iterations required but more importantly (2) that existing criteria for the weighting functions is not appropriate for that will lead to an increased number of energy-consuming iterations. The work also considers the impact of nonsymmetric links on achieving consensus. These results address practical considerations regarding implementing distributed consensus building in “real" sensor networks. As such, it is hoped that this work will motivate others to consider implementation issues in this domain.

References

  1. L. Xiao and S. Boyd, “Fast linear iterations for distributed averaging,” in Proceedings of the 42nd IEEE Conference on Decision and Control, vol. 5, pp. 4997–5002, December 2003.
  2. A. Olshevsky and J. N. Tsitsiklis, “Convergence speed in distributed consensus and averaging,” SIAM Journal on Control and Optimization, vol. 48, no. 1, pp. 33–55, 2009. View at Publisher · View at Google Scholar · View at Scopus
  3. R. Olfati-Saber and R. M. Murray, “Consensus problems in networks of agents with switching topology and time-delays,” IEEE Transactions on Automatic Control, vol. 49, no. 9, pp. 1520–1533, 2004. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  4. R. Olfati-Saber, J. A. Fax, and R. M. Murray, “Consensus and cooperation in networked multi-agent systems,” Proceedings of the IEEE, vol. 95, no. 1, pp. 215–233, 2007. View at Publisher · View at Google Scholar · View at Scopus
  5. S. Barbarossa and G. Scutari, “Bio-inspired sensor network design,” IEEE Signal Processing Magazine, vol. 24, no. 3, pp. 26–35, 2007. View at Publisher · View at Google Scholar · View at Scopus
  6. S. Barbarossa and G. Scutari, “Decentralized maximum-likelihood estimation for sensor networks composed of nonlinearly coupled dynamical systems,” IEEE Transactions on Signal Processing, vol. 55, no. 7, pp. 3456–3470, 2007. View at Publisher · View at Google Scholar · View at Scopus
  7. G. Scutari, S. Barbarossa, and L. Pescosolido, “Distributed decision through self-synchronizing sensor networks in the presence of propagation delays and asymmetric channels,” IEEE Transactions on Signal Processing, vol. 56, no. 4, pp. 1667–1684, 2008. View at Publisher · View at Google Scholar
  8. L. Chen, G. Carpenter, S. Greenberg, J. Frolik, and X. S. Wang, “An implementation of decentralized consensus building in sensor networks,” IEEE Sensors Journal, vol. 11, no. 3, pp. 667–675, 2011. View at Publisher · View at Google Scholar