Green Intelligent Transport SystemView this Special Issue
A Bayesian Network Model for Origin-Destination Matrices Estimation Using Prior and Some Observed Link Flows
This paper presents a Bayesian network model for estimating origin-destination matrices. Most existing Bayesian methods adopt prior OD matrixes, which are always troublesome to be obtained. Since transportation systems normally have stored large amounts of historical link flows, a Bayesian network model using these prior link flows is proposed. Based on some observed link flows, the estimation results are updated. Under normal distribution assumption, the proposed Bayesian network model considers the level of total traffic flow, the variability of link flows, and the violation of the traffic flow conservation law. Both the point estimation and the corresponding probability intervals can be provided by this model. To solve the Bayesian network model, a specific procedure which can avoid matrix inversion is proposed. Finally, a numerical example is given to illustrate the proposed Bayesian network method. The results show that the proposed method has a high accuracy and practical applicability.
Information about the traffic demand, which commonly means the origin-destination (OD) matrices, has been traditionally used by transportation planning agencies to evaluate the impact of various strategic transportation plans. And the real-time OD matrices are essential for real-time traffic applications, especially in the intelligent transportation system (ITS), such as the real-time route guidance via a dynamic traffic assignment or the evaluation of various ITS deployment alternatives [1, 2].
Various methods have been proposed to estimate OD matrices by using aggregate data such as OD demand counts and/or a set of traffic counts observed on the links. Using information derived from traffic counts is very attractive because they are cheap, easy, and immediate data. However, based on these data, we cannot obtain a unique OD matrix because the number of OD pairs is much larger than the number of links in large-scale transportation networks and there are infinite solutions satisfying the conservation law.
In order to have a unique solution which must be close to the actual one, one has to give more information. Normally, people use a prior OD matrix which can be obtained by many different methods, such as an old out-of-date or subjectively guessed OD matrix. These methods for estimating OD matrices can be classified as least squares [3–9] and generalized least squares [10–12] methods, entropy or information based methods [13, 14], and statistical based methods.
Providing variability information of the traffic flow estimation is the most important advantage of the statistical methods. Normally, other methods give only the particular values of the OD and link flows, while statistical methods could also provide the corresponding probability intervals. The statistical methods can be categorized as follows. Classical methods [15–17]: the traffic flows are assumed multivariate random variables given some parametric families, such as Poisson, Gamma, and multivariate normal. Then, the problem reduces to estimating the parameters and becomes a standard statistical problem. Bayesian methods [18–21]: these methods also consider parametric families of distributions, but the parameters are considered as random variables themselves. Particularly, among the Bayesian methods, using Bayesian network [22–24] can easily know the relationship of all the variables (link flows and OD flows) and then simplify the calculation.
Whether using prior information (historical information or experience) or not is the main difference between Bayesian methods and classical statistical methods. In the Bayesian methods, based on some prior information, the prior distribution of some parameters or variables can be determined. Then by updating the sample information (observed information), we can derive the posterior distribution, which is the fundamental inferential tool of the Bayesian methods.
Generally, the quality of the prior information can affect the accuracy of the estimation when using the Bayesian methods. The prior information used by almost all existing Bayesian methods for estimating OD matrices is a prior OD matrix. However, it is difficult to guarantee the accuracy of the prior OD matrix, which is outdated or subjectively guessed. Moreover, it is even impossible to get a prior OD matrix in some cases, especially in a newly developed city.
In reality, there are usually large amounts of historical link flow data stored in the cities’ transportation system data base. Compared with a prior OD matrix, prior (historical) link flows are more accurate as they were obtained by traffic detectors or manual investigation. Therefore, in this paper, in order to estimate OD matrices, we propose a Bayesian network (BN) method using prior link flows and a set of new observed link flows. Based on these prior link flows, we can derive the prior distribution of link flows and OD flows. Then, by updating a set of observed link flows, we can modify the means and reduce the variances of the remaining variables. Using these updated means and variances, we can obtain the posterior distribution of all the variables. Based on the posterior distribution, both the point estimation and the corresponding probability intervals can be provided.
Note that the level of total traffic flow varies randomly and deterministically in similar situations (vacation, peak hour, special weather conditions, etc.) [20, 24]. So the proposed BN model also considers the level of total traffic flow, which is very useful for many real-time traffic applications. In addition, the BN model also considers the variability of link flows and the violation of the conservation law.
The rest of the paper is organized as follows. Section 2 briefly introduces Bayesian network and Gaussian Bayesian networks. In Section 3, the proposed BN model for estimating OD matrices and its main assumptions are described. In Section 4, using the Bayesian network model, a specific procedure for estimating OD matrices is proposed. In Section 5, a numerical example is provided to illustrate the proposed model and clarify some of its implementation details. Finally, some conclusions are provided in Section 6.
2. Bayesian Network and Gaussian Bayesian Network
In this section, we briefly review the Bayesian network and Gaussian Bayesian network, which are the basic tools of this paper.
Definition 1 (Bayesian network). A Bayesian network is a pair , where is a directed acyclic graph (DAG) defined on a set of nodes , is a set of conditional probability densities (CPDs), and is the set of parents of node in . The set defines the associated joint probability density (JPD) as
The graph contains all the qualitative information about the relationships among the variables. As a supplement, the probabilities in quantify the qualitative information in graph .
In Bayesian networks, the factorization of JPD implied by (1) is normally very simple and the conditional independence relations among variables can be inferred directly from the graph , which makes the evidence propagation easy. Due to these advantages, Bayesian network models have been used widely to solve a large variety of practical problems [25, 26].
Bayesian networks can be applied to many distributions. For the sake of illustration, we consider the important and particular case of Gaussian Bayesian networks, in which the traffic flows distribution is supposed to be a normal distribution. A normal distribution for traffic flows is reasonable, because these random variables are the sum of a great number of independent Bernoulli experiments in which the users decide where to travel and which routes to choose. In the literature, Gaussian Bayesian networks have been used frequently [24, 27].
Definition 2 (Gaussian Bayesian network). A Bayesian network is said to be a Gaussian Bayesian network if and only if the joint probability distribution (JPD) associated with its variables is a multivariate normal distribution, , that is, with joint probability density function:
where is the mean vector, is the covariance matrix, is the determinant of , and is the transpose of .
The JPD of the variables in a Gaussian Bayesian network can be specified as in (1) by the product of a set of CPDs, whose joint probability density function is where is the regression coefficient of in the regression of on its parents .
And the conditional variance of is where is the unconditional variance of , is the covariance matrix between and the variables in , and is the covariance matrix of .
3. Proposed Bayesian Network Model
Since Bayesian network has so many advantages as introduced in Section 2, in this section we propose a Bayesian network (BN) model to reproduce the probabilistic structure of link and OD flows.
3.1. Model Assumptions
Assuming we have some prior (historical) link flows, in order to give the prior distribution of the link flows, we make the following assumptions.
Assumption 3. The link flows are given by
Assumption 4. The variable is a normal random variable with mean and variance-covariance matrix , where is a normal random variable and measures the level of total mean flow. It reflects that traffic flows vary randomly and deterministically in similar situations (vacation, peak hour, special weather conditions, etc.). is a vector, whose elements measure the relative weights of link flows with respect to the total traffic flow; is a vector of independent normal random variables with zero mean; and measures the discrepancy of the flow of link with respect to its mean.
Note that traffic flows vary randomly and deterministically in similar situations (vacation, peak hour, special weather conditions, etc.) [20, 24]. Assumption 3 can take this into account. The distribution of varies with the situation. Based on prior link flows and considering the similar situation, the distribution of and the initial vector are determined. Then we can easily derive the prior distribution of link flows, which will be shown later. Assumption 4 is a normal assumption, which is also adopted in Maher , Hazelton , Castillo et al. , and so forth.
To give the prior distribution of OD flows, we first consider the well-known conservation law equation: where and are the flows of OD pair and link , respectively. is the incidence element; that is, it takes value 1 if link belongs to route of OD pair and 0, otherwise. is the proportion of users from OD pair choosing route . In this paper, the route choice proportions are defined by a logit model as follows: where is a parameter measuring travelers’ sensitivity to the cost difference between routes; is the cost associated with route of OD pair .
Equation (6) can be written as
Set to represent the proportions of users from OD pair choosing link . Then (8) can be rewritten in the form of matrix as
Matrix is not necessarily reversible because it is not necessarily a square. So we do the following conversion of (9):
If matrix is of full rank, it is reversible. Then, (10) can be written as
Set and according to (11), we make the following assumption.
Assumption 5. The OD flows are given by where are mutually independent normal random variables with mean and variance . The variables represent OD flows apart from those using links of the considered network. Setting all the variables of to be null or evaluating their values, the conservation law equation can be satisfied.
3.2. The Complete Model
Based on Definitions 1 and 2, in order to complete our BN model, we need to define an associated graph . For example, consider the simple network shown in the left of Figure 1, which has 2 nodes, 2 links, and 1 OD pair 1-2. The right of Figure 1 shows the associated Bayesian network. The link flow node has as parents the corresponding node and . The OD flow node has as parents the corresponding node and .
Based on Assumption 5, we get
Then, the mean is
And the variance-covariance matrix of is where is the variance matrix of .
In summary, all random variables involved in our model are related by the linear expression:
The mean is
And the variance-covariance matrix is
Then, the prior distribution (joint probability density function) of all the variables can be given as
4. Estimating OD Matrices Using the Proposed BN Model
In this section, using the proposed BN model, we describe how to estimate the OD matrices when some new observed link flows are available.
Since we have obtained the prior distribution of all the variables, we can use the following equations to update the mean and the covariance matrix of the variables [23, 24] based on some observed variables. Note that one only needs to consider the unobserved variables conditioned on the observed variables and then update the expected values and covariance of the remaining variables. These equations are where and are the sets of unobserved and observed variables, respectively; and are the mean vector and covariance matrix of ; and are the mean vector and covariance matrix of ; and is the covariance matrix of and .
Given a set of evidential nodes whose values are known to be , by (21) and (22), we can derive the mean vector and covariance matrix of the unobserved nodes in . Thus, the conditional distribution of can be obtained. Equations (23) and (24) state that the expected values of the observed variables coincide with their observed values and their variances and covariances are null. In order to simplify the calculation, we can use an incremental method, that is, updating evidence from one by one. Thus, we do not need to calculate the matrix inverse operation, because the matrix degenerates to a scalar. In this case, is a column vector and is a scalar (i.e., ).
If we want to give the point estimation as well as the corresponding probability intervals, we can solve the following maximum posterior distribution problem to get the point estimation, whose results are normally the conditional means: where is the set of the observed variables, including those observed link flows and/or OD flows.
In summary, the specific procedure for estimating OD matrices and those unobserved link flows is given as follows.
Step 0. Initialize the model. According to Assumptions 3 and 4, based on prior (historical) link flows, we can determine the distribution of and the initial matrix . Then we can obtain the initial link flows . Thus the initial route choice proportion is calculated as follows: where (26) is the link cost function, where is the cost associated with free flow conditions, is the link capacity, and and are constants defining how the cost increases with traffic flow; (27) is the route cost function; (28) calculates the route choice proportion defined in (7).
Step 1. Solve the BN model. According to model assumptions, using the initial route choice proportion matrix , we can get the prior distribution of traffic flows (prior means and variances) using the following formulas: where (29) is for calculating the regression coefficient matrix given in (12). Equations (30) and (31) are for calculating the means of and given in (17). Equation (32) defines the diagonal variance matrix of ; that is, , where is the coefficient of variation. Equations (33) to (36) define the variance-covariance matrix in (19).
Step 2. Update the observed link flows, using the formulas where (37) and (38) are for updating the means and variance-covariance matrix of the unobserved variables, where and refer to the unobserved and observed components of (), respectively. Equations (39) and (40) state that the expected values of the observed variables are their observed values and their variances and covariances are zero, as given in (23) and (24). Equation (41) takes the conditional means as point estimation for the OD and link flows, as the results of the maximum posterior distribution problem given in (25).
Step 3. Calculate the new route choice proportions. Since link flows are updated in Step 2, the route choice proportions also need to be updated. Given that the matrix is obtained by (41), the new route choice proportion is calculated using the following expressions: where (42) is the conservation law equation given in (6).
Step 4. Test convergence. If , where is a small number to control convergence of the process, then stop the process and return the OD flow , the link flow , and the route choice proportion . Otherwise, continue with Step 5.
Step 5. Update route choice proportions and the matrix , using the expressions and go to Step 1, where (46) is for updating the route choice proportion matrix, where , , is a relaxation factor; (47) is for updating the matrix . The values of variables are obtained by (42).
5. Example: The Nguyen-Dupuis Network
In this section, we illustrate the proposed methods using the well-known Nguyen-Dupuis network, shown in Figure 2. It consists of 13 nodes, 19 links, and 4 OD pairs: 1-2, 1-3, 4-2, and 4-3.
The assumed true OD matrices, which are used later for testing the quality of the estimation, are shown in Table 4 under the heading “True flow.” The true link flows are obtained by solving the multinomial logit assign model with parameter for the stochastic loading.
The prior information is assumed as follows: the expected value of the level of total traffic flow and its standard deviation are and , respectively and the initial matrix is
The observed link flows are assumed to be , , , , and . And it is supposed that they are known in this order. Since they are observed, their values are equal to the true link flows (as shown in Table 4).
Based on the prior information, we can get the prior distribution of the traffic flows. The prior means and variances are shown in the second columns of Tables 2 and 3, respectively. To simplify the calculation, in this example, the expectation and variance-covariance of are assumed to be null (i.e., there is no uncertainty in the conservation law). In addition, to obtain the variance-covariance matrix , we have selected in (32).
Table 2 shows how the means of the traffic flows changed after updating the observed link flows one by one. After each update, the point estimation of link flows and OD flows is provided. It can be seen that once and become known and updated, the point estimation of in Table 2 remains unchanged and its variance in Table 3 becomes zero (boldfaced in the table). Because, due to the flow conservation in node 6, once and become known, becomes known. Similarly, becomes known once is given; becomes known once is given; becomes known once and are given; becomes known once is given; becomes known once , , and are given. In other words, due to the conservation law, the observed link flows are known in this order: , , , , , , , , , , and .
Table 3 shows how the variances of the traffic flows changed after updating the observed link flows one by one. Note that after some link flows (including the observed link flows and those derived from the observed link flows and the conservation laws) are known, their means remain constant and their variances become null (boldfaced in the tables). And normally the variances of the unknown variables (OD flows and those unobserved link flows) decrease with each update. Note that the smaller the variances, the higher the precision of the estimation. So after a series of update, the estimation becomes more accurate. This derives a method to determine how many links and what links need to be observed when estimating traffic flows by the Bayesian network model, that is, the network sensor location problem (NLSP) . Note that the variances updating equation (22) has no relevance with the values of the observed link flows. So we can solve NLSP without observing any link. First, by the Bayesian network model, we can get the prior distribution of all the variables shown in (19). Next, we can take the link which can reduce the variance of the OD flows maximally by updating as the first observed link. Then we update the variances of traffic flows, determine the second observed link, and iterate until the variances decrease to meet the requirement of the estimation precision or until the budget exceeds the constraint.
By the updated means (point estimation) and variances, we can obtain the posterior distribution of OD flows and those unobserved link flows. Figure 3 illustrates how the marginal densities of OD flows and those unobserved link flows evolve from their initial form to their final form (boldfaced) by updating the observed link flows one by one. It can be seen that the variances of the unknown variables are normally decreasing with each update.
In summary, according to Tables 2 and 3 and Figure 3, using the proposed Bayesian network method, after some variables are observed, the means of these observed remain constant and their variances become null. For the remaining variables (those unobserved), their variances are normally decreasing with each update. The proposed method can provide a control of the conservation law as well. The final forms (boldfaced) in Figure 3 are the posterior densities of OD flows and those unobserved link flows. These posterior densities supply complete statistical information about the unknown variables. By these posterior densities, we can provide the point estimation as well as the corresponding probability intervals.
In order to test the quality of the estimation, Table 4 compares the true flow and the point estimation of the proposed BN model. Because , , , , , , , , , , and are observed, their values are equal to the true flow. And studying the OD pairs and those unobserved links (boldfaced in the table), it can be seen that the estimation and true flow are basically the same. The relative errors are all very small and the maximum relative error value of the OD flows estimation is only 4.70%. This illustrates that the proposed BN model has a high accuracy.
In this paper, we use a Bayesian network model to estimate origin-destination matrices based on prior link flows and a set of observed link flows. Normally, large amounts of historical link flows are stored in the cities’ transportation system. Compared with an outdated or subjectively guessed prior OD matrix, prior link flows are more accurate as they are obtained by traffic detectors or manual investigation. The proposed Bayesian network model can make use of these historical link flows and also consider the level of total traffic flow, which is really useful for many real-time traffic applications, especially in the ITS.
Using the Bayesian network model and updating the observed variables (including the observed link flows and those derived from the observed link flows and the conservation law) can modify the means and reduce the variances of the remaining variables. These updated means and variances allow us to obtain the posterior distribution of the unobserved variables based on those observed. Thus, the methods can provide not only point estimation but also the corresponding probability intervals. In addition, an incremental procedure is developed for solving the Bayesian network model without the intensive computation of matrix inversion, which can make this model apply easily in large-scale networks.
Moreover, in this paper, a normal distribution for traffic flows is assumed. It is reasonable because these random variables are the sum of a great number of independent Bernoulli experiments in which the users decide where to travel and which routes to choose. For future research, it is worthwhile to relax the normal distribution assumption.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
This research is supported by the National Natural Science Foundation of China (no. 51178110 and no. 51378119) and Graduate Innovation Project of Jiangsu Province (no. CXZZ12_0113). Comments provided by anonymous referees are much appreciated.
M. Ben-Akiva, M. Bierlaire, J. Bottom, H. Koutsopoulos, and R. Mishalani, “Development of a route guidance generation system for real-time application,” in Proceedings of the IFAC Transportation Systems Conference, Beijing, China, 1997.View at: Google Scholar
M. G. Bell, “The estimation of origin–destination matrix from traffic counts,” Transportation Science, vol. 17, no. 2, pp. 198–217, 1983.View at: Google Scholar
E. Cascetta and S. Nguyen, “A unified framework for estimating or updating origin/destination matrices from traffic counts,” Transportation Research B: Methodological, vol. 22, no. 6, pp. 437–455, 1988.View at: Google Scholar
H. Yang, “Heuristic algorithms for the bilevel origin-destination matrix estimation problem,” Transportation Research B: Methodological, vol. 29, no. 4, pp. 231–242, 1995.View at: Google Scholar
M. G. H. Bell, “The estimation of origin-destination matrices by constrained generalised least squares,” Transportation Research B: Methodological, vol. 25, no. 1, pp. 13–22, 1991.View at: Google Scholar
H. J. van Zuylen and L. G. Willumsen, “The most likely trip matrix estimated from traffic counts,” Transportation Research B: Methodological, vol. 14, no. 3, pp. 281–293, 1980.View at: Google Scholar
Y. Vardi, “Network tomography: estimating source-destination traffic intensities from link data,” Journal of the American Statistical Association, vol. 91, no. 433, pp. 365–377, 1996.View at: Google Scholar
M. J. Maher, “Inferences on trip matrices from observations on link volumes: a Bayesian statistical approach,” Transportation Research B: Methodological, vol. 17, no. 6, pp. 435–447, 1983.View at: Google Scholar
C. Tebaldi and M. West, “Bayesian inference on network traffic using link count data,” Journal of the American Statistical Association, vol. 93, no. 442, pp. 557–573, 1998.View at: Google Scholar
J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufman, San Mateo, Calif, USA, 1988.
F. V. Jensen, Bayesian Networks and Decision Graphs, Springer, 2001.
S. L. Zhu, L. Cheng, Z. M. Chu, C. Anthony, and J. X. Chen, “Identification of network sensor locations for traffic flow estimation,” accepted by Journal of the Transportation Research Board.View at: Google Scholar