An Improved Deep Learning Model for Traffic Crash Prediction

Dong, Chunjiao; Shao, Chunfu; Li, Juan; Xiong, Zhihua

doi:https://doi.org/10.1155/2018/3869106

Journal of Advanced Transportation

On this page

Abstract Introduction Literature Review Data Conclusions Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Machine Learning in Transportation

View this Special Issue

Research Article | Open Access

Volume 2018 | Article ID 3869106 | https://doi.org/10.1155/2018/3869106

An Improved Deep Learning Model for Traffic Crash Prediction

Chunjiao Dong,^1,2,3Chunfu Shao,^1,2Juan Li,¹and Zhihua Xiong¹

Guest Editor: Hamzeh Khazaei

Received12 Jun 2018

Accepted12 Nov 2018

Published10 Dec 2018

Abstract

Machine-learning technology powers many aspects of modern society. Compared to the conventional machine learning techniques that were limited in processing natural data in the raw form, deep learning allows computational models to learn representations of data with multiple levels of abstraction. In this study, an improved deep learning model is proposed to explore the complex interactions among roadways, traffic, environmental elements, and traffic crashes. The proposed model includes two modules, an unsupervised feature learning module to identify functional network between the explanatory variables and the feature representations and a supervised fine tuning module to perform traffic crash prediction. To address the unobserved heterogeneity issues in the traffic crash prediction, a multivariate negative binomial (MVNB) model is embedding into the supervised fine tuning module as a regression layer. The proposed model was applied to the dataset that was collected from Knox County in Tennessee to validate the performances. The results indicate that the feature learning module identifies relational information between the explanatory variables and the feature representations, which reduces the dimensionality of the input and preserves the original information. The proposed model that includes the MVNB regression layer in the supervised fine tuning module can better account for differential distribution patterns in traffic crashes across injury severities and provides superior traffic crash predictions. The findings suggest that the proposed model is a superior alternative for traffic crash predictions and the average accuracy of the prediction that was measured by RMSD can be improved by 84.58% and 158.27% compared to the deep learning model without the regression layer and the SVM model, respectively.

1. Introduction

Road traffic injuries are a leading cause of preventable death, especially, for the young people. In the United States, traffic crashes were the number one cause of death among people from 16 to 24 years old for each year from 2012 to 2014 [1]. In 2015, the nation lost 35,092 people in traffic crashes, a 7.2-percent increase from 32,744 in 2014, which is the largest percentage increase in nearly 50 years [2]. This is an average of approximately 96 people being killed on the nation’s roadways every day of the year, and an average of more than four people per hour. In other words, one person dies on roadways every 15 minutes.

To understand the relationship between the influence factors and traffic crash outcomes, with the extracted data from police reports and state highway-asset-management databases, the analyses of traffic safety estimate and predicate the likelihood of a traffic crash. The number of crashes occurring on a defined spatial entity over a specific time period (for example, the number of crashes per year occurring at a roadway intersection, over a specified roadway segment, or in a region) would be considered as the dependent variables and some of the many factors affecting the likelihood of a traffic crash are analyzed and examined (see [3–5] for a comprehensive review). Though more and more factors that are relevant to the traffic crashes have been incorporated and the proposed models became more and more sophisticated, there are still some factors that are not available to the researchers and the models result in bias estimations and erroneous predictions. In this study, we proposed an innovative approach for traffic crash prediction, which incorporates a multivariate regression layer into a dynamic deep learning model that contains an unsupervised feature learning module and a supervised fine tuning module governing the state dynamics to improve the performances of prediction.

2. Literature Review

The statistical methodologies, such as the Poisson, negative binomial (NB), and their variants in univariate and multivariate regression frameworks, have been successfully applied in crash count analyses [4, 6–8], which attempt to deal with the data and methodological issues associated with traffic crash estimations and predictions, and enhance our understanding on the relationship between the influence factors and traffic crash outcomes. However, current research in traffic safety indicates that the applied statistical modeling fails when dealing with complex and highly nonlinear data [9], which could suggest that the relationship between the influence factors and traffic crash outcomes is more complicated than can be captured by a single statistical approach. In addition, most of the statistical methods are based on some strong assumptions, such as specifying a priori and the error distribution. Moreover, a problematic issue is multicollinearity, i.e., the high degree of correlation between two or more independent variables. Furthermore, statistical models have difficulty when dealing with outliers, missing or noisy data [10].

To deal with the limitations of statistical methodologies, the machine learning methods, including Artificial Neural Network (ANN), Support Vector Machine (SVM) models, and deep learning models, have been applied to various traffic safety problems and used as data analytic methods because of their ability to work with massive amounts of multidimensional data. In addition, because of the modeling flexibility, learning and generalization ability, and good predictive ability, the machine learning has been considered as generic, accurate, and convenient mathematical models in the field of traffic safety.

Because the commonly used Poisson or NB regression models assume the predefined underlying relationship between dependent and independent variables and the violation of the assumption would lead to erroneous estimation, ANN and Bayesian neural network (BNN) models have been employed to analyze the traffic safety problems for many years. Although both ANN and BNN models have similar multilevel network structures, they are different in predicting the outcome variables. For ANN, the weights are assumed to fix. However, the weights of BNN follow a probability distribution and the prediction needs to be integrated over all the probability weights. Basically, the ANN can be characterized by three features: network architecture, model of a neuron, and learning algorithms. Chang [11] compared the performances of NB regression model and ANN in crash frequency analyses. The results showed that ANN is a consistent alternative method for analyzing crash frequency. Abdelwahab and Abdel-Aty [12] employed two well-known ANN paradigms [the multilayer perceptron and radial basis functions (RBF) neural networks] to analyze the traffic safety of toll plazas and evaluate the impacts of electronic toll collection (ETC) systems on highway safety. The performance of ANN was compared with calibrated logit models. Modeling results showed that the RBF neural network was the best model for analyzing driver injury severity. Xie, Lord, and Zhang [13] evaluated the application of BNN models for predicting traffic crashes by using data collected on rural frontage roads in Texas. The results showed that back-propagation neural network (BPNN) and BNN models perform better than the NB regression model in terms of traffic crash prediction. The results also showed that BNNs could be used to address other issues in highway safety, such as the development of crash modification factors, and enhance the prediction capabilities for evaluating different highway design alternatives. Kunt, Aghayan, and Noii [14] employed a genetic algorithm (GA), pattern search, and ANN models to predict the severity of freeway traffic crashes. The results showed that the ANN provided the best predictions. Jadaan, Al-Fayyad, and Gammoh [15] developed a traffic crash prediction model using the ANN simulation with the purpose of identifying its suitability for predicting traffic crashes under Jordanian conditions. The results demonstrated that the estimated traffic crashes are close to actual traffic crashes. Akin and Akbas [16] proposed an ANN model to predict intersection crashes in Macomb County of the State of Michigan. The predictive capability of the ANN model was determined by classifying the crashes into these types: fatal, injury, and property damage only (PDO) crashes. The results were very promising and showed that ANN model is capable of providing an accurate prediction (90.9%) of the crash types. In summary, though ANN and BNN models show better linear/nonlinear approximation properties than traditional statistical approaches, these models often cannot be generalized to other data sets [3].

The SVM models have recently been introduced for traffic safety analyses [17, 18], which are a new class of models that are based on statistical learning theory and structural risk minimization [19]. These models are supposed to approximate any multivariate function to any desired degree of accuracy with a set of related supervised learning methods. Li et al. [17] evaluated the application of SVM models for predicting motor vehicle crashes. The results showed that SVM models predict crash data more effectively and accurately than traditional NB models. In addition, the findings indicated that the SVM models provide better (or at least comparable) performance than BPNN models and do not over-fit the data. To identify the relationship between severe crashes and the explanatory variables and enhance model goodness-of-fit, Yu and Abdel-Aty [20] developed three models to analyze crash injury severity, which include a fixed parameter logit model, a SVM model, and a random parameter logit model. The results showed that the SVM models and the random parameter models provide superior model fits compared to the fixed parameter logit model. Findings also demonstrate that it is important to consider possible nonlinearity and individual heterogeneity when analyzing traffic crashes. Chen et al. [21] employed the SVM models to investigate driver injury severity patterns in rollover crashes using two-year crash data collected in New Mexico. The results showed that the SVM models produce reasonable predictions and the polynomial kernel outperforms the Gaussian RBF kernel. Dong, Huang, and Zheng [22] proposed a SVM model to handle multidimensional spatial data in crash prediction. The results showed that the SVM models outperform the nonspatial models in terms of model fitting and predictive performance. In addition, the SVM models provide better goodness-of-fit compared with Bayesian spatial model with conditional autoregressive prior when utilizing the whole dataset as the samples. Ren and Zhou [23] proposed a novel approach that combines particle swarm optimization (PSO) and SVM for traffic safety prediction. The results showed that the predictions of PSO-SVM are better than that from BP neural network. Yu and Abdel-Aty [24] proposed the SVM models with different kernel functions to evaluate real-time crash risk. The results showed that the SVM model with RBF kernel outperformed the SVM model with linear kernel and Bayesian logistic regression model. In addition, the findings showed that smaller sample size could improve the classification accuracy of the SVM models and variable selection procedure is needed prior to the SVM model development. Overall, it has been found that the SVM models showed better or comparable results to the outcomes predicted by ANN/BNN and other statistical models [19]. However, like ANN and BNN, the SVM models often cannot be generalized to other data sets and they all tend to behave as black-boxes, which cannot provide the interpretable parameters as statistical models do.

Other than the ANN/BNN and SVM models, other machine learning methods have been introduced in traffic safety analyses. Abdel-Aty and Haleem [25] introduced a recently developed machine learning technique—multivariate adaptive regression splines (MARS) to predict vehicle angle crashes using extensive data collected on unsignalized intersections in Florida. The results showed that MARS outperformed the NB models. The proposed MARS models showed promising results after screening the covariates using random forest. The findings suggested that MARS is an efficient technique for predicting crashes at unsignalized intersections.

Deep learning is a recently developed branch of machine learning method and has been successfully applied in speech recognition, visual object recognition, object detection, and many other domains such as drug discovery and genomics [26, 27]. Compared to the conventional machine learning techniques that were limited in their ability to process natural data in their raw form, deep learning constructs computational models aiming to extract inherent features in data from the lowest level to the highest level. Though the deep learning methods have shown outstanding performances in many applications [26], the applications of deep learning in the field of transportation are relatively few and only focusing on the topic of traffic flow prediction [28–30]. In this study, we proposed an improved deep learning model for traffic crash prediction. The proposed model includes two modules: an unsupervised feature learning module and a supervised fine tuning module. To discover nonlinear relationship between the investigated variables and identify the impacts of influence factors on traffic crashes for roadway network, a DAE model is proposed in the unsupervised feature learning module to learn the features of explanatory variables. In addition, a multivariate negative binomial (MVNB) regression is embedding into the supervised fine tuning module to address the heterogeneity issues. The proposed model performances are evaluated by comparing to the deep learning model without the MVNB layer and SVM models by using five-year data from Knox County in Tennessee.

3. The Modeling Framework Formulation

A novel model is proposed for the traffic crash prediction and Figure 1 illustrates the modeling framework. The proposed model includes two modules. One is the unsupervised feature learning module and another is the supervised fine tuning module. The obtained encoded feature representations from the unsupervised feature module are used as the input for the supervised fine tuning module.

3.1. Unsupervised Feature Learning Module

Compared to the commonly used deep learning architectures including deep belief network [31], stacked autoencoder [32], and convolutional neural networks [27], the symmetrical neural networks in an unsupervised manner have shown better performances, which can automatically learn an appropriate sparse feature representation from the raw data [33]. The unsupervised feature learning module includes a denoising autoencoder (DAE) model to learn the underlying structure of the dynamic pattern among the characteristics of roadway, traffic, and environment. With the explanatory variables, such as roadway geometric design features, traffic factors, pavement factors, and environmental characteristics as the input, the designed DAE model can identify the nonlinear relationship between the investigated variables in an unsupervised and hierarchical manner and the robust feature representations can be obtained. In addition, the designed DAE model can encode the explanatory variables into an embedding low-dimensional space. The proposed DAE model contains a visible layer, a hidden layer, an output layer, and a reconstruction layer. Unlike the conventional DAE model with K hidden layers [34], the proposed model uses a reconstruction error optimizing the output layer and the noisy input layer to generate higher level representations.

Assume is a training set that contains n roadway entities, where is the explanatory variable vector with dimension D and u_i is the multivariate traffic safety outcomes for roadway entity i. Given the training set, the proposed DAE model is trained to develop a robust feature representation by reconstructing the input v_i from its noisy corrupted version , as shown in Figure 1.

There are D units in the visible layer and F units in the hidden layer and the proposed model can be defined by a parameter set , where is the interlayer connection weights, is the visible self-interactions or biases, is the hidden biases, and is the reconstruction error. The joint probability distribution between the noisy input variables and hidden variables is defined aswhere is an energy function defined by symmetric interactions between the noisy input variable, hidden variables, and a set of interaction parameters Θ; Z(Θ) is a normalized factor.

For a binary variable, a Bernoulli-Bernoulli energy function [34, 35] and the conditional distribution of a single stochastic hidden variable are given by

For a continuous variable, a Gaussian-Bernoulli energy function [31] and the conditional distribution of a single stochastic hidden variable are given bywhere , , and is the standard deviation of the i-th visible variable v_i centered on the bias a_i.

The conditional distribution over hidden units can be factorized and computed by

To estimate the parameters, the method proposed by Hjelm et al. [35], which maximizes the log-likelihood of the marginal distribution of the hidden units to find the gradient of the log-likelihood, is employed in this research. To simplify the estimation process, the free energy in terms of the probability at a data point v_n can be used to replace the energy function and the gradient has the following form: where , and the conditional distribution over hidden units should be replaced by a loss function. Considering the hidden layer as the input layer for the outcome layer and outcome layer as the hidden layer, the joint probability distribution between the hidden variables and outcome variables, energy function, the conditional distributions of the outcome variables and units, and parameter estimation process can be obtained as those for hidden layer. The model will stop training when c_k satisfies the reconstruction error requirements or the dimension of the feature representation achieves the designed goals.

3.2. Supervised Fine Tuning Module

The supervised fine tuning module is a supervised fine tuning procedure that includes a regression layer on the top of the resulting hidden representation layers to estimate the likelihood of the crash occurrences, as shown in Figure 1. The obtained encoded feature representations from the unsupervised feature module are used as the input for the supervised fine tuning module. To jointly estimate the occurrence likelihood for more than one type of crashes simultaneously and address the potential heterogeneity issues in the interdependent crash data, a multivariate negative binomial (MVNB) model is used in the supervised fine tuning module to estimate and predict the traffic crashes across injury severities. Assume y_i=(y_i1, y_i2,…, y_im)′ is a vector of crash occurrence likelihood for roadway entities i, which includes m types of crashes. The particular NB regression model employed in this study has the following form:where is the gamma function, y_ij is the crash number of crash type j for roadway segment i and E[y_ij]=λ_ij=. is a multivariate gamma-distributed error term with mean 1 and variance α⁻¹.

As described in Shi and Valdez [36] and Anastasopoulos et al. [37], with the expected number of crashes λ_ij, the MVNB model has a joint probability function:The model parameters can be estimated by maximizing the log-likelihood function:

The MVNB regression layer is added on the top of the resulting hidden representation layers to perform traffic crash prediction. This yields a deep learning model tailored to a task-specific supervised learning. Then we fine tune the module 2 using backpropagation by minimizing the following cost function:where s(·) is an indicator function, if y_ij’=y_ij, then s(·)=1; otherwise, s(·)=0, α is a regularization parameter, and is the Frobenius norm. The first term refers to the cross entropy loss for the regression layer, the second term is the weight decay penalty, and is the output of deep learning for an input ’.

The cost function is minimized with a min-batch gradient descent algorithm [27]. The parameters in module 2 are estimated by initializing the weights of the regression layer to small random values and the weights of the F hidden layers are initialized by the encoding weights obtained in the unsupervised feature learning module.

4. Data

The data are obtained from the Tennessee Roadway Information Management System (TRIMS) and the Pavement Management System (PMS), which are maintained by the Tennessee Department of Transportation (TDOT). The dataset includes crash data, traffic factors, geometric design features, pavement factors, and environmental characteristics. The traffic, geometric, pavement, and environmental characteristics are linked to the crash data through the common variable id_number. An extensive and comprehensive data screening that includes cleaning, consistency, and accuracy checks is processed and performed to ensure the data are useable, reliable, and valid for the analyses. After the initial data screening, in total 635 roadway segments in Knox County are chosen for the analyses. For the selected roadway segments, each of them has a completed dataset that links to the crash data. In other words, the dataset contains detailed information on traffic factors, geometric design features, pavement characteristics, and environment factors.

In TRIMS, the crash data have been classified into five categories, fatal crashes, incapacitating injury crashes, nonincapacitating injury crashes, possible-injury crashes, and PDO crashes. Because the category of fatal crashes has only a few observations, the categories of fatal crashes and incapacitating injury crashes have been combined and referred to as major injury crashes. The possible-injury crashes and PDO crashes have been combined and referred to as no-injury crashes. The nonincapacitating injury crashes are referred to as minor injury crashes. A few of pervious literature [38–40] has used a similar classification for injury outcomes. For those selected 635 roadway segments, from 2010 to 2014, a total of 5365 traffic crashes were reported by the police officers, which include 135 (2.51%) major injury crashes, 1312 (24.46%) minor injury crashes, and 3917 (73.02%) PDO crashes. Individual roadway segment experienced from 0 to 23 crashes per year with a mean of 1.54 and a standard deviation of 1.89. As expected, a significant amount of zeros is observed. The dependent variables and their descriptive statistics are shown in Table 1. The descriptive statistics of continuous independent variables and categorical independent variables are shown in Tables 1 and 2, respectively.

The considered traffic factors include the logarithm of annual average daily traffic (AADT) per lane, truck traffic percentage, and posted speed limits. Roadway segment AADT per lane from 2010 to 2014 varies from 851 to 32,359 vehicles with a mean of 3,388.44 and a standard deviation of 5495.41. Other than the TRIMS dataset maintained by the DDOT, traffic flow information can be obtained from https://www.tdot.tn.gov/APPLICATIONS/traffichistory, which is an AADT map providing traffic volumes based on a 24-hour, two-directional count at a given location. The website also provides the traffic history of any specific count station. The variable of posted speed limit has a mean of 38.65 and a standard deviation of 6.69 with a minimum value of 30 and a maximum value of 70. The truck traffic percentage varies from 1 to 33 with a mean of 6.71 and a standard deviation of 4.98.

Important measurements of geometric design features considered in this study include segment length, degree of horizontal curvature, median widths, outsider shoulder widths, number of through lanes, lane widths, number of left-turn lanes, median types, and shoulder type. Among them, the segment length, degree of horizontal curvature, median widths, and outsider shoulder widths are considered as the continuous variables and the others are considered as the categorical variables. Other than the traffic factors and geometric design features, the impacts of pavement surface characteristics are considered to better address traffic safety issues for roadway design and maintenance. The considered pavement surface characteristics include international roughness index (IRI) and rut depth (RD). The analyzed IRI varies from 25.45 to 182.58 with a mean of 65.85 and a standard deviation of 27.75, which is calculated using a quarter-car vehicle math model and the response is accumulated to yield a roughness index with units of slope (in/mi). Another pavement condition indicator is the RD, which is measured at roadway speeds with a laser/inertial profilograph. The analyzed RD varies from 0.06 to 0.41 with a mean of 0.13 and a standard deviation of 0.05.

The environmental factors, including terrain types, lighting condition, and land use type, are considered. Two terrain types are examined, which include rolling terrace (62.03%) and mountainous terrace (37.97%). Lighting condition was considered as a category variable, which indicated whether lighting devises are provided at the roadway segments. Three types of land use are considered, including commercial (24.41%), rural (24.49%), and residential (51.10). These variables are considered because they might have potential significant effects on traffic safety.

5. Modelling Results

The MATLAB was employed for model development. Four-year data, from 2010 to 2013, were used as the training set and one-year data, the year of 2014, were used as the testing set. In order to obtain the model with superior performance, module 1 was developed using 9 Gaussian visible units, 13 binary visible units, and a number of hyperbolic tangent hidden units ranging from 32 to 128 in steps of 2. The number of hidden units was setting based on two rules, greater than the input data dimensionality and the powers of two. The parameters for learning rate and weight decay were selected to optimize reduction of reconstruction error over training. Module 1 was trained with a sample size of 2540 (four-year crash data) to allow for full convergence of the parameters. The input data were processed by using module 1 to capture the relationship between traffic factors, geometric design features, pavement conditions, and environmental characteristics. Module 2 was developed using 4 Gaussian visible units and a number of hyperbolic tangent hidden units. The initial number of hyperbolic tangent hidden units ranging from 8 to 32 was tested and examined. The learning procedure will stop when the number of feature representations is achieved to four or the reconstruction error is less than 0.01.

5.1. Results of Unsupervised Feature Learning Module

For the final model, the reconstruction error is less than 0.01 and four hidden layers are included. The weights between the input layer and output layer can be calculated as W_32×16W_16×8W_8×4=W_32×4. The results are shown in Table 3. The negative sign represents a crash-prone condition and a positive sign represents a safe-prone condition. The valued number indicates an evaluation score. Because the feature learning module identifies relational information between input variables and output feature representations, the connection weights between visible units and hidden units can be interpreted as the functional networks [35]. The results show that each of the output units is significant associated with traffic factors, geometric factors, pavement factors, and environmental factors.

Since the proposed feature learning module has symmetric connection between visible and hidden layers and the units in both layers have the probabilistic characteristics, the proposed feature learning module also can be called as an auto-encoder. Thus, the values of output units can be interpreted as a feature representation and the results are shown in Table 4. The number of output units is smaller than the number of visible units, which indicates the feature representation with the values of output units has reduced the dimensionality of the input, but still preserving the original information. Hence the four output units are defined as traffic feature representation, geometric feature representation, pavement feature representation, and environmental feature representation.

The results show that the signs of the means of four feature representations are negative, which indicate that the feature representations are associated with crash-prone condition. In other words, the current traffic, geometric, pavement, and environmental features are the main factors that attribute to the risk of crash occurrences. The findings indicate that the traffic, geometric, pavement, and environmental factors have a direct influence on traffic safety and need to be improved.

The traffic feature representations have a wide range with a minimum value of -4.420 and a maximum value of 6.650, which indicate the traffic factors have a significant impact on traffic safety. The pavement factors have comparative impacts on traffic safety with a minimum value of -12.076 and a maximum value of 6.753. The ranges of geometric and environmental feature representations are from -1.386 to 1.280 and from -1.805 to 0.847, respectively, which indicate that the geometric and environmental feature representations have comparative effects on traffic safety. Compared to those crash modeling techniques that use only geometric design features as the input factors, the current research reveals new insights that would benefit the development of updated guidelines.

5.2. Results of the Supervised Fine Tuning Module

For the supervised fine tuning module, the visible units of the input layer use the feature representations as the input and the crash counts across injury severities are used as the training target. The aggregate weights between the input layer and output layer are shown in Table 5. The results show that the traffic and geometric feature representations have positive effects and pavement and environmental feature representations have negative effects on traffic crashes across injury severities. The findings indicate that decreasing the values of traffic and geometric feature representations will increase the likelihood of crashes and increasing the values of geometric and environmental feature representations will increase the likelihood of crashes. The comparison results show that traffic feature representation and geometric feature representation have significant impact on PDO crashes. The pavement feature representation and environmental feature representation have significant impact on minor injury crashes. Among four feature representations, the geometric feature representation, pavement feature representation, and traffic feature representation have most direct impacts on major injury, minor injury, and PDO crashes, respectively.

Considering the data in the year of 2014 as the input variables, the developed deep learning model is used to predict the crash counts for the year of 2014. To validate the superiority of the proposed models, the predicted results are compared to the observed values. In addition, a deep learning model without the regression layer and a support vector machine (SVM) model are also developed to predict crash counts across injury severities. There are two key issues related to the development of SVR models, kernel selection, and parameters optimization. To address the nonlinear relationship between the outcomes and attributes, the commonly used RBF kernel is chosen to develop the SVM model. To precisely reflect the performance on regressing unknown data and prevent the overfitting problem, the k-fold cross-validation approach is employed for optimizing the two parameters in RBF kernels—C and ε [41, 42]. The optimized parameters are (42.30, 37.09) and the optimized SVM model yields to a training mean absolute error (MAE) less than 0.01 and a training root-mean-squared deviation (RMSD) less than 5%.

To evaluate the accuracy and reliability of the prediction results, the predicted means for each injury severity level by the proposed model, the deep learning model without the regression layer, and the SVM model are compared to the observed means and two evaluation measures are used, which include MAE and RMSD. The comparison and validation results are shown in Table 6. Results in Table 6 indicate that the predicted means from the proposed model (0.110, 0.573, 1.335, and 2.019 for major injury, minor injury, no-injury, and all crashes, respectively) are very close to the observed means (0.096, 0.556, 1.306, and 1.986). We believe that a very importation feature of the proposed model is that the included regression layer can provide a good estimate of the chance that the roadway segment is in the crash-free state or some crash-prone propensity states.

For all the observed samples, the proposed model results in a MAE of 0.030, 0.080, 0.071, and 0.150 and a RMSD of 17.298%, 29.961%, 27.206%, and 43.652% for major injury, minor injury, PDO, and all crashes, respectively. The deep learning mode without the regression layer results in a MAE of 0.043, 0.202, 0.405, and 0.520 and a RMSD of 20.620%, 51.741%, 65.086%, and 82.862% for major injury, minor injury, PDO, and all crashes, respectively. The SVM model results in a MAE of 0.055, 0.257, 0.471, and 0.660 and a RMSD of 26.022%, 61.350%, 72.416%, and 96.636% for major injury, minor injury, PDO, and all crashes, respectively. The results suggest that the proposed model predicts better than the deep learning model without the regression layer and the SVM model. In summary, compared to the deep learning model without the regression layer and the SVM model, the proposed model results in the smallest prediction MAE and RMSD, no matter for the crash types across injury severities. We hypothesize that the proposed model better addresses the issue of heterogeneity and allows for excess zero counts in correlated data.

The findings indicate that the predictions from the proposed model have significant improvements over all comparison models, in both accuracy and robustness. The best-performing result of the proposed model for major injury crashes has a MAE of 0.030, which indicates an 42.105% and 84.211% improvement from the deep learning model without the regression layer and the SVM model, respectively. The proposed models perform worse for the minor injury crashes, with a 0.080 RMSD for all observed samples. However, it is still better than the evaluation measurements from the deep learning model without the regression layer and the SVM model, which are 0.202 and 0.257, respectively. This represents a MAE improvement of 150.980% and 219.608% for minor injury crash prediction. For the PDO crashes, the MAE improvements of the proposed models over the comparison models range from 471.111% to 564.444%. For all the observed samples, the MAE improvements range from 247.368% to 341.053%. Clearly, the improvement is significant for the traffic crash predictions. Therefore, the proposed model seems to be a better alternative for crash count predictions.

The proposed model has better performances in terms of small error variances than the comparison models, since the regression model is imbedding into the proposed model. The overall performances of the proposed model for all crashes show an 89.824% RMSD improvement over the deep learning mode without regression layer and an 121.378% RMSD improvement over the SVM model. It is clear that the predictions obtained from the proposed models are superior to those obtained from the comparison models. The greatest difference is demonstrated for the PDO crashes where the proposed model yields a RMSD of 27.206% compared to a 65.086% RMSD value from the deep learning model without the regression layer and a 72.416% RMSD value from the SVM model. The differences in the proposed model and the SVM model for the minor injury crashes are also significant (29.961% versus 61.350%).

6. Conclusions

Because traffic crashes are a big concern of the public, agencies, and policy makers and result in countless fatalities and injuries, there is a need to perform a comprehensive analysis that aims to understand the relationship between the influence factors and traffic crash outcomes. In this study, we presented an innovative approach for traffic crash prediction. Methodologically, we demonstrated a novel deep learning technique embedded within a multivariate regression model can be used to identify relationship between the examined variables and the traffic crashes. Future applications of this approach have the potential to provide insights into basic questions regarding roadway spatial and temporal dynamic function and practical questions regarding countermeasures. The investigation results provide sufficient evidence for the following conclusions:

The results show that the feature learning module identifies relational information between input variables and output feature representations. The findings indicate that the feature representations have reduced the dimensionality of the input, but still preserving the original information.

The proposed model that includes a MVNB regression layer in the supervised fine tuning module can better account for different patterns in crash data across injury severities and provide superior traffic crash predictions. In addition, the proposed model can perform multivariate estimations simultaneously with a superior fit.

The proposed model has superior performances in terms of prediction power compared to the deep learning model without a regression layer and the SVM model. The overall performances of the proposed model for all crashes show an 89.824% RMSD improvement over the deep learning model without a regression layer and an 121.378% RMSD improvement over the SVM model.

The findings suggest that the proposed model is a superior alternative for traffic crash predictions. The proposed model can better account for heterogeneity issues in traffic crash prediction.

The proposed models can perform traffic crash prediction for a given facility. The proposed methodology could be applied to other roadway networks if appropriate attribute variables are available. Traffic and transportation engineering agencies can employ the proposed models with relative cases and develop them to their needs to obtain traffic crash predictions for various time periods. Further investigation of the proposed models includes the predictions of spatial-temporal dynamic pattern in crash data.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

Special thanks are due to TDOT for providing the TRIMS data. This research is supported by funding provided by the Southeastern Transportation Center—a Regional UTC funded by the USDOT—Research and Innovative Technology Administration. Additional funding was provided by the National Natural Science Foundation of China (Grant Nos. 51678044, 51338008, 71621001, 71210001, and 71501011).

References

NHTSA, Motor Vehicle Traffic Crashes as a Leading Cause of Death in the United States, 2012-2014, Department of Transportation, National Highway Traffic Safety Administration, Traffic Safety Facts, DOT HS 812 297, 2016.
NHTSA, 2015 Motor Vehicle Crashes: Overview, U.S. Department of Transportation, National Highway Traffic Safety Administration, Traffic Safety Facts, DOT HS 812 318, 2016.
D. Lord and F. Mannering, “The statistical analysis of crash-frequency data: a review and assessment of methodological alternatives,” Transportation Research Part A: Policy and Practice, vol. 44, no. 5, pp. 291–305, 2010.
View at: Publisher Site | Google Scholar
F. L. Mannering and C. R. Bhat, “Analytic methods in accident research: methodological frontier and future directions,” Analytic Methods in Accident Research, vol. 1, pp. 1–22, 2014.
View at: Publisher Site | Google Scholar
F. L. Mannering, V. Shankar, and C. R. Bhat, “Unobserved heterogeneity and the statistical analysis of highway accident data,” Analytic Methods in Accident Research, vol. 11, pp. 1–16, 2016.
View at: Publisher Site | Google Scholar
J. C. Milton, V. N. Shankar, and F. L. Mannering, “Highway accident severities and the mixed logit model: an exploratory empirical analysis,” Accident Analysis & Prevention, vol. 40, no. 1, pp. 260–266, 2008.
View at: Publisher Site | Google Scholar
C. Dong, D. B. Clarke, X. Yan, A. Khattak, and B. Huang, “Multivariate random-parameters zero-inflated negative binomial regression model: an application to estimate crash frequencies at intersections,” Accident Analysis & Prevention, vol. 70, pp. 320–329, 2014a.
View at: Publisher Site | Google Scholar
C. Dong, D. B. Clarke, S. S. Nambisan, and B. Huang, “Analyzing injury crashes using random-parameter bivariate regression models,” Transportmetrica A: Transport Science, vol. 12, no. 9, pp. 794–810, 2016.
View at: Publisher Site | Google Scholar
M. G. Karlaftis and E. I. Vlahogianni, “Statistical methods versus neural networks in transportation research: differences, similarities and some insights,” Transportation Research Part C: Emerging Technologies, vol. 19, no. 3, pp. 387–399, 2011.
View at: Publisher Site | Google Scholar
J. C. Principe, N. R. Euliano, and W. C. Lefebvre, Neural and Adaptive Systems: Fundamentals through Simulations, vol. 672, Wiley, New York, NY, USA, 2000.
View at: Publisher Site
L.-Y. Chang, “Analysis of freeway accident frequencies: Negative binomial regression versus artificial neural network,” Safety Science, vol. 43, no. 8, pp. 541–557, 2005.
View at: Publisher Site | Google Scholar
H. T. Abdelwahab and M. A. Abdel-Aty, “Artificial neural networks and logit models for traffic safety analysis of toll plazas,” Transportation Research Record, no. 1784, pp. 115–125, 2002.
View at: Google Scholar
Y. Xie, D. Lord, and Y. Zhang, “Predicting motor vehicle collisions using Bayesian neural network models: an empirical analysis,” Accident Analysis & Prevention, vol. 39, no. 5, pp. 922–933, 2007.
View at: Publisher Site | Google Scholar
M. M. Kunt, I. Aghayan, and N. Noii, “Prediction for traffic accident severity: Comparing the artificial neural network, genetic algorithm, combined genetic algorithm and pattern search methods,” Transport, vol. 26, no. 4, pp. 353–366, 2011.
View at: Google Scholar
K. S. Jadaan, M. Al-Fayyad, and H. F. Gammoh, “Prediction of Road Traffic Accidents in Jordan using Artificial Neural Network (ANN),” Journal of Traffic and Logistics Engineering, vol. 2, no. 2, pp. 92–94, 2014.
View at: Publisher Site | Google Scholar
D. Akin and B. Akbaş, “A neural network (NN) model to predict intersection crashes based upon driver, vehicle and roadway surface characteristics,” Scientific Research and Essays, vol. 5, no. 19, pp. 2837–2847, 2010.
View at: Google Scholar
X. Li, D. Lord, Y. Zhang, and Y. Xie, “Predicting motor vehicle crashes using Support Vector Machine models,” Accident Analysis & Prevention, vol. 40, no. 4, pp. 1611–1618, 2008.
View at: Publisher Site | Google Scholar
Y. Zhang and Y. Xie, “Forecasting of short-term freeway volume with v-support vector machines,” Transportation Research Record, vol. 2024, no. 1, pp. 92–99, 2007.
View at: Publisher Site | Google Scholar
V. Kecman, “Support Vector Machines – An Introduction,” in Support Vector Machines: Theory and Applications, vol. 177 of Studies in Fuzziness and Soft Computing, pp. 1–47, Springer Berlin Heidelberg, Berlin, Heidelberg, 2005.
View at: Publisher Site | Google Scholar
R. Yu and M. Abdel-Aty, “Analyzing crash injury severity for a mountainous freeway incorporating real-time traffic and weather data,” Safety Science, vol. 63, pp. 50–56, 2014.
View at: Publisher Site | Google Scholar
C. Chen, G. Zhang, Z. Qian, R. A. Tarefder, and Z. Tian, “Investigating driver injury severity patterns in rollover crashes using support vector machine models,” Accident Analysis & Prevention, vol. 90, pp. 128–139, 2016.
View at: Publisher Site | Google Scholar
N. Dong, H. Huang, and L. Zheng, “Support vector machine in crash prediction at the level of traffic analysis zones: assessing the spatial proximity effects,” Accident Analysis & Prevention, vol. 82, pp. 192–198, 2015.
View at: Publisher Site | Google Scholar
G. Ren and Z. Zhou, “Traffic safety forecasting method by particle swarm optimization and support vector machine,” Expert Systems with Applications, vol. 38, no. 8, pp. 10420–10424, 2011.
View at: Publisher Site | Google Scholar
R. Yu and M. Abdel-Aty, “Utilizing support vector machine in real-time crash risk evaluation,” Accident Analysis & Prevention, vol. 51, pp. 252–259, 2013.
View at: Publisher Site | Google Scholar
M. Abdel-Aty and K. Haleem, “Analyzing angle crashes at unsignalized intersections using machine learning techniques,” Accident Analysis & Prevention, vol. 43, no. 1, pp. 461–470, 2011.
View at: Publisher Site | Google Scholar
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015.
View at: Publisher Site | Google Scholar
J. Schmidhuber, “Deep learning in neural networks: an overview,” Neural Networks, vol. 61, pp. 85–117, 2015.
View at: Publisher Site | Google Scholar
W. Huang, G. Song, H. Hong, and K. Xie, “Deep architecture for traffic flow prediction: deep belief networks with multitask learning,” IEEE Transactions on Intelligent Transportation Systems, vol. 15, no. 5, pp. 2191–2201, 2014.
View at: Publisher Site | Google Scholar
Y. Lv, Y. Duan, W. Kang, Z. Li, and F.-Y. Wang, “Traffic Flow Prediction with Big Data: A Deep Learning Approach,” IEEE Transactions on Intelligent Transportation Systems, vol. 16, no. 2, pp. 865–873, 2015.
View at: Google Scholar
N. G. Polson and V. O. Sokolov, “Deep learning for short-term traffic flow prediction,” Transportation Research Part C: Emerging Technologies, vol. 79, pp. 1–17, 2017.
View at: Publisher Site | Google Scholar
G. E. Hinton, S. Osindero, and Y. Teh, “A fast learning algorithm for deep belief nets,” Neural Computation, vol. 18, no. 7, pp. 1527–1554, 2006.
View at: Publisher Site | Google Scholar | MathSciNet
P. Swietojanski, A. Ghoshal, and S. Renals, “Convolutional neural networks for distant speech recognition,” IEEE Signal Processing Letters, vol. 21, no. 9, pp. 1120–1124, 2014.
View at: Publisher Site | Google Scholar
M. M. A. Rahhal, Y. Bazi, H. Alhichri, N. Alajlan, F. Melgani, and R. R. Yager, “Deep learning approach for active classification of electrocardiogram signals,” Information Sciences, vol. 345, pp. 340–354, 2016.
View at: Publisher Site | Google Scholar
H.-I. Suk, C.-Y. Wee, S.-W. Lee, and D. Shen, “State-space model with deep learning for functional dynamics estimation in resting-state fMRI,” NeuroImage, vol. 129, pp. 292–307, 2016.
View at: Publisher Site | Google Scholar
R. D. Hjelm, V. D. Calhoun, R. Salakhutdinov, E. A. Allen, T. Adali, and S. M. Plis, “Restricted Boltzmann machines for neuroimaging: An application in identifying intrinsic networks,” NeuroImage, vol. 96, pp. 245–260, 2014.
View at: Publisher Site | Google Scholar
P. Shi and E. A. Valdez, “Multivariate negative binomial models for insurance claim counts,” Insurance: Mathematics & Economics, vol. 55, pp. 18–29, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
P. C. Anastasopoulos, V. N. Shankar, J. E. Haddock, and F. L. Mannering, “A multivariate tobit analysis of highway accident-injury-severity rates,” Accident Analysis & Prevention, vol. 45, pp. 110–119, 2012.
View at: Publisher Site | Google Scholar
L. Chang and J. Chien, “Analysis of driver injury severity in truck-involved accidents using a non-parametric classification tree model,” Safety Science, vol. 51, no. 1, pp. 17–22, 2013.
View at: Publisher Site | Google Scholar
J. Pahukula, S. Hernandez, and A. Unnikrishnan, “A time of day analysis of crashes involving large trucks in urban areas,” Accident Analysis & Prevention, vol. 75, pp. 155–163, 2015.
View at: Publisher Site | Google Scholar
Q. Wu, F. Chen, and G. H. Zhang, “Mixed logit model-based driver injury severity investigations in single- and multi-vehicle crashes on rural two-lane highways,” Accident Analysis & Prevention, vol. 72, pp. 105–115, 2014.
View at: Publisher Site | Google Scholar
N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines, Cambridge University Press, Cambridge,UK, 2000.
View at: Publisher Site
C. Campbell, “Kernel methods: A survey of current techniques,” Neurocomputing, vol. 48, pp. 63–84, 2002.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2018 Chunjiao Dong et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

10746

Downloads

3503

Citations