Wireless Communications and Mobile Computing

Wireless Communications and Mobile Computing / 2021 / Article
Special Issue

AI-Based Federated Learning for 6G Mobile Networks

View this Special Issue

Research Article | Open Access

Volume 2021 |Article ID 5583874 | https://doi.org/10.1155/2021/5583874

G. Kothai, E. Poovammal, Gaurav Dhiman, Kadiyala Ramana, Ashutosh Sharma, Mohammed A. AlZain, Gurjot Singh Gaba, Mehedi Masud, "A New Hybrid Deep Learning Algorithm for Prediction of Wide Traffic Congestion in Smart Cities", Wireless Communications and Mobile Computing, vol. 2021, Article ID 5583874, 13 pages, 2021. https://doi.org/10.1155/2021/5583874

A New Hybrid Deep Learning Algorithm for Prediction of Wide Traffic Congestion in Smart Cities

Received08 Feb 2021
Revised22 Mar 2021
Accepted24 Apr 2021
Published20 May 2021


The vehicular adhoc network (VANET) is an emerging research topic in the intelligent transportation system that furnishes essential information to the vehicles in the network. Nearly 150 thousand people are affected by the road accidents that must be minimized, and improving safety is required in VANET. The prediction of traffic congestions plays a momentous role in minimizing accidents in roads and improving traffic management for people. However, the dynamic behavior of the vehicles in the network degrades the rendition of deep learning models in predicting the traffic congestion on roads. To overcome the congestion problem, this paper proposes a new hybrid boosted long short-term memory ensemble (BLSTME) and convolutional neural network (CNN) model that ensemble the powerful features of CNN with BLSTME to negotiate the dynamic behavior of the vehicle and to predict the congestion in traffic effectively on roads. The CNN extracts the features from traffic images, and the proposed BLSTME trains and strengthens the weak classifiers for the prediction of congestion. The proposed model is developed using Tensor flow python libraries and are tested in real traffic scenario simulated using SUMO and OMNeT++. The extensive experimentations are carried out, and the model is measured with the performance metrics likely prediction accuracy, precision, and recall. Thus, the experimental result shows 98% of accuracy, 96% of precision, and 94% of recall. The results complies that the proposed model clobbers the other existing algorithms by furnishing 10% higher than deep learning models in terms of stability and performance.

1. Introduction

The vehicular adhoc network is one among the puissant research applications in the intelligent transportation system (ITS) that furnishes the information to prevent or reduce the traffic congestion. For exchanging the information in a network, the vehicular adhoc network has vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communication. When a conveyance directly communicates with other conveyance in a network is V2V communication and when a conveyance directly communicates with roadside units (RSU), then, it is V2I communication [1]. The momentous standards of VANET are the dedicated short-range communication (DSRC) protocol, IEEE 802.11 [2], and wireless access in vehicular environment (WAVE) [3, 4]. Delays due to traffic, traffic that leads to congestion, consumption of energy, and the emission of pollution are the disputable in traffic management for smart cities [59]. The traffic management must effectuate the smart system for parking, an intelligent system for vehicles in routing management, and an intelligent system that predicts the traffic [1016].

In recent years, there is a higher death rate in road accidents which must be conquered to save the lives of people. User behavior, infrastructure, environmental factors, and mechanical error in roads are the important factors that cause accidents on the road [17, 18]. Traffic congestion is one among predicaments that need to be mutated in the transportation system [19]. As stirring of population accelerated, there is an increase in the number of vehicles on road that steer to traffic congestion, accidents, and pollution [20].

Collision in traffics is caused due to bad traffic management, poor law enforcements, poor infrastructure, and failure of signals [17, 21]. Averting of transportation fatalities ahead is an open aftereffect in vehicular traffic on highways, cities, and urban areas [22]. Ammunition on the road comprehends traffic monitoring and channeling that begets which consist of various technology riveting alert systems, digital maps. The vehicle active safety is a consequential part in collision warning systems [23].

The congestion can be minimized by identifying traffic jams, attaining the estimation of congestion levels, relaying the information about prevailing traffic state, and proposing new routes [24, 25]. Hence, to reduce the congestion level of traffic, the methodology mandatorily needed to predict the traffic jams. Prognosticating the prevalence of crashes that pertains to the count of crashes jotted down for a unit of time at a concrete location is benignant in monitoring highways [26, 27]. Evading auguring collisions will have high strike on reducing road concussion [28]. The demurrer in vehicular networks comprehends the vehicles’ rapid stirring and communication disassociation and conjunctions [2934].

The various techniques for predicting the traffic collisions in machine learning are sampling, regressions, correlations [35], clustering algorithms [36, 37], -nearest neighbor (kNN) algorithm [38], and artificial neural network (ANN) [39] are clobbered by the deep learning (DL) models in terms of accuracy in predicting the collision. CNN [40], transpose CNN [41], and long short-term Memory (LSTM) [42] are some of the deep learning techniques [4348] used for predicting the collision [41]. The systematic random sampling ameliorates in getting the automobilist samples, samples of the commuter, and samples of arid for reducing the hazards of bias. Purposive sampling ameliorates in electing the respondents of traffic officers that cynosure on the authentic traffic officer inaugurates at the sedulous streets [35].

Congestion cluster furnishes the adverting amount of flexibility in disparate needs in applications. These clusters vary dynamically in the network. These clusters accomplish intracluster similarity to disport the analogous development of driving speeds in the road segment over time [36]. The kNN inaugurates in classifying the conditions of the traffic and imputes the advertence to the class for receiving the considerable vote among the neighbors. This method identifies the accident betides due to traffic by utilizing the condition of traffics and constraining the factors of environments [38]. The ANN substantiates in extracting the features and dredging the incidents that furnishes and smashes the warning to the commuters and operator [39]. The features of images are extracted by a feedforward neural network called CNN by applying convolution operations. A conventional recurrent neural network called LSTM contains the cell state, the memory part, and three gates to predict the collision based on the time series sequence of images in traffic. The transpose convolutional neural network produces the predicted images of collision [41].

These deep learning algorithms produce the high spatial resolution that leads to the overfitting problem and disaccords the access and amalgamate in vehicle stirring patterns and conditions in traffic. Exploration of accidents at junctions must be included, and visualizing the emission and dispersion of traffic must substantiate in evaluating the real-time environment. This paper establishes the hybrid BLSTME and CNN for overcoming the overfitting problem and in predicting the traffic collision. This paper squarely fractionalized into five segments. The related work has been elaborated in Section 2. The proposed methodology in this paper has been deliberated in Section 3 along with the equation. Section 4 demonstrates the implementation of the model that is proposed and compared the accuracy with the existing models. Finally, this paper is concluded in Section 5.

A systematic random sampling approach by Onyeneke et al. [35] supports in reducing the chance of bias by getting the samples of allonges, travelers, and pedestrians. The purposive sampling focuses in recruiting the respondents from the right traffic officers. The simple linear regression canvasses the relationship to place the dependent and independent variables in data. Based on the casualties that are intended as a dependent variable and an independent variable is the number of registered vehicle; the future values are interpreted. This model examines the independent effects of manufacturing and enables the concrete absorption of causes and effects of congestion in traffic. The model fails in evaluating the accuracy, precision, and recall.

Wang et al. [49] studied the strike of congestion in traffic by using the spatial analysis technique for finding the frequency of accidents in the road. Poisson-lognormal, Poisson-gamma, and Poisson-lognormal with car priors for first- and second-order neighbors are the models to inquire the relationship amide congestion of traffic and the prevalence of distinct accidents on road. Accidents can be mapped to the veracious motorway segment, and the congestion index is evaluated to reckon the segment-level congestion of traffic. The Poisson-lognormal and Poisson-gamma models test the heterogeneity effects and exclude the spatial correlation effects, but the Poisson-lognormal car model holds up the effects of heterogeneity and spatial correlation. These models are consistent and confronted that congestion on traffic has no strike on the frequency of accidents. Exploration of congestion effects at junction on roads is required. The analysis is made by containing only the road segments in London from the M25 motorway.

Hao et al. [50] develop a system that conveys some intimation to the operators for transportation and officials of public health to ease the imminence of air pollutant. The authors proposed a model that blends the traffic state model, emission model, and dispersion model. The traffic condition from mobile data nourishes in reckoning the traffic state-like link average speed and traffic volume. Whence, with traffic conditions to emission and from emission to dispersion for preparing the data and estimating traffic state, a low-frequency problem is harnessed by extending stochastic arterial trajectory estimation model to freeways. Reliable real traffic volume information is furnished for a low penetration problem. Vehicular emissions and short-range dispersion of air pollutant emissions are estimated. A real-time environmental evaluation system must be entrenched to envision the traffic emission and dispersion.

Rempe et al. [36] determine the congestion clusters that furnish the significant amount of flexibility for different applications by the clustering algorithm technique. A congestion cluster is identified by dynamic congestion pockets and construction of static congestion clusters. In the case study of the Munich road network in Germany, the clusters that are the static road network of Munich and discriminating amide days of regular and irregular are taken for cluster congestion analysis. The resulting cluster countenances in identifying the weekdays that do not bear systematically. Reckoning the times and variance of the congestion and quantifying the distinct clusters for correlating the congestion behavior are obtained. This model postulates the implementation and testing in an online traffic forecast system.

The CNN model outperforms the other deep learning algorithm as it inaugurates in furnishing the prognostication of flow in traffic by prying the features of traffic images and classifies the data of traffic based on any feature from traffic data. The convolutional and pooling layers are the two important layers that inaugurate in learning the feature representation of the input traffic images. The LSTM model trains and tests the feature and solves the dematerializing and detonating of the gradient problem in training the neural network.

Song et al. [51] aim to prognosticate the traffic speed and analogize the performance with the existing prediction models by exploiting the CNN. The CNN captures the local dependencies of data and is lesser inclined to clatter in traffic data. This method requires five input layers where one input layer is for furnishing the temporal data and the remaining layers are for the speed profile of links one, two, three, and four. Attaining the local dependencies and capitalizing on the strong relationship for proximate data or nodes in the convolutional layer catenates to a fraction of nodes in the antecedent layer. This algorithm serves to attain the local dependencies and is less sensitive to noises in data. For outperforming the existing models, there is a need for multiple submodels.

Hebert et al. [52] creates the high-resolution accident prediction model for prognosticating the circumstance of an accident within hours on segments of roads delineated by intersections through exploiting big data analytics. Big data analytics is an intended approach that permits data scientists for prying the significant information from large amount of heterogeneous and complex data. The balanced random forest algorithm exploits in amending or sampling the imbalance of data, and several machine learning algorithms like decision trees, artificial neural networks, and Bayesian networks abet in prognosticating the circumstance of road accidents. By exploiting the features and parameters such as weather attributes, attributes from arterial segment, and attributes from date and time in the dataset, the circumstance of road accidents can be successfully prognosticated. Various features like location and date of erection work on roads and population density must be added to the dataset for exceling the performance.

The hybrid multimodel deep learning framework (HMDLF) by Du et al. [53] is aimed at forecasting the traffic flow. This model incorporates gated recurrent units (GRU) and one-dimensional CNN for attaining the features of correlation amid drifts and elongate dependencies of any one modal traffic data, by incorporating the CNN with GRU delves and ascertaining the deep nonlinear correlation attributes of multimodal input data. The end-to-end multimodel communes the traffic sequential data processing framework that rivets on features of spatial locally, features that have long dependency, and correlations of spatial-temporal. The CNN-GRU dopes out the traffic flow auguring issues by ascertaining the long temporal dependencies and features of spatial-temporal correlation for determining the correlation between speed flow journeys’ time in multimodality traffic data. Recasting in number of vehicles at the advertence point is awaited. Encompassing the ascertaining of time series precipitate, bouncing match with error tolerance, and spatial and temporal interdependence of multimodality input data are exploited. Collecting potent traffic data in a short epoch of time is a hindrance. The information that was congregated from the highways of England is traffic flow, speed, and passing time as they face rigor by traffic fatalities and ultimate weather events.

Building a potent model for prognosticating the traffic abundance based on features that effectuate the hidden insights in vehicular stirs is the intent of Moses and Parvathi [54]. The author exploits the support vector regression that maps the input using nonlinear mapping on -dimensional features. The mean square error approach estimates the performance by scaling the average squares of errors. The linear regression model erects in scaling the relation between scalar response and independent variables. The decision tree learning algorithm reckons the entropy or information gain. Efficient in identifying the optimal model to the open data that are available is the biggest profit. This model is generic; hence, integrating with existing agencies for doping out the traffic knot in real time is arduous.

Bang and Lee [25] redict the awaited position in stirrings and direction of each conveyance for avoiding amalgamate or access of collision between vehicles. The vector-based mobility prognosticate model in the TDMA-based VANET avoids the collision by apportioning the time slots and prognosticates the mobility of proximate vehicles through exploiting the habitation information of the control time slot, vehicle ID, direction of the vehicle stir, hop information, and latitude and longitude of a vehicle. The gain in performance of the algorithm is amended in the road ambient where the firmness of the traffic is high and the conveyances have high stirring and recasting the directions for travel constantly. Access and amalgamate collisions betide due to vehicle stir patterns and the condition of traffic.

Wei et al. [55] steer in ameliorating the prognosticate accuracy in the flow of traffic. In the autoencoder long short-term memory (AE-LSTM) approach, the autoencoder endorses the internal accordance of the flow in traffic by plucking the characteristics of the stream data in the traffic flow. The LSTM network cannibalizes the attained characteristic data and the historical data to prognosticate the baroque linear data in the traffic flow. This approach is arduous to implement and has a sober applicability. It also furnishes the exalted performance in prognosticating the traffic flow. But the strike is this study only esteems the time patterns and simple spatial patterns.

Sellami and Alaya [56] inquest the unpredictable density of conveyance and also furnish the attestation in the determinate load balance and other resources attainable between the distinct VANET networks for conveyances. The self-adaptive multikernel clustering for urban VANET (SAMNET) approach is postulated on a designated data that can be measured by depicting the ambivalent density of conveyance nodes, deceleration, acceleration, and bounded radio ranges for communication. It undergoes three stages, and they are the initialization stage of clusters, adaption stage of clusters, and fusion stage of clusters. It poses preeminent resultant alluded to the other distinct algorithms for any densities of traffic in the urban environment with the deduction of the arrant transmitted packets that was not unanimous at the destination. The incommodity in the adaption of the proposed algorithm parameters to concede the wielding of SAMNET is more complex in the road for distinct scenarios, and for optimizing the performance in distinct scenarios, there is bearing of the machine learning technique.

Ranjan et al. [41] redict the congestion level of a transportation network by integrating the CNN, transpose CNN, and LSTM. The convolutional encoder as a spatial feature extraction network encodes the input image into a low-resolution latent state. The temporal or time series information on data is ascertained by a recurrent network hackneyed as long short-term memory. The reconstruction network postulates the convolutional decoder and transposes operation on data by the transpose convolutional neural network to consequence the predicted image. The PredNet and ConvLSTM models attain the towering accuracy, precision, and recall in predicting the traffic congestion by associating the spatial and temporal features. For learning the background area, the huge number of resources and computing time is debilitated [41].

By incorporating the CNN and BLSTME models, the prognostication of the traffic flow is acquired. The proposed model does not necessitate higher resource that may lead to higher computational time [41]. The hybrid does not furnish multiple submodels of CNN for extracting the features that reduces the imbalance in collecting the data [53], and BLSTME is integrating the LSTM. The AdaBoost algorithm is used for strengthening the weak classifiers that resolve the overfitting problem with stir patterns of vehicles [25] and furnish higher performance in prognosticating the flow of traffic in real time [54] with higher density of population [52].

The recent survey on VANET is tabulated in Table 1. The gap diagnosed from the above survey table is optimizing the performance and arduous in inferring the traffic problem in real time that is conquered by our proposed system that combines the CNN and BLSTME.

Author and yearMethodsObjectiveLimitations

Wang et al. [49] 2009Spatial analysis approachTo scout the strike of congestion in traffic on the prevalence of distinct accidents in roadTo cruise the effectuate of congestions at junctions on smash-up
Rempe [36] 2016Clustering algorithmTo decree congestion clusters that furnishes an allusive quantum of flexibility to confront the covenants for distinct applicationsThe composed method must be enforced and tested in an online form of a forecast system of traffic
Song et al. [51] 2017Convolutional neural networkTo prognosticate the speed in traffic and analogize the performances with the existing prognosticate modelsThe multiple submodels are persistent
Hao et.al [50] 2017(1) Sparse mobile crowd
(2) Integrating traffic state model, emission model, and dispersion model
To forge a system that furnishes suggestions to the respective officials to alleviate the exposure of air pollutantA system must be demonstrated to visualize the dispersion and emission of traffic
Onyeneke et al. [35] 2018(1) Systematic random sampling
(2) Purposive sampling
(3) Simple linear regression
(4) Correlation
To audit the effects that is independent of withal fabricating or importing conveyance in the United StatesPerception of performance metric is persistent
Hebert et al. [52] 2019(1) Balanced random forest algorithm
(2) XG boost algorithm
To nurture high-resolution accident prognosticate model using big data analyticsMore features and a dataset with population density are persistent for delicate performance
Wei et al. [55] 2019Autoencoder long short-term memory (AE-LSTM)To ameliorate the prognosticate accuracy in flow of trafficSimple spatial patterns and time patterns are only premeditated in this study
Du et al. [53] 2020Hybrid multimodel deep learning framework for traffic flow forecasting (HMDLFTo portent the short-term traffic flowConfound in competent collection of data on accidents and baroque weather events in shorter time period
Moses and Parvathi [54] 2020(1) Support vector regression
(2) Mean squared error
(3) Linear regression model
(4) Decision tree learning
To prefabricate an efficient model for prognosticating the traffic volume and for effectuating out the hidden insights in vehicular stirringsArduous in inferring the traffic problem in real time
Bang and Lee [25] 2020(1) Vector-based mobility prediction model
(2) TDMA-based VANET
To avert blending or access collision between conveyances by prognosticating the delinquent stirring position and direction of each conveyanceRadical access and merging fracases intervene due to conveyance patterns in the movement and conditions of traffic
Ranjan et al. [41] 2020(1) Convolutional neural network (CNN)
(2) Long short-term memory (LSTM)
(3) Transpose CNN
To prognosticate the congestion level by grasping the chronological ramification of input imagesAbundance of resources and computational time are indulgent in ascertaining the background area
Sellami and Alaya [56] 2021Self-adaptive multikernel clustering for urban VANET (SAMNET)To strike the unpredictable density and to stipulate a certain balance loadAdopting this approach is complex in road scenarios, and optimizing the performance is difficult

3. Methodology

Section 3 includes the proposed architecture for predicting the traffic congestion. The proposed hybrid incorporated CNN and BLSTME models prognosticate the traffic flow. The features of input traffic images are extracted by CNN, and the extracted features are trained based on the classes for prognosticating the traffic flow by BLSTME through strengthening the weak classifiers.

3.1. Proposed Architecture

A high spatial resolution is produced by the long short-term memory (LSTM) technique. Hence, to avoid this problem, a hybrid deep learning algorithm BLSTME-CNN is proposed, and the architecture is shown in Figure 1.

3.2. Convolutional Neural Network

The CNN has the pulverized adroitness in the representation of a feature of an input image with nonpareil aspects as local connectivity to the neuron and sharing of the weight. The layers of CNN are the convolutional layer that learns in representing the feature of the input image and pooling layer that accomplishes the shift invariance. In the convolutional layer, the neurons will receive the inputs from its previous layer’s neuron of the local group for the output layer. The distinct feature representations were erudite by convoluting several kernels from the previous layer. The convolution layer is incurred by equation (1) [41].

Equation (1) infers the th activation map of the th convolution layer which is denoted by , th activation map of th layer is represented by , and and refer to the weight that connects the th activation map of the th layer at position . The several filters in th layer can be represented by , and the elementwise nonlinear activation function is signified by [41].

The spatial size of the activation map can be subdued by the pooling operations, but these operations possess the vital information. in equation (2) [41] can be obtained by coiling the output of previous layer with the size in the convolution filter and touching bitwise nonlinear activation is imparted [41]. a1 and b1 is kernel location.

The convolution layer supervened by the location of the thactivation map of th pooling layer, by coiling the outcome of the previous layer with the filter of size ; is obtained, and then, the bitwise nonlinear activation is applied and postulated in (3) [41].

3.3. Long Short-Term Memory

LSTM has been extensively used in many fields such as in generating music, captioning images, recognition of speech, and machine translation for improving the hidden layer cell on the basis of the recurrent neural network (RNN) [55]. The network consists of a cell to commemorate the values aloft the time intervals from LSTM memories and the gates [57, 58]. The LSTM network is the RNN that consorts with LSTM units which is paraded in Figure 2.

Figure 2 reminisces the output for the hidden layer as , preceding output as , input of a cell, and output and preceding state as and , respectively. , , and are three gate states in the network. LSTM cells and are calculated by evaluating the three gate states and cell input state and can be transmitted to the next neural network [57].

The input gate is given in equation (4) [57].

The forget gate is given in equation (5) [57].

The output gate is calculated by using equation (6) [57].

The cell input is given in equation (7) [57].

The matrices of weight are connected to the input gates of the output layers and are the weight matrices that are connected by the gate inputs for the hidden layers [R14]. The bias vector network is , and the hyperbolic function for the network is [57].

The calculated output state of a cell is given in equation (8) [57].

The calculated hidden layer output is given in equation (9) [57].

The number of concatenated cells designates the number of observations of the data that are regarded before making the prediction. Generally, more layers of LSTM cells are strong in predicting the collision but induce the overfitting problem. The boosted LSTM ensemble approach solves the problem by boosting LSTM for an effective traffic flow prediction.

3.4. AdaBoost Algorithms

In the AdaBoost approach, hybrid ensemble learning algorithms are established by integrating the LSTM networks with AdaBoost learning algorithms for strengthening the weak classifiers. Normally, by updating its weights, the AdaBoost algorithm strengthens the weak classifiers until classification or prediction accuracy obtains a maximum value [59]. The proposed model is a strong model where each weak classifier satisfies the performance.

3.5. Boosted LSTM Ensemble

In this approach, the hybrid neural network aggregates BLSTME and CNN to reduce overfitting for the prediction of traffic congestion. The CNN extracts the features of the image, and the feature is trained using BLSTME. The pseudocode and mathematical expression of BLSTME are given below.

The LSTM network is trained using over the training set of traffic data at iteration . At first, is set equally, . By using mathematical equation (6), the weak LSTM predictor computes the network for the first iteration. The modified output cell is given in equation (10):

A user-defined error function is identified to describe the boosting outputs by the mathematical expression in equation (11):

By the expression , the network parameter has been calculated and is given by equation (12):

and the final ensemble boosted output is calculated for every iteration when error is zero, and the mathematical expression is given by equation (13)

The complete pseudocode for the proposed BLSTME is rendered below.

1. Inputs sample training sets where where  = no of input samples and where is a multiclass label associated with
2. Initialize
3. For
4.     Train the LSTM classifier using the distribution
5.      Get the hypothesis with error function with respect to
6.        Error function is calculated at each stage which is then weighted
7.          Choose -network parameter calculation
8. Update the
9.  Calculate the error function and repeat step 4
10. If error is less than
11. Then, ensemble all the outputs
12. Else
13. Go to step 4
14. End
15. End

4. Results and Discussion

For a potent perpetration of prognosticate models in the networks, the real-time data are congregated from the arterial network of Seoul city. To utensil the real-time data congregate mechanism, we have incorporated SUMO platforms that run in the OMNeT++ environment. The separate python API has been developed to interface with data collection unit which runs on the SUMO-OMNeT++ platforms to utensil the continuous simulation. However, the simulation analysis has been done using Python Tensor Flow API running on the Intel i3.

Figure 3 flourishes the real-time scenario of the arterial system and the vehicles are surveilled in the SUMO. They are alchemized into vehicular nodes by catenate effectuated using the C++ programming for an apparent perpetration in OMNeT++ for the foster annotations and modeling.

4.1. Feature Extraction

The images are collected from SUMO-OMNeT++ interfaces, and their shape variations of real-time dynamic scenarios are represented in Figure 4.

Around 125 images are deliberated for the feature analysis. The classes are classified based on the density, and the computed values are represented in Table 2.

Pixel valueDensityClass


From Table 2, it is inferred that the density value is based on the pixel value of the input image. If pixel values get increased then automatically density values of an image get increased. Based on the density, the classes are classified. When the density ranges from 1 to 3, it comes under Class 0. When the density ranges from 4 to 6, it is Class1, and if the density ranges higher than 6, then it is Class 2.

Based on the traffic density, the different image data are gathered and the image dilation and image thresholding are performed. The frames are converted into gray scale, and the images are plotted after frame differencing. The density is obtained by calculating the horizontal and vertical edges by using Prewitt kernel as shown in Figure 5.

Figure 5(a) depicts the gray scale image of edge calculation using Prewitt kernel; Figure 5(b) portrays the gray scale image after frame differencing; Figure 5(c) represents the image after thresholding, and Figure 5(d) describes the image after dilation.

The vehicle detection zone and the contours of the vehicle in the road network are shown in Figure 6. Figure 6(a) expresses the vehicle detection zone, and Figure 6(b) denotes the contours.

The convolutional neural network extracts the features from the input images, and the results are represented in Table 3.

Layer (type)Output shapeParam #

conv2d (Conv2D)(none, 32, 32, 32)896
activation (Activation)(none, 32, 32, 32)0
conv2d_1 (Conv2D)(none, 32, 32, 32)9248
dropout (Dropout)(none, 32, 32, 32)0
batch_normalization (BatchNo)(none, 32, 32, 32)128
conv2d_2 (Conv2D)(none, 32, 32, 64)18496
Activation_1 (Activation)(none, 32, 32, 64)0
max_pooling2d (MaxPooling2D)(none, 16, 16, 64)0
dropout_1(Dropout)(none, 16, 16, 64)0
batch_normalization_1 (BatchNo)(none, 16, 16, 64)256
conv2d_3 (Conv2D)(none, 16, 16, 64)36928
activation_2 (Activation)(none, 16, 16, 64)0
max_pooling2d_1 (MaxPooling2D)(none, 8, 8, 64)0
dropout_2 (Dropout)(none, 8, 8, 64)0
batch_normalization_2 (BatchNo)(none, 8, 8, 64)256
conv2d_4 (Conv2D)(none, 8, 8, 128)73856
activation_3 (Activation)(none, 8, 8, 128)0
dropout_3 (Dropout)(none, 8, 8, 128)0
batch_normalization_3 (BatchNo)(none, 8, 8, 128)512
flatten (Flatten)(none, 8192)0
dropout_4 (Dropout)(none, 8192)0
dense (Dense)(none, 256)2097408
activation_4 (Activation)(none, 256)0
dropout_5 (Dropout)(none, 256)0
batch_normalization_4 (BatchNo)(none, 256)1024
dense_1 (Dense)(none, 128)32896
activation_5 (Activation)(none, 128)0
dropout_6 (Dropout)(none, 128)0
batch_normalization_5 (BatchNo)(none, 128)512
dense_2 (Dense)(none, 10)1290
activation_6 (Activation)(none, 10)0

The total parameters computed in CNN from the input data is 2,273,706. The trainable and nontrainable parameters for training the dataset in the network are 2,272,362 and 1,344 from the total parameters, respectively. The features that are extracted from the CNN are trained by BLSTME. It has higher computational load by handling 2,272,362 trainable parameters.

4.2. Performance Analysis

The proposed predicted BLSTME model is analyzed based on the performance metrics. The performance standards of the proposed DL algorithm are calculated, and the parameters such as accuracy, precision, and recall are applicative and estimated in training datasets and by using equations (14), (15), and (16) [41].

The performance analysis of the proposed BLSTME-CNN and the existing models such as the autoencoder, convolutional long short-term memory (ConvLSTM), and PredNet are tabulated in Table 4. The data of the existing prediction models such as the autoencoder, ConvLSTM, and PredNet are collected from [41, 60] for the statistical analysis of performance.

Prediction modelsPrecisionRecallAccuracy

Autoencoder [41, 60]0.740.710.75
ConvLSTM [41, 60]0.800.780.82
PredNet [41]0.860.850.86

The performance analysis of distinct performance metrics is evaluated for the various prediction models such as the autoencoder, ConvLSTM, PredNet, and proposed BLSTME-CNN and is represented in Figure 7.

Figure 7 flaunts that the existing autoencoder model has 0.74 precision value, ConvLSTM has 0.86 precision value, and PredNet has 0.86 precision value. The proposed BLSTME-CNN model has 0.96 precision value that is 10% higher than the autoencoder, ConvLSTM, and PredNet.

Figure 7 flaunts that the existing autoencoder model has 0.71 recall value, ConvLSTM has 0.78 recall value, and PredNet has 0.85 recall value. The proposed BLSTME-CNN model has 0.94 recall value that is around 10% higher than the autoencoder, ConvLSTM, and PredNet.

Figure 7 flaunts that the existing autoencoder model has 0.75 accuracy value, ConvLSTM has 0.82 accuracy value, and PredNet has 0.86 accuracy value. The proposed BLSTME-CNN model has 0.98 accuracy value that is around 10% higher than the autoencoder, ConvLSTM, and PredNet.

5. Conclusions and Future Work

The hybrid deep learning model is evolved by assimilating the CNN and BLSTME. The models can apprehend effectively based on the relation of both the temporal and spatial of the input images. It inaugurates in prognosticating the congestion of traffic for traffic management in smart cities that reduces delays which occurred by traffic, consuming energy, and travel management for passengers. By prognosticating the flow of traffic, the recurring and nonrecurring congestion of traffics are directed by smart traffic management by computing the density, calculating the edges, and frame differencing. Incorporating the CNN and BLSTME inaugurates for smart city traffic management by thresholding, dilation, contours, and detecting the vehicle zone. The CNN method extracts both spatial and temporal features from the traffic images, and BLSTME trains the features and strengthens the weak classifiers for predicting the traffic flow. Our proposed model is analogized with the existing models such as the autoencoder, ConvLSTM, and PredNet for predicting the traffic collision. The proposed model BLSTME-CNN achieves more than 10% higher accuracy, precision, and recall in predicting the collision than the existing models by strengthening the weak classifiers. Therefore, the proposed BLSTME-CNN algorithm produces the higher performance and computational efficiency in predicting the congestion. The future direction of our research work is to propose a hybrid incorporation of predictors with the attainment during collision in the network.

Another subject worth mentioning is real-time prediction. It plays an important role in modern cities and puts greater demands on the capacity of available prediction methods to forecast in real time. In the future, we will consider a more complex model architecture, especially for modeling temporal closeness, cycles, and patterns, in order to better capture temporal dependencies. We will also look at how to deal with sparse spatial traffic flow matrix inputs in order to minimize training time and maintain topological relationships.

Future research will concentrate on using larger datasets, exploring different combinations of flow, occupancy, speed, and other road traffic characteristics to improve prediction accuracy, improving prediction methodologies and analytics, using various types of road traffic datasets, fusing multiple datasets, and using multiple deep learning models.

Data Availability

The data used to support the findings of this study are available from the author upon request (gdhiman0001@gmail.com).

Conflicts of Interest

The authors declare that they have no conflicts of interest.


We are thankful for the support from the Taif University Researchers Supporting Project number (TURSP-2020/98).


  1. K. Arthi and S. Rani, “Secured message transmission between vehicles for reducing delay and collision in VANET,” International Journal of Innovative Technology and Exploring Engineering, vol. 8, no. 8, pp. 2853–2857, 2019. View at: Google Scholar
  2. M. Aydemir and K. Cengiz, “A potential architecture and next generation technologies for 5G wireless networks,” in IEEE 24th Signal Processing and Communication Application Conference (SIU), pp. 277–280, Zonguldak, Turkey, 2016. View at: Publisher Site | Google Scholar
  3. Z. Lu, G. Qu, and Z. Liu, “A survey on recent advances in vehicular network security, trust, and privacy,” IEEE Transactions on Intelligent Transportation Systems, vol. 20, no. 2, pp. 760–776, 2019. View at: Publisher Site | Google Scholar
  4. H. Faris and S. Yazid, “Development of communication technology on VANET with a combination of ad-hoc, cellular and GPS signals as a solution traffic problems,” in 2019 7th International Conference on Information and Communication Technology (ICoICT), pp. 1–9, Kuala Lumpur, Malaysia, 2019. View at: Publisher Site | Google Scholar
  5. P. Singh, G. Dhiman, and A. Kaur, “A quantum approach for time series data based on graph and Schrödinger equations methods,” Modern Physics Letters A, vol. 33, no. 35, p. 1850208, 2018. View at: Publisher Site | Google Scholar
  6. G. Dhiman and V. Kumar, “Astrophysics inspired multi-objective approach for automatic clustering and feature selection in real-life environment,” Modern Physics Letters B, vol. 32, no. 31, p. 1850385, 2018. View at: Publisher Site | Google Scholar
  7. M. Garg and G. Dhiman, “Deep convolution neural network approach for defect inspection of textured surfaces,” Journal of the Institute of Electronics and Computer, vol. 2, no. 1, pp. 28–38, 2020. View at: Publisher Site | Google Scholar
  8. G. Dhiman, M. Soni, H. M. Pandey, A. Slowik, and H. Kaur, “A novel hybrid hypervolume indicator and reference vector adaptation strategies based evolutionary algorithm for many-objective optimization,” Engineering with Computers, pp. 1–19, 2020. View at: Google Scholar
  9. G. Dhiman, M. Garg, A. Nagar, V. Kumar, and M. Dehghani, “A novel algorithm for global optimization: rat swarm optimizer,” Journal of Ambient Intelligence and Humanized Computing, pp. 1–26, 2020. View at: Google Scholar
  10. F. Malik, M. A. Shah, and H. A. Khattak, “Intelligent transport system: an important aspect of emergency management in smart cities,” in 2018 24th International Conference on Automation and Computing (ICAC), pp. 1–6, Newcastle upon Tyne, United Kingdom, 2018. View at: Publisher Site | Google Scholar
  11. G. M. Lingani, D. B. Rawat, and M. Garuba, “Smart traffic management system using deep learning for smart city applications,” in 2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC), pp. 0101–0106, Las Vegas, NV, USA, 2019. View at: Publisher Site | Google Scholar
  12. G. Dhiman and V. Kumar, “Spotted hyena optimizer: a novel bio-inspired based metaheuristic technique for engineering applications,” Advances in Engineering Software, vol. 114, pp. 48–70, 2017. View at: Publisher Site | Google Scholar
  13. G. Dhiman and V. Kumar, “Emperor penguin optimizer: a bio-inspired algorithm for engineering problems,” Knowledge-Based Systems, vol. 159, pp. 20–50, 2018. View at: Publisher Site | Google Scholar
  14. G. Dhiman and V. Kumar, “Multi-objective spotted hyena optimizer: a multi-objective optimization algorithm for engineering problems,” Knowledge-Based Systems, vol. 150, pp. 175–197, 2018. View at: Publisher Site | Google Scholar
  15. G. Dhiman and V. Kumar, “Seagull optimization algorithm: theory and its applications for large-scale industrial engineering problems,” Knowledge-Based Systems, vol. 165, pp. 169–196, 2019. View at: Publisher Site | Google Scholar
  16. P. Singh and G. Dhiman, “A hybrid fuzzy time series forecasting model based on granular computing and bio-inspired optimization approaches,” Journal of computational science, vol. 27, pp. 370–385, 2018. View at: Publisher Site | Google Scholar
  17. M. Divyaprabha, M. Thangavel, and P. Varalakshmi, “A comparative study on road safety problems,” in 2018 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), pp. 1–7, Madurai, India, 2018. View at: Publisher Site | Google Scholar
  18. S. Jat, R. S. Tomar, and M. S. P. Sharma, “Traffic Analysis for Accidents Reduction in VANET’s,” in 2019 International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), pp. 115–118, Dubai, United Arab Emirates, 2019. View at: Publisher Site | Google Scholar
  19. C. Jayapal and S. S. Roy, “Road traffic congestion management using VANET,” in 2016 International Conference on Advances in Human Machine Interaction (HMI), pp. 1–7, Doddaballapur, 2016. View at: Publisher Site | Google Scholar
  20. Y. R. B. Al-Mayouf, O. A. Mahdi, N. A. Taha, N. F. Abdullah, S. Khan, and M. Alam, “Accident management system based on vehicular network for an intelligent transportation system in urban environments,” Journal of Advanced Transportation, vol. 2018, 11 pages, 2018. View at: Publisher Site | Google Scholar
  21. A. Ghazy and T. Ozkul, “Design and simulation of an artificially intelligent VANET for solving traffic congestion,” in 2009 6th International Symposium on Mechatronics and its Applications, pp. 1–6, Sharjah, 2009. View at: Publisher Site | Google Scholar
  22. P. G. Shinde and M. M. Dongre, “Traffic congestion detection with complex event processing in VANET,” in 2017 Fourteenth International Conference on Wireless and Optical Communications Networks (WOCN), pp. 1–5, Mumbai, 2017. View at: Publisher Site | Google Scholar
  23. S. B. Raut and L. G. Malik, “Survey on vehicle collision prediction in VANET,” in 2014 IEEE International Conference on Computational Intelligence and Computing Research, pp. 1–5, Coimbatore, 2014. View at: Publisher Site | Google Scholar
  24. G. B. Araújo, M. M. Queiroz, F. de LP Duarte-Figueiredo, A. I. J. Tostes, and A. A. F. Loureiro, “CARTIM: A proposal toward identification and minimization of vehicular traffic congestion for VANET,” in 2014 IEEE Symposium on Computers and Communications (ISCC), pp. 1–6, Funchal, 2014. View at: Publisher Site | Google Scholar
  25. J.-H. Bang and J.-R. Lee, “Collision avoidance method using vector-based mobility model in TDMA-based vehicular ad hoc networks,” Applied Sciences, vol. 10, no. 12, p. 4181, 2020. View at: Publisher Site | Google Scholar
  26. K. Pandey, P. Fulzele, R. Singh, P. Kumar, and S. Singh, “Predicting and preventing fatal crashes,” in 2019 Twelfth International Conference on Contemporary Computing (IC3), pp. 1–6, Noida, India, 2019. View at: Publisher Site | Google Scholar
  27. M. H. Ahmadzadegan, H. A. Deilami, M. Izadyar, and H. Ghorbani, “Implementation and evaluation of the impact of traffic congestion on the detection of the missing packets in VANET,” in 2019 Third International conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), pp. 169–172, Palladam, India, 2019. View at: Publisher Site | Google Scholar
  28. N. Aljeri and A. Boukerche, “A predictive collision detection protocol using vehicular networks,” in 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC), pp. 1–5, Montreal, QC, 2017. View at: Publisher Site | Google Scholar
  29. G. Tuna and K. Cengiz, “Telematics and mobile internet: current situation and 5G networks,” Principles and Applications of Narrowband Internet of Things (NBIoT), IGI Global, pp. 373–396, 2021. View at: Google Scholar
  30. S. Kaur, L. K. Awasthi, A. L. Sangal, and G. Dhiman, “Tunicate swarm algorithm: a new bio-inspired based metaheuristic paradigm for global optimization,” Engineering Applications of Artificial Intelligence, vol. 90, article 103541, 2020. View at: Google Scholar
  31. G. Dhiman and A. Kaur, “STOA: a bio-inspired based optimization algorithm for industrial engineering problems,” Engineering Applications of Artificial Intelligence, vol. 82, pp. 148–174, 2019. View at: Publisher Site | Google Scholar
  32. G. Dhiman and V. Kumar, “Spotted hyena optimizer for solving complex and non-linear constrained engineering problems,” in Harmony Search and Nature Inspired Optimization Algorithms, pp. 857–867, Springer, Singapore, 2019. View at: Google Scholar
  33. P. Singh and G. Dhiman, “Uncertainty representation using fuzzy-entropy approach: special application in remotely sensed high-resolution satellite images (RSHRSIs),” Applied Soft Computing, vol. 72, pp. 121–139, 2018. View at: Publisher Site | Google Scholar
  34. P. Singh and G. Dhiman, “A fuzzy-LP approach in time series forecasting,” in International conference on pattern recognition and machine intelligence, pp. 243–253, Cham, 2017. View at: Google Scholar
  35. C. Onyeneke, C. Eguzouwa, and C. Mutabazi, “Modeling the effects of traffic congestion on economic activities-accidents, fatalities and casualties,” Biomedical Statistics and Informatics, vol. 3, no. 2, pp. 7–14, 2018. View at: Publisher Site | Google Scholar
  36. F. Rempe, G. Huber, and K. Bogenberger, “Spatio-temporal congestion patterns in urban traffic networks,” Transportation Research Procedia, vol. 15, pp. 513–524, 2016. View at: Google Scholar
  37. A. Jesudoss, S. K. Raja, and A. Sulaiman, “Stimulating truth-telling and cooperation among nodes in VANETs through payment and punishment scheme,” Ad Hoc Networks, vol. 24, pp. 250–263, 2015. View at: Publisher Site | Google Scholar
  38. Y. Lv, S. Tang, and H. Zhao, “Real-time highway traffic accident prediction based on the k-nearest neighbor method,” in 2009 International Conference on Measuring Technology and Mechatronics Automation, pp. 547–550, Zhangjiajie, Hunan, 2009. View at: Publisher Site | Google Scholar
  39. Y. Ki, W. Jeong, H. Kwon, and M. Kim, “An algorithm for incident detection using artificial neural networks,” in 2019 25th Conference of Open Innovations Association (FRUCT), pp. 162–167, Helsinki, Finland, 2019. View at: Publisher Site | Google Scholar
  40. H. Zhao, H. Cheng, T. Mao, and C. He, “Research on traffic accident prediction model based on convolutional neural networks in VANET,” in 2019 2nd International Conference on Artificial Intelligence and Big Data (ICAIBD), pp. 79–84, Chengdu, China, 2019. View at: Publisher Site | Google Scholar
  41. N. Ranjan, S. Bhandari, H. P. Zhao, H. Kim, and P. Khan, “City-wide traffic congestion prediction based on CNN, LSTM and transpose CNN,” IEEE Access, vol. 8, pp. 81606–81620, 2020. View at: Publisher Site | Google Scholar
  42. Y. Jeong and K. Yi, “Bidirectional long short-term memory-based interactive motion prediction of cut-in vehicles in urban environments,” IEEE Access, vol. 8, pp. 106183–106197, 2020. View at: Publisher Site | Google Scholar
  43. G. Dhiman and V. Kumar, “KnRVEA: a hybrid evolutionary algorithm based on knee points and reference vector adaptation strategies for many-objective optimization,” Applied Intelligence, vol. 49, no. 7, pp. 2434–2460, 2019. View at: Publisher Site | Google Scholar
  44. G. Dhiman, S. Guo, and S. Kaur, “ED-SHO: a framework for solving nonlinear economic load power dispatch problem using spotted hyena optimizer,” Modern Physics Letters A, vol. 33, no. 40, p. 1850239, 2018. View at: Publisher Site | Google Scholar
  45. P. Singh, K. Rabadiya, and G. Dhiman, “A four-way decision-making system for the Indian summer monsoon rainfall,” Modern Physics Letters B, vol. 32, no. 25, p. 1850304, 2018. View at: Publisher Site | Google Scholar
  46. G. Dhiman, “MOSHEPO: a hybrid multi-objective approach to solve economic load dispatch and micro grid problems,” Applied Intelligence, vol. 50, no. 1, pp. 119–137, 2020. View at: Publisher Site | Google Scholar
  47. G. Dhiman, “ESA: a hybrid bio-inspired metaheuristic optimization approach for engineering problems,” Engineering with Computers, pp. 1–31, 2019. View at: Google Scholar
  48. A. Kaur, S. Kaur, and G. Dhiman, “A quantum method for dynamic nonlinear programming technique using Schrödinger equation and Monte Carlo approach,” Modern Physics Letters B, vol. 32, no. 30, p. 1850374, 2018. View at: Publisher Site | Google Scholar
  49. C. Wang, M. A. Quddus, and S. G. Ison, “Impact of traffic congestion on road accidents: a spatial analysis of the M25 motorway in England,” Accident Analysis & Prevention, vol. 41, no. 4, pp. 798–808, 2009. View at: Publisher Site | Google Scholar
  50. P. Hao, C. Wang, G. Wu, K. Boriboonsomsin, and M. Barth, “Evaluating the environmental impact of traffic congestion based on sparse mobile crowd-sourced data,” in 2017 IEEE Conference on Technologies for Sustainability (Sus Tech), pp. 1–6, Phoenix, AZ, 2017. View at: Publisher Site | Google Scholar
  51. C. Song, H. Lee, C. Kang, W. Lee, Y. B. Kim, and S. W. Cha, “Traffic speed prediction under weekday using convolutional neuralnetworks concepts,” in 2017 IEEE Intelligent Vehicles Symposium (IV), pp. 1293–1298, Los Angeles, CA, 2017. View at: Publisher Site | Google Scholar
  52. A. Hébert, T. Guédon, T. Glatard, and B. Jaumard, “High-resolution road vehicle collision prediction for the city of Montreal,” in 2019 IEEE International Conference on Big Data (Big Data), pp. 1804–1813, Los Angeles, CA, USA, 2019. View at: Publisher Site | Google Scholar
  53. D. Shengdong, T. Li, X. Gong, and S.-J. Horng, “A hybrid method for traffic flow forecasting using multimodal deep learning,” International journal of computational intelligence systems, vol. 13, pp. 85–97, 2020. View at: Publisher Site | Google Scholar
  54. A. Moses and R. Parvathi, “Vehicular traffic analysis and prediction using machine learning algorithms,” in 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE), pp. 1–4, Vellore, India, 2020. View at: Publisher Site | Google Scholar
  55. W. Wei, H. Wu, and H. Ma, “An auto encoder and LSTM-based traffic flow prediction method,” Sensors, vol. 19, no. 13, article 2946, 2019. View at: Publisher Site | Google Scholar
  56. L. Sellami and B. Alaya, “SAMNET: self-adaptative multi-kernel clustering algorithm for urban VANETs,” Vehicular Communications, vol. 29, article 100332, 2021. View at: Publisher Site | Google Scholar
  57. S. Amudha and M. Murali, “Deep learning based energy efficient novel scheduling algorithms for body-fog-cloud in smart hospital,” Journal of Ambient Intelligence and Humanized Computing, 2020. View at: Publisher Site | Google Scholar
  58. B. Tian, G. Wang, Z. Xu, Y. Zhang, and X. Zhao, “Communication delay compensation for string stability of CACC system using LSTM prediction,” Vehicular Communications, vol. 29, article 100333, 2021. View at: Publisher Site | Google Scholar
  59. Y. Zhang, M. Ni, C. Zhang et al., “Research and application of AdaBoost algorithm based on SVM,” in 2019 IEEE 8th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), pp. 662–666, Chongqing, China, 2019. View at: Publisher Site | Google Scholar
  60. S. Zhang, Y. Yao, J. Hu, Y. Zhao, S. Li, and J. Hu, “Deep autoencoder neural networks for short-term traffic congestion prediction of transportation networks,” Sensors, vol. 19, no. 10, article 2229, 2019. View at: Publisher Site | Google Scholar

Copyright © 2021 G. Kothai et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Related articles

No related content is available yet for this article.
 PDF Download Citation Citation
 Download other formatsMore
 Order printed copiesOrder

Related articles

No related content is available yet for this article.

Article of the Year Award: Outstanding research contributions of 2021, as selected by our Chief Editors. Read the winning articles.