Smart Shift Decision Method Based on Stacked Autoencoders

Wang, Zengcai; Qi, Yazhou; Zhang, Guoxin; Zhao, Lei

doi:https://doi.org/10.1155/2018/1098753

Journal of Control Science and Engineering

On this page

Abstract Introduction Results and Discussion Conclusion Conflicts of Interest Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2018 | Article ID 1098753 | https://doi.org/10.1155/2018/1098753

Smart Shift Decision Method Based on Stacked Autoencoders

Zengcai Wang,^1,2Yazhou Qi,^1,2Guoxin Zhang,^1,2and Lei Zhao^1,2

Academic Editor: Enrique Onieva

Received20 Oct 2017

Accepted03 May 2018

Published31 May 2018

Abstract

Manual calibration and testing on real vehicles are common methods of generating shifting schedules for newly developed vehicles. However, these methods are time-consuming. Shifting gear timing is an important operating parameter that affects shifting time, power loss, fuel efficiency, and driver comfort. The stacked autoencoder (SAE) algorithm, a type of artificial neural network, is used in this study to predict shifting gear timing on the basis of throttle percentage, vehicle velocity, and acceleration. Experiments are conducted to obtain training and testing data. Different neural networks are trained with experimental data on a real vehicle under different road conditions collected using the CANcaseXL device and control AMESim simulation model, which was constructed based on real vehicle parameters. The input number of SAE is determined through a comparison between two and three parameters. The output type of SAE is determined through a comparative experiment on pattern recognition and multifitting. Meanwhile, the network structure of SAE is determined through a comparative experiment on simple and deep-learning neural networks. Experimental results demonstrate that using the SAE intelligent shift control strategy to determine shift timing not only is feasible and accurate but also saves time and development costs.

1. Introduction

Shift control is a key technology in automotive automatic transmission control because it directly affects the fuel economy and dynamic performance of vehicles [1]. Current methods of gear decision-making consist of two categories. One is the traditional method, in which an optimal method for solving the shift schedule is established after the shift control parameter is selected according to a certain performance index. The other method involves using intelligent shift, driving experience, and expert knowledge. Shift control in the traditional basic shift schedule is based on different parameters (e.g., single-, two-, or three-parameter shift schedules). However, regardless of the number of parameters, a shift schedule can only reflect the running state of a vehicle and does not fully consider the intention of the driver and the automotive environment. Manual calibration and testing on real vehicles are common means of generating shifting schedules for newly developed vehicles; however, these methods are time-consuming [2]. Current research on intelligent shift decision-making mainly includes two methods, namely, those based on fuzzy logic and those based on neural networks [3–6]. Alternate method based on artificial intelligence techniques implemented with fuzzy controllers is proposed [7]. Elnashar used the fuzzy theory and neural network to establish the automatic variable speed controller of the automobile and carried out the computer simulation [8]. Gear shift strategy is based on stochastic dynamic programming [9]. Mechatronic gear shift system has been developed and tested in a passenger car reducing fuel consumption and improving the vehicle drivability [10]. Casavola et al. have fully analyzed and here described genetic and fuzzy algorithm gear shifting strategy [11]. The artificial neural network (ANN) has strong nonlinear mapping and generalization capabilities and can even be trained to adapt to the dynamic conditions of vehicles, road conditions, and changes in the characteristics of drivers [12]. A feed-forward neural network that calculates optimal dynamic and economical shift schedules using a three-parameter shift schedule has been presented [13]. The fuzzy neural network has been adopted for the construction of vehicles with multiparameter transmission [14]. A neural network has also been developed to evaluate downhill engine brake necessity and make correct shifting decisions similar to those made by experienced drivers [15]. In [16], a multilayer perceptron algorithm was applied to predict shifting gear timing. However, this algorithm can only be implemented on the AMESim transmission model and not on vehicles with transmission. Moreover, it does not consider the deviation of the optimized values.

In this study, actual vehicle data obtained from an experimental vehicle under different road conditions were analyzed using the CANcaseXL device. The network implemented on an AMESim model of the experimental vehicle with automated transmission was sufficiently trained. A stacked autoencoder (SAE) method was developed for the gear recognition rate and compared with the traditional ANN.

2. Experimental Vehicle Model

Figure 1 shows a diagram of neural network shift control. The vehicle model was established based on an actual test vehicle using the AMESim software. The driver and neural network controller models were established using the Simulink software. The CANcaseXL device was used to analyze the actual vehicle data of the experimental vehicle. The model described was modified based on the test data. The engine output and torque characteristics of the engine mode were changed based on the experimental data. The basic parameters of the vehicle, such as rated power, maximum engine torque, engine speed range, total mass loaded, wheel rolling radius, transmission mechanical efficiency, air resistance coefficient, and rolling resistance coefficient, were set. The transmission model’s shifting logic based on a shift table is shown in Table 1, together with the setting of the solenoid valve and shifting clutch. Figure 2 presents the physical model constructed using AMESim to model the proposed vehicle. Figure 3 presents the driver and neural network controller models constructed using MATLAB to model the behavior of the driving and transmission control unit. The driver model controls the accelerator and brake pedals and outputs the signal of throttle and brake percentages with time. The neural network controller model is a sufficient training network that uses a neural network with a three-parameter shift. The details of the neural network controller model are described in the subsequent sections.

3. ANN and SAE

3.1. ANN

Artificial intelligence consists of two major branches. Expert systems and the study of ANN do not require detailed system information and work similar to a black box model. However, the relationships between the input parameters and controlled and uncontrolled variables are learned by studying previously tested data, similar to nonlinear regression. Another advantage of using ANN is its ability to handle large and complex systems with many interrelated parameters [17]. A suitable shifting strategy based on the BP neural network algorithm has been established [18]. Reference [19] presented a neural-networked, three-parameter gear-shift control. In [18, 19], the back-propagation learning algorithm was used in a feed-forward process, but these studies did not use curve fitting or pattern recognition of neural networks, which were used in [20, 21]. In this study, the use of curve fitting and pattern recognition was discussed. This study selected a multilayer ANN structure, as shown in Figure 4.

The input data were a combination of throttle percentage, vehicle velocity, and acceleration. Gear was the desired output. was set as the sample number, and was set as the number of samples. With a certain input , the network output is , and the node output is . The node input iswhere are the weights of the connection of the intermediate layer node to the node on level and is the node threshold. The output of each node is a nonlinear function of the input desirable sigmoid function.

For the set of input samples , network output set , and target output set , the error function of the sample training network can be defined as follows: where is the ideal output value of the th output node of sample and is the output value of node which stands at the output layer with the influence of sample input . With the most rapid descent method, the algorithm used to change and when is zero is derived aswhere is the learning ratio or epoch, is the error signal of the th node of sample , and is incremental weight of in sample .

If is the output node, thenIf is not the output node, then

In the first training stage, the inputs and desired outputs are provided to the neural network (NN). The weights are modified to minimize the error between the NN predictions and the expected outputs. Training aims to minimize errors and consequently optimize the NN solution. Each iterative step where the weights are recalculated is called an epoch. When the minimum is achieved, the weights are fixed, and the training process ends. Once an NN has been trained to a satisfactory level, it is used as an NN controller for the AMESim model.

In this work, the back-propagation learning algorithm was used in a feed-forward, and a function fitting neural network was developed and compared with a pattern recognition neural network. An ANN that is trained and simulated with validated vehicle data was proposed and compared. The result showed that the function fitting neural network predicted gear timing better than the pattern recognition neural network. Accurate data are discussed in the next section. The three-parameter shift schedule based on neural network model was compared with the two-parameter shift schedule. The result of the comparison showed that the proposed three-parameter gear shift conformed to driver experience or practice better and was smoother for gear-shift surface changes. Accurate data are discussed in the next sections.

3.2. SAE

At present, manufacturers should improve their services, products, and technological base to achieve a sustainable value proposition, become highly efficient and effective in the market, and satisfy the needs of users. Significant emerging technologies being discussed in various research studies include wearable technologies, networked and smart environments connected by the Internet of Things, evolving tools, tangible interfaces, human-robot collaborations, processes and interactions, virtual reality, ubiquitous use of machine learning, and deep-learning algorithms [22]. In the last few years, applications based on deep neural networks have performed various tasks, such as speech recognition or image classification, to levels that even exceed human abilities [23–25]. SAE is a deep-learning algorithm. It is better than a traditional neural network. According to [26, 27], SAE-based deep learning uses limited shallow neural network learning capability; thus, the depth of the network should be known when SAE is utilized. SAE consists of multiple layers of sparse autoencoders, in which the outputs of each layer are the inputs of the successive layer. Formally, we consider an SAE with layers. , , , and denote the parameters of , , , and for the th autoencoder. The encoding for the SAE is obtained by implementing the encoding step of each layer in a forward order as follows:

The decoding step is obtained by running the decoding stack of each autoencoder in a reverse order as follows:

The information of interest is contained in , which is the activation of the deepest layer of hidden units. This vector represents the input in terms of higher-order features.

An autoencoder neural network is an unsupervised learning algorithm that applies back-propagation, and it sets the target values to be equal to the inputs. The autoencoder attempts to learn an approximation to the identity function; thus, the output is similar to the input.

First, a sparse autoencoder is trained based on the raw inputs of throttle percentage, vehicle velocity, and acceleration to learn the primary features on the raw input (Figure 5). Second, the raw input is fed to the trained sparse autoencoder, thereby obtaining the primary feature activations for each of the inputs. Third, these primary features are used as the “raw input” to another sparse autoencoder to learn the secondary features on these primary features (Figure 6). Following this method, the primary features are fed to the second sparse autoencoder to obtain the secondary feature activations for each of the primary features . These secondary features are treated as a “raw input” to the softmax classifier, which trains it to map secondary features to digit labels (Figure 7). Finally, all three layers are combined to form an SAE with three parameter inputs (Figure 8).

4. Results and Discussion

4.1. Data Extraction

A vehicle can only shift gears according to a fixed shift control strategy under different driving environments because the basic shift rule is preset in the controller. Thus, the given gear of the vehicle may not be the optimum. The basic shift strategy presents a poor control performance when the vehicle operates on a ramp. The vehicle encounters a cycle shift when climbing, and its speed increases with a high gear ratio. Hence, the engine brakes are not fully utilized. In this work, the CANcaseXL device was used to analyze the actual data of the experimental vehicle when shifting gears manually under different road conditions. We collected information on the driver’s shift under seven different road conditions. The information was then used to train the neural network. Useful vehicle data are shown in Figures 9–15. When the neural network with three-parameter shift was trained, throttle percentage, vehicle velocity, and acceleration were treated as input data, and the gear was treated as target data. When the neural network with two-parameter shift was trained, throttle percentage and vehicle velocity were treated as input data, and the gear was treated as target data.

4.2. SAE with Data Fitting

The function fitting neural network was compared with the pattern recognition neural network to predict gear timing. The function fitting neural network is an example of a fitting problem in which inputs are matched to associated target outputs to create a neural network that not only estimates the known targets of given inputs but also accurately generalizes the estimated outputs. The regression across a sample of the road test is plotted in Figure 16. The regression plot shows the actual network outputs plotted in terms of the associated target values. If the network has learned to fit the data well, then the linear fit to this output-target relationship should closely intersect in the bottom-left and top-right corners of the plot. If the case is the opposite, then further training or training a network with more hidden neurons would be advisable. The value of is an indication of the relationship between the outputs and targets. If is close to one, then the outputs and targets have an exact linear relationship. If is close to zero, then the outputs and targets have no linear relationship.

Figure 17 shows the regression of the shift schedule with three parameters and the shift schedule with two parameters. Figure 17 shows that of the three-parameter shift schedule is relatively closer to 1 than that of the two-parameter shift schedule. The comparison of the two- and three-parameter neural networks showed that three-parameter gear shift conforms to driver’s experience or practice better. Moreover, as the data points increase, the fitting effect decreases. This finding made us think of a new method of the pattern recognition neural network.

4.3. SAE with Pattern Recognition

Neural networks are good at solving pattern recognition problems. A neural network with sufficient elements (called neurons) can classify any data with arbitrary accuracy. These networks are particularly well suited for complex gear shifting decisions over many variables. Therefore, neural networks are good candidates for solving gear classification problems. Then, the data were used to train the pattern recognition neural network. The performance curve is given in Figure 18. The plot shows the value of the performance function versus the iteration number (epochs). Training, validation, and test performances are plotted. The best validation performance is 0.023685 at epoch 1000.

The confusion matrix explains how the trained neural network fits the data, as shown in Figure 19. The confusion matrix is plotted across all the training data of the two-parameter neural network. The confusion matrix shows the percentages of correct and incorrect classifications. Correct classifications form the green squares on the matrices diagonally. Incorrect classifications are represented by the red squares. If the network is trained well and has learned to classify properly, then the percentages in the green squares should be large, indicating good classifications. If the case is the opposite, then further training or training a network with more hidden neurons would be advisable. The number of experimental pieces of data is 189,808, and the percentage of correct classification is 94.383759%.

Figure 20 shows the accuracy of the neural network classification with three and two parameters. The accuracy of the three-parameter classification is relatively close to 100% and is significantly higher than that of the two-parameter classification. The comparison shows that the three-parameter gear shift conforms better to driver’s experience or practice than the two-parameter gear shift. Moreover, as the data points increase, the percentages of correct classification decrease.

4.4. Comparison of Pattern Recognition and Data Fitting under the Same Network Structure

Two types of neural networks were trained and simulated with the validated vehicle data to determine whether a neural network with fitting predicts gear timing better than pattern recognition. Figures 21–27 show the output of a neural network with the input data of seven types of roads. Three curves are drawn in each figure to represent the actual vehicle gear timing, the pattern recognition network output gear timing, and the function fitting output gear timing. The comparison shows that the function fitting neural network predicts gear timing better than the pattern recognition neural network.

4.5. Comparison between SAE and a Shallow Neural Network

Figure 17 shows that the fitting effect decreases as the data points increase. Figure 20 shows that the percentages of correct classification decrease as the data points increase. As the data points increase, the learning capability of the shallow neural network becomes limited. A large amount of data for network training is required to apply the neural network shift law and complex intersection. Hence, an ANN technique that uses the SAE algorithm was utilized to predict shifting gear timing based on throttle percentage, vehicle velocity, and acceleration. Table 2 shows that neural network with pretraining performs better than the algorithm without pretraining.

5. Conclusion

Manual calibration and testing on real vehicles are traditional ways of generating shifting schedules for newly developed vehicles. However, these methods are time-consuming. In this study, the back-propagation learning algorithm was used in feed-forward progress, and a polynomial fitting neural network was developed and compared with the pattern recognition neural network. The polynomial fitting neural network predicts gear timing better than the pattern recognition neural network. The polynomial fitting neural network and pattern recognition neural network with three parameters perform better than those with two parameters.

The accuracy of the BP neural network decreases with the increase in the experimental sample points in terms of the fitting effect and correct rate after network training, and meeting the requirements of intelligent shift control to cope with complicated conditions is difficult. However, its depth learning stack self-coding is good. At the experimental sample point of 205,632, the accuracy of SAE is 1.6% higher than that of the BP neural network. Therefore, the SAE neural network with the three-parameter intelligent shift control strategy not only correctly predicts shift timing and saves time but also adapts to the different driving habits of drivers.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was supported by the Open Foundation of State Key Laboratory of Automotive Simulation and Control (China, Grant no. 20161105) and the Natural Foundation of Shandong Province (China, Grant no. ZR2018MEE015).

References

Z. Sun and K. Hebbale, “Challenges and opportunities in automotive transmission control,” in Proceedings of the 2005 American Control Conference, ACC, pp. 3284–3289, usa, June 2005.
View at: Google Scholar
J. Wang, Y. Lei, A. Ge, and X. Lu, “Shift strategy research on off-road vehicle,” SAE Technical Papers, 2009.
View at: Publisher Site | Google Scholar
A. Ghazi Zadeh, A. Fahim, and M. El-Gindy, “Neural network and fuzzy logic applications to vehicle systems: literature survey,” International Journal of Vehicle Design, vol. 18, no. 2, pp. 132–193, 1997.
View at: Google Scholar
B. Bosacchi and I. Masaki, “Fuzzy logic technology & the Intelligent Highway System (IHS),” in Proceedings of the Second IEEE International Conference on Fuzzy Systems, pp. 65–70, April 1993.
View at: Google Scholar
K. Kondo and H. Goka, “Adaptive shift scheduling strategy introducing neural network in automatic transmission,” JSAE Review, vol. 16, no. 4, pp. 411–414, 1995.
View at: Publisher Site | Google Scholar
Y. H. Yamaguchi, H. Narita, H. Takahashi, and Y. Katou, “Automatic transmission shift schedule control using fuzzy logic,” SAE Technical Papers 930674, 1993.
View at: Publisher Site | Google Scholar
F. Alonge, F. Raimondi, and L. Ciancimino, “A new approach to the intelligent gear shift using artificial intelligence and fuzzy logic,” in Proceedings of the 6Th Wseas Intern. Conf. on Mathem. Methods Comput. Techn. in Electrical Engineer, 2004.
View at: Google Scholar
G. Elnashar, Intelligent controllers based on fuzzy systems and neural networks, The Catholic University of America, 2000.
View at: Publisher Site
V. D. Ngo, J. A. Colin Navarrete, T. Hofman, M. Steinbuch, and A. Serrarens, “Optimal gear shift strategies for fuel economy and driveability,” Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, vol. 227, no. 10, pp. 1398–1413, 2013.
View at: Publisher Site | Google Scholar
J. Jantos, K. Praznowski, and J. Mamala, “Automatic gear shift unit,” Solid State Phenomena, vol. 147-149, pp. 185–190, 2009.
View at: Publisher Site | Google Scholar
A. Casavola, G. Prodi, and G. Rocca, “Efficient gear shifting strategies for green driving policies,” in Proceedings of the 2010 American Control Conference, ACC 2010, pp. 4331–4336, July 2010.
View at: Google Scholar
Q. H. Chen and D. T. Qin, “Neural-networked three-parameter gear-shift schedule for automated-manual-transmission car,” Control Theory & Applications, vol. 11, p. 023, 2010.
View at: Google Scholar
J. Tan, X. Yin, Y. Lei, and A. Ge, “Research on a neural network model based automatic shift schedule with dynamic 3-parameters,” SAE Technical Paper 2005-01-1597, 2005.
View at: Google Scholar
S. Wu and H. Lu, “Fuzzy neural network control in automatic transmission of construction vehicle,” in Proceedings of the 6th World Congress on Intelligent Control and Automation, WCICA 2006, pp. 2512–2516, chn, June 2006.
View at: Publisher Site | Google Scholar
Y. Li, F. Yu, and C. Wu, “Application of neural network to downhill shift strategy for automatic transmission,” Journal of Shanghai Jiaotong University (Science), vol. 15, no. 4, pp. 498–503, 2010.
View at: Publisher Site | Google Scholar
M. S. Barakat and M. Abdelaziz, “Neural Network Transmission Control,” SAE Technical Papers, 2016.
View at: Publisher Site | Google Scholar
V. Shree, V. Ganesan, P. Tamil Porai, and N. V. Mahalakshmi, “Optimization of fuel injection timing of a gasoline engine using artificial neural network,” SAE Technical Papers, vol. 12, 2013.
View at: Publisher Site | Google Scholar
Q. Dai, “Training and simulation on gear position decision for vehicle based on optimal algorithm of network,” Chinese Journal of Mechanical Engineering, vol. 38, no. 11, pp. 124–127, 2002.
View at: Publisher Site | Google Scholar
C. Qing-hong and Q. Da-tong, “Neural-networked three-parameter gear-shift schedule for automated-manual-transmission car,” Control Theory & Applications, vol. 11, p. 023, 2010.
View at: Google Scholar
M. Peña-Cabrera, V. Lomas-Barrie, I. López-Juárez, and R. Osorio-Comparán, “Contour object generation method for object recognition using FPGA,” International Journal of Automation Technology, vol. 7, no. 2, pp. 182–189, 2013.
View at: Publisher Site | Google Scholar
M. Kato and T. Yamamoto, “Development of Neural-Net-Based Decision Support System for Mattress Patterns Using Particle Swarm Optimization,” International Journal of Automation Technology, vol. 4, no. 2, pp. 178–183, 2010.
View at: Publisher Site | Google Scholar
S. Wiesner, E. Marilungo, and K.-D. Thoben, “Cyber-physical product-service systems – challenges for requirements engineering,” International Journal of Automation Technology, vol. 11, no. 1, pp. 17–28, 2017.
View at: Publisher Site | Google Scholar
N. Yalta, K. Nakadai, and T. Ogata, “Sound source localization using deep learning models,” Journal of Robotics and Mechatronics, vol. 29, no. 1, pp. 37–48, 2017.
View at: Publisher Site | Google Scholar
J. A. Garcia Sanchez, K. Ohnishi, A. Shibata, F. Dong, and K. Hirota, “Deep level emotion understanding using customized knowledge for human-robot communication,” Journal of Advanced Computational Intelligence and Intelligent Informatics, vol. 19, no. 1, pp. 91–99, 2015.
View at: Publisher Site | Google Scholar
L.-F. Chen, Z.-T. Liu, M. Wu, F. Dong, and K. Hirota, “Multi-robot behavior adaptation to humans' intention in human-robot interaction using information-driven fuzzy friend-Q learning,” Journal of Advanced Computational Intelligence and Intelligent Informatics, vol. 19, no. 2, pp. 173–184, 2015.
View at: Publisher Site | Google Scholar
W. Li, H. Fu, L. Yu et al., “Stacked Autoencoder-based deep learning for remote-sensing image classification: a case study of African land-cover mapping,” International Journal of Remote Sensing, vol. 37, no. 23, pp. 5632–5646, 2016.
View at: Publisher Site | Google Scholar
Y. Lv, Y. Duan, W. Kang, Z. Li, and F.-Y. Wang, “Traffic flow prediction with big data: a deep learning approach,” IEEE Transactions on Intelligent Transportation Systems, vol. 16, no. 2, pp. 865–873, 2015.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2018 Zengcai Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1872

Downloads

1314

Citations