Abstract

Driving simulation is an efficient, safe, and data-collection-friendly method to examine driving behavior in a controlled environment. However, the validity of a driving simulator is inconsistent when the type of the driving simulator or the driving scenario is different. The purpose of this research is to verify driving simulator validity in driving behavior research in work zones. A field experiment and a corresponding simulation experiment were conducted to collect behavioral data. Indicators such as speed, car-following distance, and reaction delay time were chosen to examine the absolute and relative validity of the driving simulator. In particular, a survival analysis method was proposed in this research to examine the validity of reaction delay time. The result indicates the following: (1) most indicators are valid in driving behavior research in the work zone. For example, spot speed, car-following distance, headway, and reaction delay time show absolute validity. (2) Standard deviation of the car-following distance shows relative validity. Consistent with previous researches, some driving behaviors appear to be more aggressive in the simulation environment.

1. Introduction

Driving simulation has been increasingly popular in transportation research because of its efficiency, safety, and controllability. By using driving simulation, researchers can design a specific driving scenario, conduct experiments in a closed and safe environment, and collect precise and diverse data through sensors. These advantages are prominent when driving behavior occurs in a scenario that is dangerous or difficult to reproduce.

For simulation experiments, simulator validity is an unavoidable issue; it refers to the ability of a simulator to reproduce real-world driving accurately [1]. However, simulator validity is inconsistent when the type of the driving simulator or the driving scenario is different, and there is no standardized method for assessing simulator validity [1]. Therefore, it is appropriate to verify the validity of the apparatus before conducting a simulation experiment.

Many driving scenarios need to be verified; one of them is driving in work zones. Work zones are considered to have a negative impact on traffic safety and mobility because of lane closure and lower speed limits [2]. The vehicle speed at the beginning of the work zone always exceeds the speed limit, and the deceleration before the work zone is high [3]. At the same time, the risk of rear-end crash is higher than in nonwork zones [46]. It is dangerous to reproduce these driving scenarios in the real world, which makes the driving simulator a perfect tool for relevant researches.

The primary objective of this research is to verify the validity of behavioral research in the work zone. A field experiment and a corresponding simulation experiment were conducted here to collect behavioral data. Indicators were chosen to identify simulator validity. Moreover, a survival analysis method was proposed here to analyze the validity of reaction delay time.

The arrangement of this paper is presented as follows. Section 2 is an overview of the current literature. In the next section, the apparatus, participants, and experiment process are provided. Section 4 is the definition of indicators and the survival analysis method. The rest of the sections are the results, discussion, and conclusion.

2. Literature Review

Driving simulator validity is a prerequisite of simulation-based research. There are different classifications of simulator validity. One of the widely used simulator validity is absolute-relative validity. Absolute validity indicates that no significant differences between real-world driving and simulated driving. Relative validity indicates that simulated driving shows the same patterns as real-world driving. However, there are a limited number of research studies that validate a driving simulator by directly comparing simulated and real driving [1]. In these studies, statistical tests are a common method to verify absolute validity. In the meantime, direct comparison and regression models are methods to verify relative validity. Tornros [7] used the Tukey test to verify the absolute validity of speed behavior and lateral behavior in the tunnel driving. Helland et al. [8] and Meuleners and Fraser [9] used the paired sample t-test to verify the absolute validity in drunk driving and driving errors, respectively. ANOVA was used to identify the significant difference between real driving and simulated driving, too [1012]. As for relative validity, Helland et al. [8] used the linear mixed model to verify the relative validity of drunk driving, while Riener [13] verified the relative validity of drivers’ reaction delay time by direct comparison.

Data collected from real-world driving and simulated driving are the foundation of driving simulator validity verification. These data always presented in the form of behavioral indicators. Therefore, driving simulator validation research studies can be classified by the type of indicator. Common types of behavioral data are speed [11, 14], lateral position [10, 15], lane-changing behavior [1618], driving errors [9], and others [19]. It is worth noting that validation research for car-following behavior is rarely mentioned in the review of simulator validation studies [1, 20]. In the above cases, indicators are related to the research topic. For example, Branzi [14] used the average speed for speed behavior research. Davenne [16] used inappropriate line crossing time, self-fatigue, and sleepiness for lane-changing behavior and driving fatigue research. Meuleners and Fraser [9] studied driving error with mirror checking, four-direction observations, the speed at interactions, obeying traffic lights, and obeying stop signs.

Speed behavior [2123] and rear-end-crash-related behavior [6, 2430] (merging behavior and car-following behavior) have been a primary concern of researchers because of the traffic feature of work zones. Besides naturalistic driving and field experiments, self-report and driving simulation are also used in the research studies for data collection. Debnath [21] compared self-nominated speeds and actual speeds in work zones, finding that participants generally underestimate the speed in work zones. Domenichini [22] conducted a simulation experiment and found that drivers always exceed the speed limit of work zones. These research studies used behavioral indicators to describe driving behaviors. Paolo and Sar [3] used spot speed and deceleration for speed behavior research in work zones. Lochrane et al. [27] used car-following distance and relative speed for car-following behavior research.

The existing studies show that driving simulators have been used in driving behavior research. Some validation research studies corresponding to the particular driving scenario have been proposed. However, there is a gap in simulator validity research for driving in work zones. In particular, simulator validity research for car-following behavior. The validity verification method is not standardized; the direct comparison is still a common method to verify relative validity. This research examines the simulator validity of driving in work zones, including the free-flow scenario and car-following scenario. Statistical methods and regression models are proposed here for validity verification. Especially, a survival analysis method is proposed here for time-event data like reaction delay time.

3. Experimental

3.1. Apparatus

A field experiment and a simulation experiment were conducted in this research. The field experiment data were collected by instrumented vehicles. The on-board data processing system integrated the data and output it at a frequency of 10 Hz. The driving simulator used in the simulation experiment consisted of an eight degree-of-freedom motion system, a fully instrumented vehicle, and a high-fidelity visual system. The motion system provided drivers with driving force feedback. Sensors of the instrumented vehicle collected data while driving. The visual system consisted of five simulation projectors; the projectors produced a view of horizontal 250 degrees and vertical 40 degrees. LCD monitors provided a view of rearview mirrors. SCANeR™ software was used to edit driving scenarios and integrate experiment data. Simulation data were also output at a frequency of 10 Hz. The apparatuses are shown in Figure 1.

3.2. Participants

The recruitment method of this research followed the method in Davenne et al.’s research [16]. 36 healthy men were recruited; all of them held a valid driving license and had daily-driving experience for at least one year. There were 20 drivers for the field experiment (mean age ± SD = 25.4 ± 3.5 years; mean driving age ± SD = 3.3 ± 1.5 years) and 16 matched drivers for the simulation experiment (mean age ± SD = 25.6 ± 2.4 years; mean driving age ± SD = 3.7 ± 1.1 years). A pretest was provided to ensure every participant is familiar with the requirement of experiments and the operation method of apparatus.

3.3. Experiment Tasks

The free-flow scenario and car-following scenario were chosen in this research. These scenarios were the same both in the field and simulation experiments. The field experiment was conducted on a two-way four-lane highway in Shandong Province, China. The length of the test section was 10 km, and the speed limit of the test section was 100 km/h. The road section in the driving simulator is shown in Figure 2. The speed limit sign and other essential preinformation signs were installed in the simulation experiment to reproduce the road section in the field experiment. To verify the relative validity, 2 × N design with driving environments and other factors were employed in the study.

For the free-flow scenario, the factor was the lane closure type. Two tests were contained in the free-flow scenario; one of them closed the passing lane, and another closed the emergency lane. There were four work zones in each test.

For the car-following scenario, the factor was the leading vehicle’s speed. The car-following scenario was designed as follows to reproduce the rapid deceleration at the beginning of work zones [3] and acceleration at the end of work zones. The driver of the following vehicle was required to follow the leading vehicle and keep it in the same lane for the whole test. The driver of the leading vehicle kept driving at a stable speed before accelerating or decelerating. The upper and lower bounds of the leading vehicle’s speed were 40 km/h and 80 km/h; the gradient of speed changing was 20 km/h.

4. Indicators and Validation Methods

4.1. Driving Behavior Indicators

Free-flow indicators are spot speed, speed reduction, and speed reduction rate. The spots include the beginning of deceleration (BD) and the end of deceleration (ED). Speed reduction rate refers to the deceleration at the beginning of the work zone. The calculation method is shown in the following equation:where is the speed reduction rate. is the speed at BD. is the speed at ED. is the time for the vehicle to drive from BD to ED. The algorithm to identify the speed change point follows the method in Zhang’s research [31].

Car-following indicators include car-following distance (average and standard deviations when speed is stable), headway (average and standard deviations when speed is stable), and reaction delay time. The standard deviation of the car-following distance represents the stability of car-following behavior. Define A as the acceleration/deceleration point of the leading vehicle and B as the acceleration/deceleration point of the following vehicle. The time interval between A and B is regarded as the reaction delay time.

4.2. Survival Analysis Method

The validation methods for nontime data are the Wilcoxon test and linear regression. In the meantime, a survival analysis method is proposed for time-event data such as reaction delay time. Survival analysis is a collection of statistical procedures for data analysis for which the outcome variable of interest is time until an event occurs [32]. According to the basic concept of survival analysis, the key elements of survival analysis include events, survival time , the consequence of event (failure) , survivor functions of the event , and hazard function of the event .

In this study, an event refers to the following vehicle’s response to the leading vehicle’s speed change. Survival time is the reaction delay time. An event will be referred to as a failure if the following vehicle does not respond to the leading vehicle’s speed change or the reaction delay time exceed the threshold. represents the probability that the survival time (reaction delay time) T exceeds the specified time . Survivor function is a basic component of the survival analysis, and it obtains survival probabilities for different values of , summarizing key information from survival data [32]. A nonparametric method called the Kaplan-Meier method is used in this study to estimate . The formula of the Kaplan–Meier method is shown in the following equations:

Iterating equation (2), we have the following:

Data used for the Kaplan–Meier method is arranged in the ascending order of reaction delay time. is the -th shortest reaction delay time. is the estimation of at time . is the probability that T is larger than when reaction delay T is larger or equal to . is a step function.

Hazard function represents the instantaneous potential per unit time for the event to occur, under the premise that the following vehicle has not reacted to the change at time t. Instead of focusing on the continuity of the event, the hazard function focuses on the failure of the event. The hazard function is also called the conditional failure rate, and it is a regression model for survival analysis. The formula of hazard function is shown in the following equation:

The proportional hazards model (Cox model) is used to estimate . The formula of Cox model is shown in the following equation:where is the vector of independent variables. In most cases, is a discrete variable. is the coefficient of . is the nonparametric part of the Cox model, and it represents the baseline version of the hazard function.

For reaction delay time, the absolute validity is verified by comparing the difference of between real-world driving and simulated driving. A chi-square test named Log-Rank test is used in this research. The relative validity is verified by comparing the coefficients of the Cox model.

5. Results

5.1. Free-Flow Validation
5.1.1. Spot Speed

The statistical result of spot speed is shown in Figures 3(a) and 3(b). For the beginning of deceleration, spot speeds in the simulation experiment are higher than in the field experiment (passing lane = 6.25 km/h, emergency lane = 3.63 km/h). Driving environments significantly affect spot speed when the passing lane is closed (); driving environments do not affect spot speed when the emergency lane is closed (). Regarding lane closure type as the independent variable (passing lane = 0, emergency lane = 1), linear regression results show that lane closure type has the same effect for real-world driving (, ) and simulated driving (, ). However, the coefficient for the simulation model is not significant.

For the end of deceleration, spot speeds in the simulation experiment are lower than in the field experiment (passing lane = 2.71 km/h, emergency lane = 2.79 km/h). However, driving environments have no significant effect on spot speed regardless of the lane closure type (passing lane: ; emergency lane: ). Linear regression results show that the lane closure type has the same effect for real-world driving (, ) and simulated driving (, ). Except for one spot (BD, passing lane), the result shows strong evidence of absolute validity.

5.1.2. Speed Reduction

The statistical result of speed reduction is shown in Figure 3(c). Speed reductions in the simulation experiment are higher than in the field experiment (passing lane = 8.96 km/h, emergency lane = 6.42 km/h). Driving environments have a significant effect on speed reduction (passing lane: ; emergency lane: ). Linear regression results show that the lane closure type has the same effect for real-world driving (, ) and simulated driving (, ). However, the coefficients of both driving environments are not significant. The result can be a sign of lacking simulator validity.

5.1.3. Speed Reduction Rate

The statistical result of the speed reduction rate is shown in Figure 3(d). Speed reduction rates in the simulation experiment are higher than in the field experiment (passing lane = 0.51 m/s2, emergency lane = 0.29 m/s2). Driving environments have a significant effect on the speed reduction rate (passing lane: ; emergency lane: ). Linear regression results show that the lane closure type has the same effect for real-world driving (, ) and simulated driving (, ). The coefficient for the real-world model is not significant. The result indicates that the speed reduction rate shows no simulator validity.

5.2. Car-Following Validation
5.2.1. Car-Following Distance

The statistical result of car-following distance is shown in Figures 4(a) and 4(b). For the average of the car-following distance, there is no significant difference between field experiment and simulation experiment (40 km/h: ; 60 km/h: ; 80 km/h: ). Leading vehicle’s speed has the same effect for real-world driving (, ) and simulated driving (, ). The average of the car-following distance shows absolute validity.

For the standard deviation of the car-following distance, the values in the simulation experiment are higher than in the field experiment (40 km/h: 0.39 m; 60 km/h: 1.79 m; 80 km/h: 3.93 m). Driving environments have a significant effect on the indicator (40 km/h: ; 60 km/h: ; 80 km/h: ). Leading vehicle’s speed has the same effect for real-world driving (, ) and simulated driving (, ). The result shows the relative validity of the indicator.

5.2.2. Headway

The statistical result of the headway is shown in Figures 4(c) and 4(d). For the average of the headway, there is no significant difference between field experiment and simulation experiment (40 km/h: ; 60 km/h: ; 80 km/h: ). Leading vehicle’s speed affects headway in the same pattern. The average of the headway shows absolute validity.

For the standard deviation of the headway, the values in the simulation experiment are higher than in the field experiment (40 km/h: 0.15 s; 60 km/h: 0.10 s; 80 km/h: 0.19 s). Driving environments have a significant effect on the indicator (40 km/h: ; 60 km/h: ; 80 km/h: ). Figure 4(d) shows that the relationship between the leading vehicle’s speed and the indicator is not linear. ANOVA result shows that the leading vehicle’s speed () and the interaction () do not affect the indicator. Therefore the indicator shows no simulator validity.

5.2.3. Reaction Delay Time

The statistical result of the reaction delay time is shown in Figure 5. The driving environment has no significant effect on the reaction delay time (overall: ; 40 km/h: ; 60 km/h: ; 80 km/h: ). Regarding leading vehicle’s speed (1 for speed <50 km/h; 2 for speed <70 km/h; 3 for speed ≥70 km/h), leading vehicle’s acceleration (0 for acceleration <0 m/s2; 1 for acceleration ≥0 m/s2), and car-following distance as the independent variable, the result of Cox model is shown in Table 1. The result shows that in the real-world model, the leading vehicle’s acceleration and car-following distance affect reaction delay time significantly. The hazard ratio of the leading vehicle’s acceleration is equal to 0.6014. It means when the leading vehicle is accelerating, the hazard function value of reaction delay decreases by 39.86% and the reaction delay time is longer. The hazard ratio of relative distance is equal to 0.9911. It means the hazard function value of reaction delay decreases by 8.55% for every 10 meters increase in the car-following distance. The reaction delay time is longer. In the simulation model, no independent variable affects the reaction delay time significantly. The survival analysis result shows that the reaction delay time has absolute validity.

6. Discussion and Conclusion

This research shows that for driving behavior in work zones, most of the indicators are valid. In the simulation experiment, the speed behavior in the free-flow scenario and the car-following behavior in the car-following scenario are consistent with which in the field experiment. For the speed behavior, vehicle dropping speed rapidly at the beginning of work zones, which is consistent with the study by Paolo and Sar [3]. Taylor et al. [33] pointed out that additional design features like temporary traffic barriers, reduced lane width, and crossover sections may influence vehicle speeds in work zones. For this research, lane closure is the main feature to affect vehicle speeds. In particular, the vehicle speed is lower and drops more rapidly when the passing lane is closed. As for the car-following behavior, car-following distance has a linear relationship with the leading vehicle’s speed. Drivers prefer to keep a longer distance when the speed is higher. This behavior shows strong consistency between the field experiment and simulation experiment. The result of the Cox model indicates that reaction delay time is not a constant but an unfix value related to car-following distance and the leading vehicle’s acceleration. This finding is proved by previous research studies [3437]. Instead of treating the relationship between reaction delay time and independent variables as linear [3436], this study uses a proportional hazards model to describe the probability distribution of reaction delay time. However, the model result for the simulation experiment is not significant. Perhaps further research is needed to find out the reason.

Past researches reported that driving simulators have relative validity, but do not exactly replicate the driving behavior of the real world [38]. Driving behaviors in the simulation experiment are more aggressive than in the field experiment. For example, vehicle speed in the simulation experiment is higher, and the deceleration at the beginning of the work zone is higher, too. These behaviors can conduct to a high probability of traffic crash [3]. Similar results were reported by previous researches [7, 14, 3941]. The standard deviation of the car-following distance and standard deviation of the headway are higher in the simulation experiment, which means the car-following process is more stable in real-world driving. The safety of driving simulators may be an explanation of aggressive behaviors. Helland et al.[8, 15] reported that the aggressive driving behaviors in the simulation experiment can be explained by an enhanced perception of real danger in real-world driving compared to the simulator. Bella [41] conducted a similar conclusion.

Overall, the simulator validity of driving behaviors in work zones is verified. The speed behavior and car-following behavior in the simulation environment show a similar pattern as which in the real-world environment. A survival analysis method is proposed to replace the direct comparison method for simulator validity verification of the time-event data. Comparing to linear regression models, the proposed model can describe the probability distribution of reaction delay time. The result of this research can be theoretical support for simulation-based research, especially for driving behavior research in work zones. Consistent with previous researches, some behaviors are more aggressive in the simulation experiment, which needs further research to explain the mechanism.

This study deals with one critical issue of driving behavior research based on the driving simulator. The survival analysis method proposed in the study provides an effective way to verify time-event data. However, this study still has some limitations. First, in the free-flow validation study, the deceleration behavior is presented by spot speed. Although the spot speed can represent the deceleration behavior feature, it still should be noticed that this behavior is continuous. Thus in future research, the driving simulation validation based on speed profile should be discussed. Second, merging behavior or lane-changing behavior also is important in the work zone area [6, 28, 29]. The driving simulator validity of merging behavior will be an interesting topic. It should be mentioned that collecting merging behavior in real-world driving situations is a challenging job; advanced technology and method should be proposed to deal with it.

Data Availability

The data used to support the findings of this study are available upon request to Yanning Zhang, [email protected].

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This research was financially supported by Technology Research and Development Plan of China State Construction Engineering Corporation (CSCEC-2017-Z-20) and the National Natural Science Foundation of China (71673201).