Abstract

The usage of a smartphone while driving has been declared a global portent and has been admitted as a leading cause of crashes and accidents. Numerous solutions, such as Android Auto and CarPlay, are used to facilitate for the drivers by minimizing driver distractions. However, these solutions restrict smartphone usage, which is impractical in real driving scenarios. This research paper presents a comprehensive analysis of the available solutions to identify issues in smartphone activities. We have used empirical evaluation and dataset-based evaluation to investigate the issues in the existing smartphone user interfaces. The results show that using smartphones while driving can disrupt normal driving and may lead to change the steering wheel abruptly, focus off the road, and increases cognitive load, which could collectively result in a devastating situation. To justify the arguments, we have conducted an empirical study by collecting data using maxed mode survey, i.e., questionnaires and interviews from 98 drivers. The results show that existing smartphone-based solutions are least suitable due to numerous issues (e.g., complex and rich interfaces, redundant and time-consuming activities, requiring much visual and mental attention, and contextual constraints), making their effectiveness less viable for the drivers. Based on findings obtained from Ordinal Logistic Regression (OLR) models, it is recommended that the interactions between the drivers and smartphone could be minimized by developing context-aware adaptive user interfaces to overcome the chances of accidents.

1. Introduction

According to the world health organization, road accidents are the ninth leading cause of death and are expected to become seventh by 2030. [1]. Each year, more than one million deaths and 50 million damages are caused due to road crashes [1, 2]. The main reason for this depredation is the driver repeated engagements in nondriving activities [1, 3]. Driver engagements with nondriving or distracting activities caused 25% of crashes reported to the police [4]. These distractions disturb the normal driving activity and interrupt the drivers’ attention, leading to accidents [4, 5]. There are different types of distracting activities, including interacting inside and outside objects, eating and drinking, operating the radio or music system, communicating with commuters in the vehicle, and particularly operating smartphones [6].

The use of a smartphone while driving made driving activity more unsafe as performing concurrent activities requires fine-grained cognitive, physical, and mental skills [6, 7]. Various studies reveal that smartphone usage while driving is a global issue and the main source of accidents [8]. Despite the known calamities, drivers are still using their smartphones, which is evident from the fact that at a particular instant of time, about 0.66 million people are using their phones while driving [8, 9]. However, most countries have discouraged this activity and proposed high penalties [10]. According to the National Safety Council, it has been reported that 1.6 million accidents and 0.39 million deaths were caused by smartphone usage [11]. Along with other smartphone activities, texting activity is very dangerous and has attracted public and media attention [12, 13]. Similarly, it has been investigated that novice drivers engaged with smartphones can spend more than 400% time not focusing on the road [14].

Reducing drivers’ distractions is the researcher’s prime interest and has tried different solutions, including Android Auto, CarPlay, and other infotainment systems, to combat the issue. The main objective of these solutions is to minimize the interaction between the vehicle and drivers for the secondary tasks. The available solutions are merely three basics concepts, i.e., blocking the smartphone’s dangerous activities, changing interaction mode, and providing simplified interaction [8, 15]. Several solutions have been proposed to reduce drivers’ interactions with smartphones [16] and suggest blocking smartphone features while driving [8, 15]. Blocking the smartphone features is found encouraging in some recent studies and has argued that it will significantly reduce the risks of crashes as many features of the phone will be stopped during driving. However, this approach is strongly discouraged by the people who have developed their habitual contact with their phones. Similarly, it has low adequacy among the drivers as the blocking approach is against the espousal of technology [17, 18]. Besides, no strong evidence has been found to investigate the effectiveness of this approach [8].

Another group of researchers has proposed changes in interaction with the smartphone using voice commands instead of visual interaction. Performing smartphone activities using voice commands will assist the drivers by minimizing physical and visual interactions [19]. Various solutions are using these voice-based interfaces for communication, including Do Not Disturb while Driving, CarPlay, Android Auto, and DriveSafe.ly [20]. This approach has shown comparatively more benefits over the visual interfaces [21, 22]. However, the researchers have claimed that drivers are still facing numerous issues as it is difficult to comprehend properly in noisy environments. Similarly, these still require interior glance time and higher cognitive overload. [8, 15, 2325]. Technically, these solutions may reduce visual-manual interaction but increase cognitive overload [8, 2628]. By considering the heap of limitations in the previous two approaches, the researchers have claimed that simplifying the smartphone functionalities will minimize the driver’s distractions. [8, 15]. Following this idea, numerous applications have been designed that provides simplified interfaces in term of voice commands and shortcuts to the apps [2]. However, as discussed earlier, operating the smartphone through voice interfaces can increase cognitive overload, off-road visual engagements, and navigational complexities [2931]. Certainly, the approach can be potentially advantageous and effective over the others, but empirically, no evidence is found supporting the applications in minimizing the risks of crashes [10]. The researcher’s interests in this area are broader and have a high volume of success if proper attention is paid to come up with suitable solutions by recognizing the fact that driver status while driving is changed from his status while not driving. Therefore, the available solutions need to be redesigned more intelligently so that most of the smartphone activities should be accomplished automatically. This paper is aimed to provide recommended interfaces to the drivers after analyzing (i.e., empirically and through AutoLog [32] dataset) the existing issues and challenges faced by the drivers. We have defined three research questions in this study:(1)Are the Smartphone Native Interfaces complex, time-consuming, require excessive visual, mental, and physical attention and lead to a change in vehicle dynamics (e.g., speed, acceleration, steering wheel) ?(2)Are the Voice Interfaces (i.e., performing smartphone activities via text-to-speech and speech-to-text) lead to increased cognitive overload and affect vehicle dynamics?(3)What type of recommended interfaces will be needed for drivers to overcome these issues and challenges?

The rest of the paper is organized as follows. Methods are presented in Section 2. Results are presented in Section 3, and their discussion is presented in Section 4. Finally, the conclusion is discussed in Section 5.

2. Materials and Methods

2.1. Participants

A total of 98 drivers participated in this study. Among these, 18.37% (n = 18) were female and 81.63% (n = 80) were male participants. The selection of the participants was based on the condition of having more than a year of driving experience with a valid driving license. Similarly, the participants were filtered with the condition of having a smartphone in use for the last three years. Ages ranged from 19 to 49 and above years. Participants have been categorized accordingly in four different age groups: 19–28 years (n = 32), 29–48 years (n = 43), 39–48 years (n = 17), and 49 and above (n = 06). The participants are normally habitual of performing common smartphone activities while driving using different metaphors, i.e., 79.6% (n = 78) are using native smartphone interfaces, 15.33% (n = 15) are using voice interfaces (. e.g., Google Assistant, etc.), and 5.11% (n = 5) are using HUDs. The participant’s frequency of travel daily was 34.69% (n = 34), and on a random or sometimes basis was 65.31% (n = 64). Normally, the traveling purpose was modeled as workplace mostly, business mostly, and shopping mostly. The number of participants who participated according to traveling type is: employee mostly (n = 51), business mostly (n = 22), and shopping mostly (n = 25).

2.2. Procedure and Instrument

A two-level methodology is proposed to investigate the drivers’ distractions due to performing smartphone activities.

In the first level, our real-time Android app, namely “AutoLog,” was installed on participants’ smartphones (see Figure 1) [32]. As shown in Figure 1, the AutoLog is developed with the intention of a multimodal data acquisition platform to capture data related to the vehicle, drivers’ smartphone activities, and environmental contextual data for finding latent distractions and their effects on driving performance. The participants are instructed that the application will be running in the background to log smartphone activities (i.e., keystrokes, missed touches, wrong touches, easiness, etc., are also captured to calculate perfect touch with less time), and their effect on vehicle dynamics irrespective of their privacy violation. The AutoLog uses built-in smartphone sensors and a simple plug-in-play module ELM327 to be inserted into the OBD2 port to obtain the required data. We have used built-in smartphone sensors (including accelerometer sensor, gyroscope sensor, location sensors, etc. [33, 34]) and OBD2 not to overburden and disturb the participant’s drivers. The modalities captured and recorded by AutoLog are driver smartphone activities, location, weather information, and vehicle dynamics (engine RPM, brake status, accelerator status, and speed).

In the second level, to further strengthen our argument, a quantitative study was carried out to obtain data from different participants for the detailed investigation. The participants have completed an online questionnaire about their preferences and opinion regarding the usage of native smartphone interfaces, usage of voice interfaces, recommended interfaces, and their effect on vehicle dynamics. The average time for questionnaire completion was 20 minutes. The questionnaire contains different items, including driver demographics (i.e., age, gender, the purpose of traveling (mostly), travel frequency, etc.), usage of smartphone native interfaces (i.e., visual-manual interaction for texting, emailing, phone calls, and their effect on driving performance), usage of smartphone activities via voice interfaces (i.e., hands-free interaction including conversation and their effect on driving performance), and usage of recommended interfaces. Questions are organized in a way where participants will be asked to select an answer from a Likert-Scales, having Definitely to Definitely Not. We have informed the participants about the question’s nature, purpose, the procedure of the data collection, and system evaluation.

To answer the first research question, participants were asked to answer 17 questions. For example, “Performing activities using native smartphone interfaces lead to change in speed/brake/accelerator/steering wheel variations?,” “accessing and taping a specific area on smartphone screen and linking it with common tasks are time-consuming and difficult,” and “is composing a text message and search for contact is time-consuming?” To answer the second research question, the participants were asked, “have you ever experienced an increase in cognitive overload when using a smartphone through voice commands?” “do you feel that performing smartphone activities via voice commands incurs extra burden for memorizing the commands?,” “Are you satisfied and comfortable when doing basic smartphone activities via voice instructions?.”

To answer the third question, participants were provided a list of recommended interfaces and were asked to select the options that they would prefer or feel comfortable. The functions were determined based on our future context-aware adaptive interfaces for drivers to minimize driver distraction. For example, the participants were asked, “do you agree to update the smartphone's existing User Interface (UI) to be easy to use and driver-friendly?” “Will you agree to convert the interaction to an automatic mode where the interface will be changed to a simplified interface?” “Do you agree if the most frequent applications are to be placed on the main screen while driving,” and “will you be happy to cancel unknown and lengthy messages while driving at higher speed?”

2.3. Data Analysis

We have performed numerous tests in this study and used STATA and Microsoft Excel to analyze the data statistically. For this reason, we have used descriptive tabulation to report frequencies and percentages of the variables. We have also performed the Cronbach alpha test to investigate the internal consistency and reliability of the measurement items. It is concluded that the items used in the study were found reliable and internally consistent. Further, to check multicollinearity, we have used Kendall’s tau-b rank correlation matrix and found it satisfactory. Finally, for distraction-free recommended interfaces, four OLR models have been estimated.

3. Results

3.1. Smartphone Use While Driving

The responses of the participants have been compiled and showed descriptive statistics of frequencies and their percentages. Text messaging, phone calling, and emailing activities performed on Smartphone Native Interfaces (SNI) showed higher scales. This means that performing these activities while driving will lead to a change in vehicle dynamics, including variations in speed, lane deviation, and abrupt changes in braking. However, many participants have answered that variations are due to time-consuming, complex, rich interfaces. These applications have very low suitability for drivers as these are mainly designed with the perspective of ordinary smartphone users. Similarly, it has also been reported that operating smartphones via Voice Interfaces (VI) may increase cognitive overload. Furthermore, it has also been reported that sometimes performing smartphone activities using VIs is also not feasibly in a noisy environment.

3.2. Managing Text Messaging

One of the most tedious and dangerous smartphone activities while driving is text messaging, which many researchers have been acknowledged as a major source of accidents. According to our analysis, maximum participants have selected higher scales 3, 4, and 5, which means that text messaging leads to speed variations, changes in lane variations, abrupt changes in braking, wrong tapping the screen, and particularly focusing off the road (see Figure 2). Similarly, some of the participants reported that texting is a difficult and time-consuming task.

3.2.1. Managing Phone Calls

It has been reported that managing phone calls while driving is complex and leads to vehicle dynamic variations due to changes in vehicle dynamics due to the intricate nature of searching phone numbers and dialing a number. Participants reported that the common reasons behind the complexity of making phone calls are small buttons, small interfaces, and complex navigational patterns. The results are summarized and depicted in Figure 3.

3.2.2. Managing Emails

Emails management while driving is not a much frequently used activity as compared to texting and calling. Performing emailing activity while driving is somewhat less usable as compared to texting and phone calling activities. Similarly, as per our analysis, the participants have stated that they usually ignore the emails while driving due to difficulties in reading and replying to emails. The participants also stated that in different varying contexts (i.e., variations in speed), complex interfaces, and smaller font size, they are ignoring the emails. Similarly, some of the participants have reported that they are ignoring emails while driving due to changes in vehicle dynamics, speed, lane variations, and abrupt changes in braking.

3.2.3. Voice Interfaces

Physical and visual engagement is not only enough for safe driving; minds need to be on-road as well. Mind engagement may increase while operating smartphones through voice interfaces. According to our statistics, performing smartphone activities while driving can overload the human brain as higher scales; i.e., Figures 4 and 5 show that cognitive overload will increase. The participants also reported that voice interfaces might disclose privacy to some extent. Similarly, some participants reported scales, i.e., 3 & 4, showing that they are not using voice interfaces due to noise, language barrier, and extra efforts. Some participants reported that they do not feel comfortable performing smartphones using voice interfaces (see Figure 5).

3.3. Multicollinearity and Data Reliability Checking

We have used Cronbach Alpha to check the reliability of the items. The scales are internally consistent and reliable (see Table 1). As shown in Table 2, we have also performed Kendall’s correlation matrix to investigate the relationship between the independent variables. The values having an asterisk () in Table 2 show that the correlation is significant. The results reflected that the correlation coefficient value is lower than 0.5, which means that there is no issue with multicollinearity.

3.4. Distraction Analysis Using Dataset

The dataset generated by the “AutoLog” application also contains valuable information, which could significantly add to the findings of distractions and issues discussed earlier. Analyzing the dataset will strengthen our recommendations and future directions for minimizing the drivers’ distractions caused due to using a smartphone. Using a smartphone while driving could result in changes in vehicle dynamics, steering wheel movements, unwise usage of gas and brake pedals, and vehicle speed. The findings extracted from the dataset are discussed in the following sections.

3.4.1. Speed Variations

We have used the AutoLog application to capture and store the speed variations when performing common activities on smartphones while driving. After analyzing the AutoLog dataset, we have noticed speed variables in different situations like attending the phone calls, reading the text messages, and replying to text messages. Speed variations can be seen in Figure 6 as it has been degraded from 80 km/h to 55 km/h while attending the phone call and 80 km/h to 30 km/h during texting activity while driving. These variations can lead to catastrophes of different kinds, such as on a highway, a vehicle following high speed may hit a vehicle ahead due to a sudden decrease in the speed. In Figure 6, X-axis shows the driving time, and Y-axis shows the speed of the vehicle.

3.4.2. Variations in Steering Wheel

Apart from speed data, the dataset also captured steering wheel information from the drivers. The control on the steering wheel w.r.t. speed shows the driving performance of a driver. Like speed, analyzing the dataset showed clear variations on the steering wheel control of the drivers, especially while attending phone calls, as shown in Figure 7. The variations in the steering wheel angle regarding speed are noticeable, and a significant variation is from 106 degrees to 121 degrees as the speed is decreased.

This shows a significantly large and consistent angle shift with a sudden decrease in the speed due to attending a call on a smartphone. Therefore, requiring drivers to be sharper in steering when attending phone calls while driving compared to other conditions. These abrupt changes in the steering wheel could be catastrophic and could result in lane deviation and an accident.

3.4.3. Distraction Analysis Using Dataset

To come up with optimum solution, data is collected from participant’s drivers for recommended solutions. As shown in Figure 8, the categorized tabulation for the four dependent variables has been constructed for Recommended Interfaces. Participants selected higher scales responses that show that the existing interfaces’ changes would be viable and fruitful. Cross-tabulation of the four dependent variables, i.e., Recommended Interfaces (RI) have been performed whereas RI1 shows Automatic and Contextual Mode of Interaction, RI2: Change the existing Interface, RI3: Automatically avoiding lengthy messages, and RI4: Priorities the Activities) as shown in Table 3. These variables have been analyzed concerning driver’s demographics, i.e., age, experience, and traveling mode.

The young participants (65%) and educated participants (i.e., 80%) have provided their positive back (i.e., mostly agree) about changing the existing smartphone user interfaces to most driver-friendly interfaces. The new driver-friendly interfaces will automatically change the driving mode and will prioritize the communication activities. Similarly, drivers with driving inner city and outer city were also having a positive attitude for new proposes driver-friendly interfaces. In addition, the participants who are driving for business purposes, work purposes, or shopping purposes also wanted new driver-friendly interfaces.

3.5. Regression Analysis

Logistic regression models have been estimated (see Tables 47) to investigate the effect and cause of the four variables of “Recommended Interfaces.” The independent variables for all models are the same, including drivers’ demographics, i.e., age, experience, traveling and driving mode, and perception about the existing interfaces. A correlation test has been conducted and found satisfied to check the multicollinearity problem between the independent variables.

4. Discussion

Minimizing smartphone distracted driving has been identified as a fundamental issue for the 2018–2020 National Road Safety Action Plane [2]. This study makes an effective contribution to investigate the issues in smartphone technology and recommended a driver-friendly solution for the development of countermeasures.

In this study, we have identified that 80% of the sample uses smartphone native interfaces, 15% sample are using supportive voice interfaces (e.g., Google Assistant), and only 5% are using Head-Up-Display (HUDs). This means that the drivers are habitual of using smartphone native interfaces. The current smartphone native interfaces require much visual, manual, and mental attention. It has been concluded that smartphone activities either on smartphone native interfaces or other infotainment systems could create serious driving distractions. It has been investigated that usage of smartphones while driving could distract drivers both physically and visually. For example, performing a textual activity for 2 sec can increase accidents 24 times [3].

Our results revealed that smartphone activities while driving lead to abrupt variations in speed, braking, lane position, wrong touches, and spelling mistakes, and diverting focus off the road. These issues are due to the small interface size, containing small icons with small font sizes. For example, the small size of a button most often leads to the wrong button/widget and requires much visual and mental attention. According to our results, using smartphone native interfaces for performing activities is difficult as it requires much time, effort, and concentration; even passengers cannot manage properly in a moving vehicle. It has been investigated that accessing a particular area on a smartphone screen for touching or tapping is time-consuming and difficult for drivers. Unfortunately, drivers are familiar with the smartphone native interfaces as they use the same in their normal routine life. These results further highlighted that the drivers are uncomfortable using supportive voice interfaces for many reasons, including privacy issues, language barriers, and noise.

We have estimated OLR models for the four different variables representing recommended interfaces. Model 1 represents the question about updating the existing UIs to more easy-to-use UIs. Model 2 is about knowing the driver perception regarding switching to an automatic mode of interaction. Model 3 is about prioritizing the applications in a way to looks less distractive and more efficient. Similarly, model 4 is about the perception of automatically ignoring and canceling lengthy messages. According to our results, the models are significant statistically as the p-value is less than 0.05, values of all coefficients are equal to zero, and the chi2 value is greater than 2.0. Hence, therefore, the null hypothesis has been rejected. It has been concluded that all the models are significant. RI2 values represent the percentage (%) variations with values 0.721, 0.673, 0.573, and 0.925 as elucidated by the independent variables for the four models in the dependent variables. The estimated probability value is less than 0.05, and the z-statistics value is greater than 2, which seems that the coefficients of independent variables are significant. The variables that hold negative coefficients will reduce the probability (log odds) while positive coefficients increase the log odds.

In conclusion, 82% of participants have selected the scale “Definitely” and “Very Probably” that the existing mode of interaction between driver and smartphone needs to be changed to more simplified and easy-to-use interfaces. In terms of “Switching to automatic interactions,” 80% of participants selected the scale “Definitely” and “Very Probably.” Similarly, more than 75% of participants reported prioritizing the activities to more relevant and less distractive interfaces. However, avoiding lengthy and unknown messages automatically while driving was reported by about 60% of participants.

There are several methodological limitations noted in this study. Firstly, although diverse recruitment strategies were adopted, still limited participants’ drivers participated in this study. Similarly, it observed that certain groups of people might have been less likely to participate due to the online nature of this study (e.g., lack of Internet accessibility, lack of education, remote areas, etc.). Secondly, due to some privacy issues about self-reported data, it is possible that participants may have been influenced by biases and recorded incorrect responses. Thirdly, most participants who participated in this study were teenagers; the reason may be that the number of drivers that use a smartphone while driving belongs to the younger population. Future research should consider some more methods to investigate the activities that may increase risky driving behaviors. In the current study, all the participants’ drivers were healthy, and future studies could examine the drivers, the low vision drivers, or those affected due to ocular pathologies issues. Furthermore, in the future, we intend to develop a solution that will use different sensors to identify the context and generate user interfaces in real-time for driver’s smartphone users. It is expected that the context-aware adaptive solution will improve driver safety by minimizing physical, mental, and visual distractions.

5. Conclusion

Smartphone usage while driving has got considerable attention globally as it requires full attention, enough physical engagements, and high psychological skills to perform concurrent activities. Using smartphones while driving is a dangerous activity and was found to be a significant source of crashes and accidents. In ordinary daily life, a person is free to operate a smartphone despite concurrent activities. However, a person while driving has certain issues due to his physical limitations, visual limitations, and psychological limitations. The current smartphone technologies and their rich and complex nature are designed for ordinary users who might not be efficient for the drivers to be used while driving. However, researchers have developed some solutions to cope with the issues and facilitate drivers with easy-to-use interfaces to minimizing distractions and issues. However, there is no empirical evidence found regarding the minimization of distractions and accidents crashes. Therefore, the existing solutions are not viable for the drivers. This paper investigated the existing issues in the state of the art smartphone and their interfaces and proposed the recommended mode of interaction and interfaces for the drivers to minimize distractions. Based on our analysis and investigation, it has been concluded that a context-aware adaptive solution could be an optimal solution to reduce the driver’s limitations.

Data Availability

The data that support the findings of this study are available upon request from the corresponding author.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was supported by Institute for Information & Communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (2021-0-01592, ITRC).