Abstract

The basal ganglia, which have been shown to be a significant multisensory hub, are disordered in Parkinson’s disease (PD). This study was to investigate the audiovisual integration of peripheral stimuli in PD patients with/without sleep disturbances. Thirty-six age-matched normal controls (NC) and 30 PD patients were recruited for an auditory/visual discrimination experiment. The mean response times for each participant were analyzed using repeated measures ANOVA and race model. The results showed that the response to all stimuli was significantly delayed for PD compared to NC (all ). The response to audiovisual stimuli was significantly faster than that to unimodal stimuli in both NC and PD (). Additionally, audiovisual integration was absent in PD; however, it did occur in NC. Further analysis showed that there was no significant audiovisual integration in PD with/without cognitive impairment or in PD with/without sleep disturbances. Furthermore, audiovisual facilitation was not associated with Hoehn and Yahr stage, disease duration, or the presence of sleep disturbances (all ). The current results showed that audiovisual multisensory integration for peripheral stimuli is absent in PD regardless of sleep disturbances and further suggested the abnormal audiovisual integration might be a potential early manifestation of PD.

1. Introduction

Parkinson’s disease (PD) is traditionally recognized as a movement disorder and is characterized by bradykinesia, resting tremor, and rigidity. However, recent evidence suggests that patients with PD also have various nonmotor disturbances such as depression, cognitive impairment, sleep disorders, and olfactory disturbance [1, 2]. Moreover, nonmotor symptoms are sometimes evident prior to the onset of motor symptoms during the “premotor stage” and influence the patients’ quality of life. Therefore, many studies have focused on the early detection and management of nonmotor symptoms associated with PD [1].

People obtain dynamic effective information from the complex environment through multiple senses. A number of studies have reported that people with PD present sensory and perceptual impairments [3], including delayed responses to auditory or visual stimuli compared with age-matched healthy controls [47]. However, a simple reaction time task includes many steps: identifying and evaluating the stimulus, selecting the appropriate response, and programming and executing the movement. Thus, delay at any one or all of these stages may lead to a delayed reaction time [5]. For PD patients, the observed increase in simple reaction time may result from slowness of movement compared with age-matched normal controls. To quantitatively assess sensory processing speed, it is necessary to remove the redundant time for executing the movement. Of note, individuals are often inundated with stimuli from various sensory modalities, and merging multisensory information is therefore often crucial in making a rapid and accurate response [812]. Therefore, the quantitative assessment of multisensory integration processing ability is very meaningful in the investigation of PD.

By comparing reaction times to multisensory stimuli and to individual component unisensory stimuli, quantitative assessment of multisensory integration can be performed while controlling for response time for executing movement in PD [1315]. A substantial loss of dopaminergic neurons in the basal ganglia is observed in PD [1618]. Using an extracellular single-cell recording technique, Nagy et al. confirmed that like the superior colliculus and related structures, the basal ganglia (e.g., the caudate nucleus and the substantia nigra) have the ability to integrate multisensory information [18]. The latest studies conducted by Noy et al. showed that individuals might optimally integrate audiovisual cues to synchronize steps during step-by-step walking [19], which indicated the importance of cross-modal integration of visual and auditory signals for PD patients. However, currently few studies have reported the audiovisual integration ability of PD patients. Fearon et al. [13] recently demonstrated that abnormal audiovisual processing occurs in PD patients compared with age-matched healthy controls; in their study, the visual stimuli were presented centrally. Previous studies have shown that the location of the presented stimuli may greatly affect detection and discrimination of the stimuli. The more peripherally a visual or auditory stimulus was located (from 0° to 60°), the slower both the response accuracy and the speed of the response were [20, 21]. Nidiffer et al. [21] found a similar response pattern to audiovisual stimuli. Furthermore, these authors also reported increasing performance facilitation as the stimuli were positioned at more peripheral locations, indicating that the location of the stimulus (central or peripheral) greatly influenced audiovisual integration [21]. However, it is still unknown whether the multisensory integration of peripheral stimuli is altered in the same way as the multisensory integration of centrally located stimuli.

Sleep disturbances that have a detrimental effect on health-related quality of life are a common disabling nonmotor symptom of PD. Such sleep disturbances can occur at any point during the course of PD and even at the initiative stage [22]. Sleep disturbances are estimated to occur in 60–98% of patients with PD [2224]. Multiple factors contribute to the occurrence of sleep disturbances, including PD-related pathological changes, nocturnal motor/nonmotor symptoms, medication use, and comorbid primary sleep disorders [25]. However, because no investigation has focused on the audiovisual integration of PD patients with sleep disturbances, it is completely unknown whether or not sleep disturbances worsen the abnormal audiovisual integration that occurs in PD.

Using an auditory/visual stimulus discrimination task [26, 27], the present study aimed to quantitatively measure the ability of PD patients to integrate peripheral audiovisual stimuli and to evaluate the effect of sleep disturbances on PD-related peripheral audiovisual integration.

2. Methods

2.1. Subjects

A total of 36 age-matched healthy volunteers (62–78 years; mean age ± SD, 69.69 ± 4.41) and 30 PD patients (53–82 years; mean age ± SD, 67.53 ± 9.1) participated in this study and finished the experiment successfully. All of the age-matched healthy volunteers who made up the normal control group were randomly recruited from the Okayama Silver Human Resources Center, and all of the PD patients were recruited from outpatient clinics of the Department of Neurology, Dokkyo Medical University Hospital. All the recruited age-matched healthy volunteers agreed to participate in the experiment, and finished the experiment successfully. However, two of the PD patients in the outpatient clinics had no time to attend the experiment. A diagnosis of PD was made according to the established criteria by board-certified neurologists [28], and disease duration of the PD patients was recorded in Table 1. The participants were naïve to the device and to the task. All the participants provided written informed consent to the procedure, which was previously approved by the ethics committee of Okayama University (NC) or of Dokkyo Medical University Hospital (PD) specifically according to the location at which the examination was performed. Additionally, all of the participants in the NC group were in good physical condition and not taking any medications that might have central effects.

2.2. Stimuli

The visual stimulus was a black and white checkerboard image (52 × 52 mm), which was presented on a black background on a 21-inch computer monitor positioned 60 cm in front of the participant’s eyes (Figure 1). All visual stimuli (V) were presented on the lower left or lower right quadrant of the screen for 150 ms (at a 12-degree visual angle to the left or right of the center and at a 5-degree angle below the central fixation point). The auditory stimulus was a 1000 Hz sinusoidal tone that was presented randomly to the left or right ear through earphones at approximately 60 dB SPL for 150 ms (10 ms of rise/fall cosine gate). The audiovisual stimuli (AV) were presented through a combination of the visual and auditory stimuli. Each subject participated in only one session consisting of 50 visual stimuli, 50 auditory stimuli, and 50 audiovisual stimuli.

2.3. Experimental Procedure

Each subject was instructed on how to complete the experiment, which consisted of two parts, a questionnaire assessment session and an auditory/visual stimuli discrimination session. All of the questionnaires were completed in the outpatient department or in a special quiet room with the assistance of professional staff. For the auditory/visual discrimination session, each subject was tested individually in a quiet room free from external noise and distraction, thereby minimizing the possible influence of any physiological effects.

2.3.1. Questionnaire Assessments

Each participant’s overall cognitive function was estimated using the Montreal Cognitive Assessment (MOCA) [29]. The Japanese versions of the Parkinson’s Disease Sleep Scale-2 (PDSS-2) [30], the Epworth Sleepiness Scale (ESS) [31, 32], and the Pittsburgh Sleep Quality Index (PSQI) [33] were used to evaluate sleep conditions. Additionally, for the PD patients, Hoehn and Yahr (HY) staging was used to rate disease severity [34], and the duration of the disease and Levodopa equivalent dose (LED) used were obtained from the attending physician after receiving the patient's permission. This session lasted approximately 40 mins.

2.3.2. Auditory/Visual Stimuli Discrimination Session

The subjects were instructed to perform an auditory/visual stimuli discrimination task in a quiet room (a laboratory room at Okayama University or at Dokkyo Medical University Hospital, Japan) with their eyes fixed on the fixation cross (Figure 1). All of the participants were naïve to the device and to the task. Stimulus presentation and response collection were conducted using Presentation software (Neurobehavioral Systems Inc., Albany, California, USA). At the beginning of the task, the subjects were presented with a fixation cross for 3000 ms. Following fixation, all stimuli were presented randomly, and the subjects were instructed to identify which hemispace the stimulus was presented in. They were instructed to press the appropriate button (the right button if the stimulus was presented in the right hemispace and the left button if the stimulus was presented in the left hemispace) as rapidly and accurately as possible. Each stimulus was followed by an interstimulus interval (ISI) that varied randomly in duration from 2000 to 3000 ms for subject response and rest. This session lasted approximately 6.3 mins.

2.4. Data Analysis
2.4.1. Questionnaire Assessments

The subject was defined as a poor sleeper if he or she had a global PDSS-2 score ≥15 [30]. The subject was recognized as having excessive daytime sleepiness if he or she had a total ESS score ≥11 [32] and was indicated as having insomnia if the overall PSQI score was ≥6 [35]. In the current study, we divided the PD patients into those with and those without sleep disturbances according to their PDSS-2 scores. The global score was computed separately for each subject in every assessment, and the resulting data were subjected to a one-sample t-test (two-tailed).

2.4.2. Mean Response Time and Hit Rates

In the auditory/visual discrimination session, the hit rates and mean response times were computed separately for each subject and in each condition. The hit rate is the percentage of correct responses (the response time falls within the average time period ± 2SD) relative to the total number of stimuli. The mean response time was determined as the average response time for all correct responses. Finally, the data were subjected to 2 groups (NC and PD) 3 conditions (A, V, and AV) repeated measures ANOVA followed by post hoc tests to analyze the main effect and factors interaction.

2.4.3. Race Model

In the current study, audiovisual integration was evaluated using the redundant nature effect. To examine the redundant nature effect of multisensory integration for the bimodal stimuli condition, we reanalyzed the mean response times using cumulative distribution functions (CDFs). The bimodal AV data were compared with an independent race model, which is a statistical prediction model that uses the CDF of the summed probabilities of the visual and auditory responses [14, 15]. The model permits a direct comparison between the multisensory condition and the predicted probability of unimodal conditions, , by segmenting the subject-specific CDFs for each condition using 10 ms time bins. is the probability of responding within a given time to a unimodal auditory trial, and is the probability of responding within a given time to a unimodal visual trial. If the probability of a response to is significantly greater than that predicted by the summed probabilities of and , neural audiovisual integration of the two unimodal inputs is considered to be occurred [14, 15]. Then, the redundant nature effect of multisensory conditions was defined by subtracting a subject’s race model from his or her audiovisual CDFs at each time bin to generate a difference curve for each subject. A one-sample t-test (two-tailed) was then performed for each time bin within each of the groups (the NC and PD groups) to identify significant deviations () by comparing the value at each time bin with zero.

2.4.4. Correlation Analysis

For PD patients, there was no significant audiovisual integration; therefore, the bimodal response facilitation was assessed through the interactive index [36]. Correlation analysis was conducted to examine the relationship between the degree of response facilitation and H&Y stage or disease duration. The variables , , and represent the mean response times to each stimulus. All of the data were subjected to bivariate correlations analysis (Pearson’s correlation, two-tailed):

3. Results

3.1. Questionnaire Assessment

A one-sample t-test (two-tailed) was conducted between the NC and PD groups for Age, Education, MOCA score, PDSS-2 score, ESS score, and PSQI score, respectively. No significant difference was found between the two groups for Age , Education , or PSQI score . However, there was a significant difference for MOCA score , indicating the presence of cognitive impairment in PD. Furthermore, significant differences were also found for PDSS-2 score and ESS score , showing that obvious sleep disturbances occurred in some PD patients (Table 2).

3.2. Mean Response Time and Hit Rates

The mean response times and hit rates for NC and PD patients are shown in detail in Table 3. Analysis using 3 (modality) 2 (hemispace) repeated measures ANOVA showed main effects of modality in both the NC group and the PD patients ; however, no significant main effects of hemispace were found in either the NC group or the PD patients . Therefore, the data from the left and right hemispaces were combined. The mean response times and hit rates for NC and PD are presented in Figure 2.

Analysis of the response times using 2 groups (NC and PD) 3 modalities repeated measures ANOVA showed a significant main group effect . The pairwise comparisons showed that for the NC group, the responses to bimodal stimuli were significantly faster than the responses to unimodal visual or auditory stimuli. However, there was no significant difference in the response of the NC group to unimodal visual and auditory stimuli . For the PD group, the responses to bimodal AV stimuli were significantly faster than the responses to unimodal visual or auditory stimuli. However, there was no significant difference in the response to unimodal visual and auditory stimuli . Additionally, there was a significant main effect of modality . The pairwise comparisons between the NC and PD groups showed significantly faster responses for NC than those for PD to unimodal visual , auditory , and audiovisual stimuli . However, there was no significant interaction between group and modality .

Analysis of the hit rates using 2 Group (NC and PD) 3 Modality repeated measures ANOVA showed a significant main effect of group , with a higher accuracy for the NC group than for the PD group. The pairwise comparisons between the NC and PD groups showed significantly higher accuracy for NC than for PD to unimodal visual and auditory stimuli; however, no significant difference was found for the bimodal AV condition. However, there was no main effect of modality and no interaction between group and modality .

3.3. Race Model Comparisons

A race model was used to analyze the RTs to evaluate the redundant nature effect of the multisensory stimuli under each of the experimental conditions (Figures 3(a) and 3(b)). The relationship was compared by subtracting the race model CDFs from the bimodal AV CDFs for each group (Figure 3(c)). Significant audiovisual interactions (, one-sample t-test) were found for the NC group (Figure 3(c), solid line); however, there were no significant differences between the responses to bimodal stimuli and the predicted race model for the PD patients (Figure 3(c), dotted line) .

The foregoing results indicate that there was significant diversity in audiovisual interaction between the PD patients and the age-matched NC group. To further examine the possible cause of the significant cognitive functional difference between these two groups, we divided each group into two subgroups based on the individuals’ MOCA scores (cutoff = 26). A similar race model analysis method was used for the further analyses. The results indicated that there was no significant difference between the NC subgroups (; Figure 4(a)) or between the PD subgroups (; Figure 4(b)). Additionally, we further divided PD patients into PD patients with sleep disturbance and PD patients without sleep disturbance based on their PDSS-2 scores (Table 1). The redundant nature analysis results showed no significant audiovisual integration for either the PD with sleep disturbance or the PD without sleep disturbance groups (Figure 5). Furthermore, the one-sample t-test (two-tailed) found that there was no significant difference between PD patients with sleep disturbance and PD patients without sleep disturbance .

3.4. Correlation Analysis

Figure 6 shows the results of the correlation analysis. The results indicate that there was no significant relationship between H&Y stage and response facilitation either for the PD with sleep disturbance group or for the PD without sleep disturbance group , nor was there a significant relationship between disease duration and response facilitation for either the PD with sleep disturbance group or the PD without sleep disturbance group .

4. Discussion

In this study, we examined the audiovisual multisensory integration elicited by peripheral stimuli in PD. The results showed that no significant audiovisual integration occurred in PD regardless of the presence of cognitive deficits or sleep disturbance; however, such integration did occur in age-matched normal controls. In addition, there were no significant correlations between audiovisual facilitation and H&Y stage or disease duration.

4.1. Absent Audiovisual Integration in PD

Regarding the investigation of multisensory integration in PD, this is the first study to quantitatively examine audiovisual multisensory integration to stimuli presented peripherally to PD patients and to report that no significant audiovisual integration was observed. Consistent with the results of a previous study, audiovisual processing in PD was found to be abnormal [13]. To some degree, the current results lead to a conclusion similar to that expressed by Fearon et al. They found that audiovisual processing in PD was attenuated but did exist and further reported that it was correlated with freezing of gait and disease duration [13]. Investigation of visual processing by fMRI showed that in PD patients, the neural response of the visual cortex to peripheral stimuli was weaker than the response to central stimuli [37]. Consistent with the inverse effectiveness principle of multisensory integration, audiovisual integration was greater when the stimuli were positioned at more peripheral locations (0° versus 30° and 60°) [21]. Therefore, the partial differences between our results and those of the previous study might be associated with the visual angle at which the stimuli were presented. To date, although there is no evidence of pathology in the visual cortex of PD patients, the present studies have implied the dysfunction of visual perception, and reduced activity in visual association cortices and primary visual cortex was found in PD [38, 39]. The regions traditionally considered to be sensory-specific (e.g., the primary visual cortex) have been proven an audiovisual integration effect as compensatory phenomena [4043]. Therefore, it is reasonable for the abnormal audiovisual integration in PD patients.

Besides, recent studies have provided evidence that the subcortical basal ganglia have multisensory properties [17, 18]. Nagy et al. reported that the caudate nucleus and substantia nigra of anesthetized cats can respond to visual, auditory, or somatosensory stimulation alone as well to multisensory stimuli. In addition, the multisensory units of the caudate nucleus and substantia nigra showed significant cross-modal interaction, displaying additive or super-additive response facilitation to multisensory simulation. There is known to be a basal ganglia disorder in PD, as evidenced by cell death in the substantia nigra and the ventral (front) part of the pars compacta as well as substantial loss of dopaminergic neurons in the substantia nigra [24, 44, 45]. The higher audiovisual integration of peripheral stimuli might be susceptible to basal ganglia impairment; thus, it seems very possible that disorders of the basal ganglia may lead to the absence of audiovisual integration processing.

Additionally, attention can also greatly modulate audiovisual integration, and audiovisual integration has been shown to be greater in attended tasks than in unattended tasks [4650]. Numerous behavioral and electroencephalographic studies have provided evidence for the existence of attentional deficits, for example, visual attention and auditory attention, in PD [4954]. Therefore, the decrease in attention that occurs in PD might also contribute to the absence of audiovisual integration.

4.2. Absent Audiovisual Integration Independent of Cognitive Deficits and Sleep Disturbance in PD

In the present study, we examined 30 clinical PD patients who successfully completed the auditory/visual stimuli discrimination experiment independently without serious cognitive deficits or motor impairment. The demographic information showed lower MOCA scores for the PD patients than for their age-matched normal controls, and a further t-test (two-tailed) analysis revealed significant differences between the two groups. Our previous study showed decreased audiovisual integration both in divided attention and selective attention tasks for patients with mild cognitive impairment, and audiovisual integration further decreased significantly in Alzheimer’s disease patients [55]. These results suggested that the cognitive deficits that occur in PD might lead to abnormal audiovisual integration. According to their MOCA scores, we divided the PD patients into two groups (cutoff = 26). The analysis revealed that there was no significant difference in audiovisual integration between the two sub-PD groups (MOCA scores of ≥26 and <26). According to the results, we propose that although cognitive deficits attenuate audiovisual integration, as found in our previous study, basal ganglia disorders might be the most critical factor associated with the lack of audiovisual integration in PD patients. In our study, we also divided the normal control group into two subgroups according to their MOCA scores. In that group, there were only three participants with MOCA scores below 26 (two participants with scores of 25 and one with a score of 24), and these participants showed no significant cognitive impairment. Although the data for normal control participants with MOCA scores below 26 are insufficient for statistical analysis, the average probability difference curve of these participants is similar to that of the group with MOCA scores of 26 or greater. This result further suggests that audiovisual multisensory integration is much more sensitive to the basal ganglia disorder that occurs in PD than to slight alterations in cognitive function.

Additionally, in the present study, we examined the audiovisual integration of peripheral stimuli in PD patients with or without sleep disturbance. According to the PDSS-2 scores, 14 PD patients (47%) had sleep disturbances; based on these scores, we divided all the participants into two groups: those with and those without sleep disturbances. However, we found no significant difference in multisensory audiovisual integration in the two subgroups. These results further suggest that audiovisual integration of peripheral stimuli might be especially sensitive to basal ganglia disorders and that sleep disturbance was not the key factor determining the lack of audiovisual integration in these patients.

To further investigate whether the ability to integrate peripheral audiovisual stimuli is reserved in the early stage of PD and disappears with the progression of the disease in the current study, we evaluated the correlation of H&Y stage and disease duration with audiovisual multisensory integration through relative unisensory response time facilitation. No significant relationship was found between the bimodal response facilitation and H&Y stage or disease duration (all ), regardless of the presence of sleep disturbance. The results confirm that the abnormal audiovisual multisensory processing occurred at an early PD stage. Together with the results of the previous study, these results further suggest that deficiencies in audiovisual multisensory processing might be a potential early manifestation of PD [13].

4.3. Limitations

The main limitation of the current study is the systemic alteration of audiovisual integration that occurred as a function of the change in the visual angle at which the stimuli are presented. The lack of objective assessments for the sleep status, such as polysomnography or actigraphy, and the limited battery (MOCA) used in this study could have influenced the results. The multiple comparisons employed in this study were not corrected because our study was exploratory in nature, which may have included some significant findings by chance. Additionally, as the sample was relatively small, we were unable to divide the PD patients according to motor symptoms and Levodopa equivalent dose in detail. Furthermore, EEG investigation is needed to evaluate the time course of audiovisual integration in PD to further verify whether the observed lack of audiovisual integration of peripheral stimuli occurs at the early stage of audiovisual integration.

5. Conclusions

The current study provides the first evidence that the audiovisual multisensory integration of peripheral stimuli is absent in PD patients regardless of the presence of sleep disturbances. The results of the study further suggest that abnormal audiovisual integration may be a potential early manifestation of PD.

Disclosure

Yanna Ren and Keisuke Suzuki contributed equally to this work and should be considered co-first authors.

Conflicts of Interest

All of the authors declare that they have no potential conflicts of interest to disclose.

Authors’ Contributions

Yanna Ren and Weiping Yang conceived and designed the experiments. Yanna Ren, Fengxia Wu, and Keisuke Suzuki collected the data. Yanna Ren analyzed the data, wrote the draft manuscript, and received comments from Keisuke Suzuki, Yanling Ren, Jiajia Yang, Satoshi Takahashi, Yoshimichi Ejima, Jinglong Wu, and Koichi Hirata.

Acknowledgments

This study was supported by the Japan Society for the Promotion of Science (JSPS) KAKENHI Grant no. 16K18052; the National Natural Science Foundation of China (61473043; 61727807; 31600882; 31700973); the Beijing Municipal Science and Technology Commission (Z161100002616020); the Humanity and Social Science Youth Foundation of the Education Bureau of Hubei Province of China (16Q030, Weiping Yang); and the Humanity and Social Science Youth Foundation of the Ministry of Education of China (16YJC190025).