Research Article | Open Access
The Vocal Extent Measure: Development of a Novel Parameter in Voice Diagnostics and Initial Clinical Experience
Voice range profile (VRP) and evaluation using the dysphonia severity index (DSI) represent essentials of instrument-based objective voice diagnostics and are implemented in different standardized registration programs. The respective measurement results, however, show differences. The aim of the study was to prove these differences statistically and to develop a new parameter, the Vocal Extent Measure (VEM), which is not influenced by the measurement program. VRPs of 97 subjects were recorded by two examiners using the established registration programs DiVAS (XION medical) and LingWAVES (WEVOSYS) simultaneously. The VEM was developed on the basis of VRP area and perimeter. All 194 VRP files were analyzed for various parameters and gender independence. The registration programs exhibited significant differences in several vocal parameters. A significant gender influence for DSI was found with DiVAS (), but not with LingWAVES. The VEM quantified the dynamic performance and frequency range by a unidimensional, interval-scaled value without unit, mostly between 0 and 120. This novel parameter represents an intelligible and user-friendly positive measure of vocal function, allows simple and stable VRP description, and seems to be suitable for quantification of vocal capacity. In contrast to DSI, the VEM proved to be less susceptible to registration program and gender.
A comprehensive evaluation of the quality and capability of the human speaking and singing voice is difficult due to its multidimensional nature and several influencing factors including subjective esthetic aspects and distracting semantic or nonsemantic information [1–3]. Sound production within the voice box is a highly complex phenomenon whose oscillating and muscular mechanisms can be investigated and visualized at the glottal level [4–6]. However, various other regions of the human body and further essential elements are known to have a relevant impact on vocal performance, amongst others: (1) breathing-related issues for generation of the airflow and sufficient subglottal pressure for vocal fold vibrations [7–9], (2) training-induced optimized utilization of physiologically and anatomically given conditions for resonance processes, sound amplification, and refinement in the vocal tract [10–12], (3) peripheral and central hearing function, perception, and neurological mechanisms of vocal control including auditory and kinesthetic feedback [13–17], (4) presence of psychologically influencing factors, stressful conditions, and current mental and emotional state [18–20], and (5) physical fitness and constitution including effects of body tension, posture, movements, and physical load during phonation [21–24]. Resulting from all that, since voice quality is not clearly defined and a multidimensional perceived construct, several measurements are recommended for the current state-of-the-art evaluation of vocal function [2, 25]. These measurements comprise subjective procedures such as auditory-perceptual judgment  and patients’ self-assessment of voice , as well as objective procedures such as frequency-dependent measurements of the sound pressure level (voice range profile [VRP] measurement), acoustic-aerodynamic analysis, and videolaryngostroboscopy.
In objective voice diagnostics, specific algorithms are applied to quantify certain aspects of a correlate of voice production. By measuring a series of spoken words and singing tones at the softest and the loudest phonation possible, the resulting speaking-voice and singing-voice profiles yield a quick and clear mapping of the vocal capacity (“audiogram” of the voice). The standardized VRP and the data thereby ascertained in order to calculate the established dysphonia severity index (DSI) are core elements in instrument-based phoniatric assessment [28, 29]. Computer-assisted application of the lowest intensity, the highest tone, the maximum phonation time, and jitter is implemented in different standardized registration programs such as DiVAS (XION medical, Berlin, Germany) and LingWAVES (WEVOSYS, Forchheim, Germany). Though both programs represent modern, reliable, and internationally acknowledged systems for speech and voice assessment, the measurement results of both programs reveal differences in clinical practice. Therefore, one objective of this study was to clarify whether these differences could be verified statistically. In addition, our aim was to develop a new parameter which is less influenced by the registration programs. Since the established DSI quantifies dysphonia as a negative criterion and involves the risk of inaccurate results due to its multidimensional acquisition, our intention was to create and present a one-dimensional, intelligible, and user-friendly positive measure of vocal range. This novel parameter, the Vocal Extent Measure (VEM), was designed for objective VRP evaluation and quantification of vocal performance.
2. Materials and Methods
All VRPs were recorded in the sound-treated voice lab of our department with a background noise < 40 dB(A) in accordance with the recommendations of the European Laryngological Society [25, 30]. The measured values were documented in a coordinate system (see Figure 1, left) where the abscissa displays the fundamental frequency in Hz and the musical pitch notation (36 mm for one octave) and the ordinate shows the sound pressure level (SPL; 15 mm for 10 dB). The abscissa is scaled to semitones to ensure a comparable evaluation of male, female, and children’s voices with different VRPs. The measurements started with the assessment of speaking-voice profiles (green crosses or curve-shaped presentation). Participants had to speak number series (from 21 upwards, in German) at different vocal intensity levels. After unstressed phonation at indifferent pitch using the lowest volume possible, the schedule of increments comprised the normal “narrator voice” (fist level of increase) and the “lecture voice” (second level of increase) up to the loudest speaking volume (“calling voice”). Subsequently, singing-voice profiles were recorded over the whole vocal pitch range, each as softly (blue dots/curve) and after that as loud as possible (black dots/curve). For both settings, participants began at their middle pitch and went down to the lower limit of their vocal range and thereafter up to the high-level peak pitches. For the loudest-sung tones, the SPL was simultaneously recorded in the spectral range of 2–4 kHz, displaying the special energy components of the singer’s formant level (red dots/curve).
The new objective VEM parameter was to be calculated on the basis of the area and the perimeter of the VRP, displayed by the curves for the softest and the loudest singing (Figure 1, middle). Missing values between the lowest and highest tones of the soft and loud singing curve were linearly interpolated, resulting in a closed polygon (Figure 1, right). The fundamental idea was that an ideal VRP shape should not show abrupt differences in the dynamic range of notes produced by the patients along their frequency range. A well-balanced dynamic extent approximates the shape of VRP to a circle, in which, compared to other geometric figures, the area is biggest for a given perimeter. The dynamic range is evenly distributed over the tonal extent in this ideal conception. Each deviation from the circular shape indicates a decrease of vocal performance. Hence, the VEM multiplies the VRP area by the quotient of the measured perimeter of the profile and the theoretical perimeter of a circle with the same area as the profile itself. The construction and mathematical derivation of the VEM measure comprises the following equations and calculations.
The area () of a circle is defined as The perimeter () of a circle is defined as Thus, the perimeter of a circle with a known area is described as The VEM is the product of the VRP area and the quotient of the actual VRP circumference and the perimeter of a circle with the VRP surface area: However, the resulting exponential characteristic is unfavorable for correlations with linear variables. Simple logarithmical conversion yields unpractical small values. Therefore, a coefficient and a subtrahend have been added finally: Calculation of the VEM was done after VRP measurement by a proprietary software program (AVA) which can extract various other parameters from the VRP, thereby enabling VRP comparisons .
After development of the VEM measure, its initial clinical application was investigated by VRP comparison registered with two different programs for objective voice diagnostics. The VRPs of 97 subjects were recorded simultaneously by two experienced examiners under practically identical conditions. One examiner used the DiVAS program (XION medical, Berlin, Germany) and the other the LingWAVES program (WEVOSYS, Forchheim, Germany). The external microphones of both systems measured the speaking and singing voice in real time under defined and reproducible conditions. The XION headset guaranteed a fixed position of the electret microphone with a distance from the lips of 30 cm. An integrated electronic circuitry calibrated the microphone connection automatically. A USB plug connected the microphone headset to the computer without requiring further adjustments for the acoustic recordings. The WEVOSYS hardware (IEC 651 Type 2, ANSI S1.4 Type 2) was placed at the same distance from the lips. The SPL meter used in this system represents a high-quality microphone, which was connected to the computer through a free USB port and automatically configured by the software.
All patients were consecutively presenting at the outpatient clinic of our phoniatric department. The measurement of their vocal capacity was part of a routine appointment. Besides the VRP measurements and VEM calculations, the voices of all participants were categorized according to the RBH system, where the perceived patient’s roughness (R), breathiness (B), and overall hoarseness (H) have to be scored on a scale from 0 to 3 (0 = not existing, 1 = mild, 2 = moderate, and 3 = severe). The RBH-status was detected on the basis of the standardized text “the north wind and the sun” (German version). In addition, digital videolaryngostroboscopy was carried out for classification of laryngeal findings  using a high-resolution rigid videolaryngoscope with integrated microphone connected to the Endo-STROB control unit (XION medical, Berlin, Germany).
All resulting 194 VRP files were put through standardized evaluation by a software program which registered the new parameter VEM as well as the established DSI, the maximum phonation time (MPT), jitter (in %), the highest tone (), the lowest tone (), frequency range (), the lowest intensity (), the highest intensity (), dynamic range (), mean dynamic range per semitone (), area of the VRP (), and perimeter of VRP (). These parameters were compared with each other, correlated with the subjective hoarseness (H) assessment according to the RBH scale, and examined for gender-specific differences. Statistical methods used were the single factor analysis of variance (ANOVA), the -test for independent and paired samples, and the calculation of Pearson’s and Spearman’s correlation coefficients () for interval or ordinal scaled values.
The study cohort () included 65 female and 32 male subjects. Their age ranged between 12 and 75 years (44 ± 17 years [mean ± SD]). Videolaryngostroboscopy revealed in 61 patients various organic diseases at vocal fold level. Classification of the resulting organic dysphonia according to the underlying pathology revealed in 24 patients (39%) diseases of the lamina propria (e.g., nodules, polyps, cysts, and oedema), in 21 patients (35%) movement disorders (e.g., vocal fold paralysis), in 10 patients (16%) diseases of the epithelium (e.g., leukoplakia, hyperkeratosis, carcinoma (in situ), and papillomatosis), and in 6 patients (10%) arytenoid pathologies (e.g., granuloma). Thirty-six participants had a normal laryngeal anatomy, 29 of whom suffered from a vocal load induced functional dysphonia, while 7 subjects had normal voices without any complaints. Altogether, 38 subjects had no hoarseness (H0), including 7 healthy participants, 29 patients with functional dysphonia, and 2 patients with organic findings distant from the vocal fold level (small arytenoid granuloma). Forty-three individuals used their voice in a nonprofessional manner (e.g., business (wo)men, clerks, and laborers), whereas 54 patients had a high vocal strain in their profession (e.g., teachers, lecturers, actors, and singers). Subjects of both sexes were comparable in terms of age, level of hoarseness (H), underlying pathologies, and sociodemographic characteristics (see Table 1 for details).
As planned, the VRP measurements were successfully executed in all study participants with both registration programs simultaneously, altogether resulting in 194 VRPs (97 DiVAS and 97 LingWAVES). Hence, for each subject, there were 2 VRPs available for further analysis. The AVA software realized calculation of the new parameter VEM in all cases without any additional effort or loss of time. The VEM quantified the patient’s dynamic performance and frequency range by a unidimensional, interval-scaled value without unit in the range between about −150 and +150, mostly between 0 and 120. A large VRP with high vocal capacity was characterized by a high VEM value; conversely, a small VRP resulted in a small VEM.
The comparison of the recordings with the LingWAVES and DiVAS program revealed diverging results for the different parameters investigated (Table 2). From all registered parameters, only MPT was exactly identical in both programs. For VEM, DSI, and , no significant differences were found (). However, the values for jitter and () as well as the frequency range () differed significantly. All other parameters examined showed a highly significant difference ().
: area of the VRP; DSI: dysphonia severity index; : the highest tone; : the lowest tone; : frequency range, : the lowest intensity; : the highest intensity; : dynamic range; : mean dynamic range per semitone; MPT: maximum phonation time; NS: not significant; : perimeter of VRP; ST: semitones; VEM: vocal extent measure; VRP: voice range profile; at ; at ; and at .
The direct program comparison for selected parameters including Spearman’s correlations with the degree of hoarseness (H) is graphically displayed in Figure 2. The VEM and H correlated highly significantly () at an average of (DiVAS ; LingWAVES ). Likewise, the DSI correlated highly significantly with H at an average of (DiVAS ; LingWAVES ). Concerning the total study group, DSI and VEM registration with DiVAS offered higher mean values compared to LingWAVES (3.4 versus 3.2; 77 versus 72). This was also true for the subgroups with the hoarseness levels H1 (2.9 versus 2.5; 72 versus 68), H2 (0.4 versus −1.2; 40 versus 36), and H3 (−2.1 versus −5.8; −12 versus −16). For the H0 patient group without hoarseness, DSI and VEM registration with DiVAS versus LingWAVES showed divergent results (5.8 versus 6.7; 116 versus 112). However, within both registration programs, the mean DSI and VEM values for the hoarseness levels H0, H1, H2, and H3 differed significantly from each other ().
Figure 3 illustrates for both parameters the distribution of values between LingWAVES and DiVAS and within each registration program. Pearson’s correlation of VEM between LingWAVES and DiVAS () was approximately equal to the correlation of DSI between both programs (). VEM and DSI correlated also with each other highly significantly () at an average of (DiVAS) and (LingWAVES).
Gender-specific differences proved highly significant () with LingWAVES for the parameters , , and frequency range (). An influence of gender on the parameters VEM, DSI, , , and mean dynamic range per semitone () was not detectable (). A highly significant gender influence on the parameters , , and was also found with the DiVAS program (). The influence on the DSI proved to be very significant () in contrast to LingWAVES. Gender showed no influence () on the parameters VEM, , , and . With neither program any significant gender influence on other parameters was found, including MPT (). Regarding comparison of vocal performance, the VEM values described the VRP in both genders better than the established DSI. Figure 4 shows the measurements of a female and a male singer, which were simultaneously recorded with both registration programs. Both subjects had a comparable DSI, but different VRPs and vocal capacities. This example indicates, in contrast to the VEM, the significant influence of the recorded acoustic and aerodynamic parameters on the multidimensional DSI calculation. It illustrates also the differing intention of both parameters, which obviously represent different aspects of vocal function.
In the group of subjects examined, the comparison of the standardized registration programs DiVAS and LingWAVES confirmed the assumed differences of acoustic measurement results in clinical practice. The influence of the software used in computer-assisted phoniatric examination cannot be disregarded, as is clear from the significant differences of simultaneously recorded measurement data from both programs processing identical signals. In spite of these differences, our findings endorse the literature results which prove high reliability and reproducibility of VRP measurements, and thus clinical usefulness [33, 34].
Concerning the established DSI, it is described as a reliable and suitable parameter to measure the severity of dysphonia [35–37]. Our study supports the general opinion that the DSI represents a robust instrument which is useful for dysphonia quantification. It is calculated as a weighted combination of the highest possible frequency (), the lowest intensity (), MPT, and jitter . Although our data proved that these components, apart from the MPT, are highly dependent on the registration program, the DSI did not show any significant differences when another software was used. Obviously, compensation arises from the multidimensional orientation of the different elements involved in the calculation of this parameter. Nevertheless, it must be noted that the DSI is able to supplement but not to replace the subjective voice assessment, since our data revealed only a moderate negative correlation with the degree of hoarseness (). Besides, previous studies indicated that the DSI is influenced not only by differences of measurements due to the registration programs, but also by age and gender [38–40]. Our results confirmed these findings, as in the present group of subjects some gender influence was detected for the DSI with the DiVAS program. To improve the quality of voice diagnostics, we saw the need to develop and investigate the VEM as an objective parameter unimpaired by these confounding factors.
Comprehensive medical voice diagnostics involves various subjective and objective instruments [25, 28, 30]. The pool of objective parameters has the potential of continuous enhancement and development of new devices, due to the advances in measurement technology, modeling, and digital signal processing [41–44]. The aim of this process is to improve, objectify, and standardize the measurements as well as the documentation of vocal function and diagnosis. However, each new parameter has to be investigated critically regarding its new value and necessity. The VEM was developed as a unidimensional score which represents a quantitative correlate of the individual vocal performance. Neither the pure tonal range nor the dynamic range may be suitable to document vocal capability. Therefore, the VEM uses the VRP area as a better correlate for quantification, though the area displays an inaccurate impression of the actual usable voice performance. For example, singers with a large VRP but tight restrictions in their dynamic range on single tones may not be able to use their whole frequency range artistically. For that reason, the VRP perimeter was also incorporated into the calculation of this new parameter. The outcome is a value which registers the subject’s dynamic capacity and frequency range, also considering the uniformity of dynamic progression of the VRP limits (i.e., the curves for the softest and loudest singing) as a qualitative vocal characteristic. As described above in detail, the resulting new parameter was constructed as VEM ≈ area (VRP)/rel.perimeter (VRP). Thus, the VEM calculation is not influenced by measurements which are likely to be influenced by age or gender [45, 46]. Elements which are highly susceptible to interference (e.g., jitter) are not considered. The VEM is also independent of the pitch (i.e., women’s and men’s voices are evaluated in the same way) and the vocal intensity (i.e., microphone distance has no influence on the assessment of the VRP).
According to our results, the VEM provided a useful representation of the recorded VRP and enabled more advanced portability between different systems than VRP data alone. Although a few subjects revealed considerable program-related differences in the VRP recordings, the VEM can be used reliably to document vocal capacity. It is less influenced by differences in measurements and therefore delivers the same results for equivalent vocal performance using different systems. A large total intensity range and a large total fundamental frequency range resulted in a high VEM score. Conversely, a small VRP led to a small VEM. The VEM was scaled in the majority of subjects from 0 to 120; however, it was indeed possible to exceed these boundaries at both ends. Further studies including more severely impaired and exceptionally great voices must show the amount of values in the higher positive and negative range.
Regarding the limitations of our investigation, some characteristics of the study design and methodology have to be taken into account. Firstly, the sample size was too small to ensure a representative distribution of the population, to examine comparably sized hoarseness subgroups, or to be considered representative for diagnosis-related groups of patients to whom the results could be generalized or transferred. Secondly, some general and well-known factors influencing the VRP registration have to be discussed critically, for example, dependence on the experience and routine of the examiner, motivation and musicality of the subject investigated, and the absence of generally accepted specifications regarding the quantity of sung and registered tones. Furthermore, the size of the recorded tone intervals influences the VRP circumference. For example, larger intervals can hide register changes with reduced vocal capability and thus wrongly increase the VRP. Most of these error sources can be neglected in our study, because all VRPs were recorded simultaneously by two equivalently experienced examiners under practically identical conditions.
Our results also demonstrated a different orientation of the VEM compared to the DSI. Whereas the DSI describes the severity of a dysphonia, the VEM represents vocal capacity. Thus, the VEM is also suitable for the documentation of increases in vocal performance in normal and trained voices. This enables a classification of the voice in a positive sense according to performance capacity, instead of emphasizing dysphonia as a negative criterion. In this way, the VEM augments comprehensive voice diagnostics and documentation. Future studies with larger samples of participants are necessary to explore and define intervals relating to the degrees of hoarseness and vocal capacity and thus classify the VEM values.
The new VEM represents a useful, intelligible, and user-friendly positive measure of vocal function. It is calculated automatically from the VRP and may be easily implemented into existing clinical protocols. This novel parameter quantifies the VRP unidimensionally by a single concrete score, instead of estimating it by means of visual perception and a few exposed values. In contrast to DSI, the VEM proved to be less susceptible to registration program and gender. The VEM allows simple and stable VRP description and seems to be suitable for the quantification of vocal capacity. This new parameter of vocal performance provides additional information about voice function. Therefore, VEM introduction in practical objective voice diagnostics is appropriate and desirable, complementing the established DSI.
Conflicts of Interest
The authors have no funding, financial relationships, or conflicts of interest to disclose.
- M. Babel, G. McGuire, and J. King, “Towards a more nuanced view of vocal attractiveness,” PLoS ONE, vol. 9, no. 2, Article ID e88616, 2014.
- B. Barsties and M. De Bodt, “Assessment of voice quality: current state-of-the-art,” Auris Nasus Larynx, vol. 42, no. 3, pp. 183–188, 2015.
- S. M. Hughes and M. A. Harrison, “I like my voice better: self-enhancement bias in perceptions of voice attractiveness,” Perception, vol. 42, no. 9, pp. 941–949, 2013.
- P. P. Caffier, B. Schmidt, M. Gross et al., “A comparison of white light laryngostroboscopy versus autofluorescence endoscopy in the evaluation of vocal fold pathology,” The Laryngoscope, vol. 123, no. 7, pp. 1729–1734, 2013.
- K. A. Kochis-Jennings, E. M. Finnegan, H. T. Hoffman, S. Jaiswal, and D. Hull, “Cricothyroid muscle and thyroarytenoid muscle dominance in vocal register control: preliminary results,” Journal of Voice, vol. 28, no. 5, pp. 652–652.e29, 2014.
- D. H. Tsuji, A. Hachiya, M. E. Dajer, C. C. Ishikawa, M. T. Takahashi, and A. N. Montagnoli, “Improvement of vocal pathologies diagnosis using high-speed videolaryngoscopy,” International Archives of Otorhinolaryngology, vol. 18, no. 3, pp. 294–302, 2014.
- D. K. Chhetri and S. J. Park, “Interactions of subglottal pressure and neuromuscular activation on fundamental frequency and intensity,” The Laryngoscope, vol. 126, no. 5, pp. 1123–1130, 2016.
- A. Irzaldy, S. I. Wiyasihati, and B. Purwanto, “Lung vital capacity of choir singers and nonsingers: a comparative study,” Journal of Voice, vol. 30, no. 6, pp. 717–720, 2016.
- Z. Zhang, “Regulation of glottal closure and airflow in a three-dimensional phonation model: implications for vocal intensity control,” The Journal of the Acoustical Society of America, vol. 137, no. 2, pp. 898–910, 2015.
- B. Delvaux, D. Howard, and D. A. Robin, “A new method to explore the spectral impact of the piriform fossae on the singing voice: benchmarking using MRI-based 3D-printed vocal tracts,” PLoS ONE, vol. 9, no. 7, Article ID e102680, 2014.
- A. Mainka, A. Poznyakovskiy, I. Platzek, M. Fleischer, J. Sundberg, and D. Mürbe, “Lower vocal tract morphologic adjustments are relevant for voice timbre in singing,” PLoS ONE, vol. 10, no. 7, Article ID e0132241, 2015.
- R. R. Vos, H. Daffern, and D. M. Howard, “Resonance tuning in three girl choristers,” Journal of Voice, vol. 31, no. 1, pp. 122.e1–122.e7, 2017.
- R. Behroozmand, X. Oya, K. V. Nourski et al., “Neural correlates of vocal production and motor control in human heschl’s gyrus,” The Journal of Neuroscience, vol. 36, no. 7, pp. 2302–2315, 2016.
- O. Korzyukov, L. Sattler, R. Behroozmand, and C. R. Larson, “Neuronal mechanisms of voice control are affected by implicit expectancy of externally triggered perturbations in auditory feedback,” PLoS ONE, vol. 7, no. 7, Article ID e41216, 2012.
- M. A. Selleck and R. T. Sataloff, “The impact of the auditory system on phonation: a review,” Journal of Voice, vol. 28, no. 6, pp. 688–693, 2014.
- J. M. Zarate, “The neural control of singing,” Frontiers in Human Neuroscience, vol. 7, article 237, 2013.
- B. Kleber, A. G. Zeitouni, A. Friberg, and R. J. Zatorre, “Experience-dependent modulation of feedback integration during singing: role of the right anterior insula,” The Journal of Neuroscience, vol. 33, no. 14, pp. 6070–6080, 2013.
- C. Dromey, S. O. Holmes, J. A. Hopkin, and K. Tanner, “The effects of emotional expression on vibrato,” Journal of Voice, vol. 29, no. 2, pp. 170–181, 2015.
- P. Larrouy-Maestri and D. Morsomme, “The effects of stress on singing voice accuracy,” Journal of Voice, vol. 28, no. 1, pp. 52–58, 2014.
- K. Pisanski, V. Cartei, C. McGettigan, J. Raine, and D. Reby, “Voice modulation: a window into the origins of human vocal control?” Trends in Cognitive Sciences, vol. 20, no. 4, pp. 304–318, 2016.
- K. M. Davis, M. J. Sandage, L. Plexico, and D. D. Pascoe, “The perception of benefit of vocalization on sport performance when producing maximum effort,” Journal of Voice, vol. 30, no. 5, pp. 639–639.e16, 2016.
- S. M. Khoddami, N. N. Ansari, F. Izadi, and S. T. Moghadam, “The assessment methods of laryngeal muscle activity in muscle tension Dysphonia: a review,” The Scientific World Journal, vol. 2013, Article ID 507397, 6 pages, 2013.
- P. G. C. Kooijman, F. I. C. R. S. De Jong, M. J. Oudes, W. Huinck, H. Van Acht, and K. Graamans, “Muscular tension and body posture in relation to voice handicap and voice quality in teachers with persistent voice complaints,” Folia Phoniatrica et Logopaedica, vol. 57, no. 3, pp. 134–147, 2005.
- L. Traser, M. Burdumy, B. Richter, M. Vicari, and M. Echternach, “Weight-bearing MR imaging as an option in the study of gravitational effects on the vocal tract of untrained subjects in singing phonation,” PLoS ONE, vol. 9, no. 11, Article ID e112405, 2014.
- P. H. Dejonckere, P. Bradley, P. Clemente et al., “A basic protocol for functional assessment of voice pathology, especially for investigating the efficacy of (phonosurgical) treatments and evaluating new assessment techniques: guideline elaborated by the Committee on Phoniatrics of the European Laryngological Society (ELS),” European Archives of Oto-Rhino-Laryngology, vol. 258, no. 2, pp. 77–82, 2001.
- M. Ptok, C. Schwemmle, C. Iven, M. Jessen, and T. Nawka, “Zur auditiven Bewertung der Stimmqualität,” HNO, vol. 54, no. 10, pp. 793–802, 2006.
- T. Nawka, I. M. Verdonck-De Leeuw, M. De Bodt et al., “Item reduction of the voice handicap index based on the original version and on european translations,” Folia Phoniatrica et Logopaedica, vol. 61, no. 1, pp. 37–48, 2009.
- W. Seidner and T. Nawka, Aids to voice diagnostics, Xion, Berlin, Germany, 2014.
- F. L. Wuyts, M. S. De Bodt, G. Molenberghs et al., “The dysphonia severity index: an objective measure of vocal quality based on a multiparameter approach,” Journal of Speech, Language, and Hearing Research, vol. 43, no. 3, pp. 796–809, 2000.
- P. H. Dejonckere, “Assessment of voice and respiratory function,” in Surgery of Larynx and Trachea, M. Remacle and H. E. Eckel, Eds., Springer-Verlag, Berlin, Germany, 2010.
- P. Caffier and A. Möller, “The Vocal Extent Measure (VEM) as Novel Parameter in Objective Voice Diagnostics,” Sprache Stimme Gehör, vol. 40, no. 04, pp. 183–187, 2016.
- C. A. Rosen and T. Murry, “Nomenclature of voice disorders and vocal pathology,” Otolaryngologic Clinics of North America, vol. 33, no. 5, pp. 1035–1045, 2000.
- T. Printz, T. Rosenberg, C. Godballe, A.-K. Dyrvig, and Å. M. Grøntved, “Reproducibility of automated voice range profiles, a systematic literature review,” Journal of Voice, 2017.
- T. Printz, J. R. Sorensen, C. Godballe, and Å. M. Grøntved, “Test-retest reliability of the dual-microphone voice range profile,” Journal of Voice, 2017.
- M. M. Hakkesteegt, M. H. Wieringa, M. P. Brocaar, P. G. H. Mulder, and L. Feenstra, “The interobserver and test-retest variability of the dysphonia severity index,” Folia Phoniatrica et Logopaedica, vol. 60, no. 2, pp. 86–90, 2008.
- M. M. Hakkesteegt, M. P. Brocaar, and M. H. Wieringa, “The applicability of the dysphonia severity index and the voice handicap index in evaluating effects of voice therapy and phonosurgery,” Journal of Voice, vol. 24, no. 2, pp. 199–205, 2010.
- B. Pullens, M. Hakkesteegt, H. Hoeve, M. Timmerman, and K. Joosten, “Voice outcome and voice-related quality of life after surgery for pediatric laryngotracheal stenosis,” The Laryngoscope, vol. 127, no. 7, pp. 1707–1711, 2017.
- P. Aichinger, F. Feichter, B. Aichstill, W. Bigenzahn, and B. Schneider-Stickler, “Inter-device reliability of DSI measurement,” Logopedics Phoniatrics Vocology, vol. 37, no. 4, pp. 167–173, 2012.
- M. M. Hakkesteegt, M. P. Brocaar, M. H. Wieringa, and L. Feenstra, “Influence of age and gender on the dysphonia severity index: a study of normative values,” Folia Phoniatrica et Logopaedica, vol. 58, no. 4, pp. 264–273, 2006.
- Y. Maryn, D. Morsomme, and M. De Bodt, “Measuring the Dysphonia Severity Index (DSI) in the program praat,” Journal of Voice, vol. 31, no. 5, pp. 644–644.e40, 2017.
- J.-H. Chang and C.-H. Jeong, “A measure based on beamforming power for evaluation of sound field reproduction performance,” Applied Sciences, vol. 7, no. 3, article no. 249, 2017.
- A. Granados and J. Brunskog, “An optical flow-based state-space model of the vocal folds,” The Journal of the Acoustical Society of America, vol. 141, no. 6, Article ID 4983628, 2017.
- R. E. Christiansen and E. Fernandez-Grande, “Design of passive directional acoustic devices using Topology Optimization - from method to experimental validation,” The Journal of the Acoustical Society of America, vol. 140, no. 5, pp. 3862–3873, 2016.
- E. C. Mediante, J. S. Jensen, J. Brunskog, and M. Larsen, “A multi-model reduction technique for optimization of coupled structural-acoustic problems,” in Proceedings of the Inter-Noise, W. Kropp, Ed., Deutsche Gesellschaft für Akustik, Berlin, Germany, 2016.
- A. Dehqan, R. C. Scherer, G. Dashti, A. Ansari-Moghaddam, and S. Fanaie, “The effects of aging on acoustic parameters of voice,” Folia Phoniatrica et Logopaedica, vol. 64, no. 6, pp. 265–270, 2012.
- H. Goy, D. N. Fernandes, M. K. Pichora-Fuller, and P. Van Lieshout, “Normative voice data for younger and older adults,” Journal of Voice, vol. 27, no. 5, pp. 545–555, 2013.
Copyright © 2018 Philipp P. Caffier et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.