Development of the 8-Item Phlegm Pattern Questionnaire (PPQ-8) Using Rasch Analysis

Park, Young-Jae

doi:https://doi.org/10.1155/2021/6528891

Evidence-Based Complementary and Alternative Medicine

On this page

Abstract Introduction Methods Results Discussion Limitations Conclusion Data Availability Conflicts of Interest References Copyright Related Articles

Research Article | Open Access

Volume 2021 | Article ID 6528891 | https://doi.org/10.1155/2021/6528891

Development of the 8-Item Phlegm Pattern Questionnaire (PPQ-8) Using Rasch Analysis

Young-Jae Park^1,2

Academic Editor: Mohammad Hashem Hashempur

Received03 Jul 2021

Revised04 Sept 2021

Accepted05 Oct 2021

Published28 Oct 2021

Abstract

The 25-item Phlegm Pattern Questionnaire (PPQ) has been widely used to examine the relationship between the phlegm pattern (PP), quality of life, tongue colour, vocal qualities, and dysfunctional breathing. However, the concerns of response burden and differences in the respondent’s abilities or item difficulty for the original version of the PPQ have not been sufficiently addressed. This study aimed to develop a short-form PPQ using Rasch analysis, an item response theory. Based on the retrospective data, the response order, differential item functioning (DIF), dimensionality, reliability, concurrent validity, and fitting errors were examined for 291 normal participants and 61 inpatients. The discriminative ability of the short-form PPQ was examined using receiver operating characteristic curve analysis. Along with Rasch analysis, another short-form PPQ was developed using equidiscriminative item-total correlation (EITC) analysis and the results between the two short-form PPQs were compared accordingly. Rasch analysis results suggested a 6-point response category for the PPQ, and finally, 8 items without fitting errors or DIF variability were selected for the PPQ (PPQ-8). The PPQ-8 had satisfactory reliability (person separation index = 2.23), unidimensionality (unexplained variance in the first contrast = 1.598), fitting levels (infit mean square, 0.80–1.39; outfit mean square, 0.79–1.34), sensitivity (70.5%), and specificity (76.5%). The PPQ-8 had a moderate discriminative ability of the PP (area under the curve = 0.759), and the cut-off point was 23. Although the 8-item PPQ developed using EITC analysis showed similar levels of reliability, validity, and discriminative ability of the PP to the PPQ-8, it could not present the information of item hierarchy and differences in the respondents’ abilities. In conclusion, the PPQ-8 by Rasch analysis is recommended for future use to evaluate the clinical severity of PP.

1. Introduction

According to the traditional Chinese medicine theory, a pathological pattern is a subcategory of a disease or disorder referring to a diagnostic conclusion based on the pathological changes at a certain stage of disease [1]. Pathological patterns are efficient in population health management [2, 3] and can be applied to guide the prevention, treatment, and rehabilitation of diseases [4]. Among the diverse pathological patterns, phlegm is a viscous, turbid pathological product that accumulates in the body and covers the areas where fluid or lymphatic circulation may be retarded [5]. Similar to traditional Chinese medicine, Korean medicine recognises that the accumulation of phlegm leads to nasal discharge or sputum and diverse neurological and gastrointestinal problems, including dizziness, palpitation, ingestion, and mucousy stool [6]. Interestingly, traditional Persian medicine has recognised that the balance among the “4 humours” (black bile, yellow bile, phlegm, and blood) in the human body sustains health preservation, while the lack of this balance results in diseases, especially the dystemperament state [7]. The presence of phlegm in the body can be diagnosed by examining the signs and symptoms in the patient’s clinical history [8]. Due to the wide spectrum of pathophysiology and high affinity towards other pathogenic factors, a Korean medical doctor must identify the presence of phlegm. A phlegm pattern (PP) is a pathological condition caused by phlegm [8]. A Phlegm Pattern Questionnaire (PPQ) was developed to quantitatively evaluate the clinical severity of PP [6]. A self-administered PPQ consists of 25 items, with each item rated on a 7-point Likert scale (1 = disagree very strongly and 7 = agree very strongly).

The PPQ was reported to have satisfactory reliability (Cronbach’s alpha coefficient = 0.902) and the moderate discriminative ability for PP (area under the curve (AUC) = 0.860) [6]. Since its development, PPQ has been utilised to evaluate the clinical severity of phlegm in diverse physiological or pathological conditions in the body. For example, increased clinical severity of PP, estimated by the PPQ scores, was associated with other pathological patterns, including increased clinical severity of yin deficiency manifesting with emaciation, tidal fever, night sweats, and increased clinical severity of qi deficiency manifesting as fatigue, shortness of breath, and indigestion [8], thereby causing a decline in the quality of life [9]. In a study on the relationship between quantitative tongue colour and pathological patterns, decreased yellow colour of the tongue tip was related to increased PPQ scores [10]. Furthermore, the vocal quality of normal subjects, especially decreased tremor-related parameters and increased resonance-related parameters, was found to be associated with increased PPQ scores [11]. Recently, a study reported higher PPQ scores in a dysfunctional breathing group than in a nondysfunctional breathing group, suggesting that the clinical severity of phlegm may be associated with the aggravation of dysfunctional breathing [12].

The length of the original version of a questionnaire often limits the extent to which it applies to patient care or research [13]. A large number of questionnaire items require excessive time for completion; in particular, the questionnaire length or the multipurpose battery of different questionnaires can affect patients with difficulty in handwriting or cognition [13]. Therefore, a demand to reduce the burden of response and a few methodologies to reduce the questionnaire items previously developed have been raised in the past. For example, Beaton et al. shortened the original version of the 30-item Disabilities of the Arm, Shoulder, and Hand Outcome Measure (DASH) and developed an 11-item QuickDASH [14]. Similarly, Badia et al. developed a 16-item Osteoporosis-Specific Quality of Life Questionnaire [15]. Furthermore, Kim suggested reducing the short-form health survey questionnaire (SF-36) to an 11-item questionnaire [16]. However, no study has addressed the item reduction of the 25-item PPQ. Therefore, this study aimed to develop a short form of the PPQ to reduce response burdens, such as answering time or difficulty in handwriting or cognition. One of the conventional statistical methods to reduce questionnaire items is to examine item-total correlations (ITCs) for each item [17]. Using ITCs, the top-ranked items can be retained, while lower-ranked items may be deleted accordingly. The equidiscriminative item-total correlations (EITCs) constitute a modified ITC method in which ITC analysis is repeated three times based on low, medium, and high score points. EITC has the advantage of distinguishing between respondents throughout the range of the total scores [14, 18]. However, the classical methodology has the limitation of not considering item hierarchy, that is, the characteristics of item response. Rasch analysis is an item response theory where each item response in the questionnaire is taken as an outcome of the independent interaction between the respondents’ abilities and item difficulty [19]. If the item the weightings are ordered based on their difficulty along a linear logistic function, multiple response options, that is, the Likert scale, may be acceptable [14]. Through the examination of response difficulty, the overlapping response category may be deleted or unified suitably, and the number of response categories can thus be reduced. Rasch analysis presents information on whether each item fits a linear function. Misfitting items derived from an acceptable fit level may be removed from the questionnaire [13]. Moreover, Rasch analysis presents the data of differential item functioning (DIF), which identifies items that do not function equally among different groups of respondents [20]. Through the DIF process, a questionnaire with reduced items may become robust, irrespective of group differences, such as gender or age. In summary, this study aimed to develop a short form of PPQ following EITC and Rasch analyses and to examine the discriminative power of PP using receiver operating characteristic (ROC) curve analysis.

2. Methods

2.1. Data Sources

The data used for analysis in this study were collected for the development of the PPQ [4]. The 25-item PPQ is shown in Table 1. The data used to develop the original version were completed by 291 normal participants consisting of 132 men (mean age, 39.81 ± 19.39 years) and 159 women (mean age, 43.61 ± 15.21 years), who consulted a clinician for a health consultation [6]. In a previous study [6], three clinicians blindly determined the presence or absence of PP in 61 inpatients, where they investigated the same patients successively at 10 minute intervals to minimise the interobserver variability, and the results of their decisions remained blinded. The final determination of PP was accepted only when at least two clinicians diagnosed an inpatient with PP. The PP data from the previous study were used to examine the discriminative ability of the short-form PPQ in this study through ROC curve analysis. To compare the internal consistency, validity, and discriminant power of the short-form questionnaire with the original version of the PPQ, the data of normal participants and inpatient groups in this study were considered equal to those of normal participants and inpatient groups in the previous study. The study protocol was approved by the Institutional Review Board of the Kyung Hee University Oriental Medical Hospital at Gangdong (IRB approval number: KHNMCOH 2021-02-001).

2.2. Rasch Analysis

A conventional questionnaire development assumes equal weighting for each item and uniform intervals between the responses for each item. However, these assumptions may not be true as the difficulty of items and the ability of the subjects to answer an item often vary. Therefore, in this study, the first step of Rasch analysis was to evaluate the weighting and difficulty of each item and rescale the 7-points Likert scale of the PPQ if there was any disordering of item responses. In the next step, the DIF, which emerges when the responses to an item function equally in different subgroups of participants for the 25-item PPQ, was evaluated. In most cases, external factors, including age and gender differences, result in DIF, and items affected by DIF would be deleted from the original version of the questionnaire [20, 21]. Rasch modelling assumes that items are weighted according to their difficulty along a linear logistic function. The mean square error (MnSq) is the chi-square statistic divided by the degrees of freedom [13]. If an item fits this linear function, the MnSq of the item ranges between 0.5 and 1.49 [22]. Therefore, in the third step of this modelling, the MnSq levels of the two fit indices, infit and outfit, were evaluated. Misfitting items were deleted, and iterations of fit evaluations were conducted until only fitting items remained [14]. Finally, the reduced items were checked for additional dimensionality. The determination of unidimensionality helped avoid scoring unrelated dimensions within the reduced items.

2.3. Equidiscriminative Item-Total Correlations

EITC, a modified ITC, is used for item reduction in a questionnaire [23]. While ITC focuses on the correlations between the scores of each item and the total scores of a questionnaire, EITC resets three cut-off points according to the three percentile levels of the total scores (25%, 50%, and 75%) and transforms the total scores for each individual into dichotomous values [18]. In this study, the values below and above the cut-off points of 25% were transformed to scores of 0 and 1, respectively, and dichotomous total scores were assigned to all participants. Similarly, other dichotomous total scores were determined according to cut-off points of 50% and 75%, respectively. Thereafter, correlations between the three sets of dichotomous value-transformed total scores and questionnaire item scores were examined, and the EITC for each item and the dichotomous value-transformed total scores were sequentially ranked according to the three percentile points. The weights of EITC did not differ between each percentile group, and items with the highest values were extracted from each subgroup by multiples of three. Therefore, the top three or four items were sequentially collected in the order of 25%, 50%, and 75% EITCs, and a total of 9 or 12 items were preliminarily determined as a short-form questionnaire [14]. If the same item was in the top four lists for both the 25% and 50% categories, it was dropped from the list of the 50% group, and the next ranked item from that group was substituted into the 50% list. Similarly, the item in the 75% list was dropped, and the next ranked item was substituted if it was both in the 50% and 75% ranks [14, 18]. The final determination of the item numbers obtained using EITC was matched with those obtained using Rasch analysis, according to a previous study [14].

2.4. Receiver Operating Characteristic Curve Analysis

A previous study defined an optimum cut-off point of 5 points on the 25-item PPQ and reported the AUC level of the PPQ, which is a discriminative PPQ power [6]. In this study, sensitivity, specificity, AUC levels, and cut-off points of the short-form questionnaire developed by EITC and Rasch analysis were calculated accordingly. Discriminative powers of the two short-form questionnaires were then separately compared with those of the 25-item PPQ.

3. Statistical Analysis

3.1. Rasch Analysis

Rasch analysis was conducted using the partial credit model as each item was answered in the form of a polytomous category, that is, a 7-point Likert scale [19]. The ordering of the item response was acceptable when the following conditions were satisfied: (1) total counting numbers of each response category ≥10, (2) ascending ordering of average measure and step calibration, and (3) outfit level of each category ≤2.0 [24]. If there was any violation among the item response category, the category was unified with an adjacent category, and the ordering of all categories was re-evaluated. Along with the numerical examination, the category probability curve was extracted and examined for the overlapping of a category curve peak with other curves [25]. An overlapped curve indicates a disordering of the response category. DIF was assessed for both sex and age. The median age of the participants was 46.0 years, and those over and below 46 years were assigned to the older and younger groups, respectively. Differences in logits between men and women and the older and younger groups were examined using the chi-square test and -values. Infit and outfit were assessed, and items with MnSq infit or outfit values <0.50 or >1.50 were removed, respectively [22]. Similar to ETIC, the dimensionality of the reduced items was assessed by principal component analysis. In Rasch analysis, unidimensionality was determined when the unexplained variance in the first contrast was under 2.0, where the number of the second factor may have consisted of only one item [26]. Reliability was examined using a person separation index, where values ≥ 2.0 were considered “acceptable” [27].

3.2. Equidiscriminative Item-Total Correlations

EITCs were calculated using Spearman’s rho correlation because of the dichotomous values for the total scores. The dimensionality of the reduced items was assessed using principal component analysis. In the EITC, the number of dimensions was examined with an eigenvalue of over 1 point. The concurrent validity of the two short-form questionnaires was examined using Pearson’s correlations between the total scores of the original version and the short-form PPQ by EITC. Internal consistency was examined using Cronbach’s alpha coefficient with values of ≥0.9, 0.7–0.9, and 0.6–0.7, which were considered excellent, good, and acceptable, respectively [28].

3.3. Receiver Operating Characteristic Curve Analyses

After examining the reliability, validity, and dimensionality of the two short-form questionnaires, ROC curve analyses of the EITC and Rasch modelling were conducted, where the total scores of the reduced EITC and Rasch items served as test variables, and the presence or absence of the PP, identified by three clinicians, served as a gold standard. The discriminative ability of the reduced questionnaire was evaluated using the AUC. As generally accepted, AUC with values > 0.9, 0.7–0.9, and 0.5–0.7 indicated high, moderate, and low accuracies, respectively [29]. An optimum cut-off point, the Youden index, was examined using two statistical values (Youden index = sensitivity + specificity – 1) [30] and the Euclidean distance from the left-top angle to the ROC curve, where the x-axis represents the 1-specificity value and the y-axis represents the sensitivity value (Euclidean distance = ) [31]. An optimum cut-off point corresponded to either the maximum Youden index or the minimum Euclidean distance. EITC and ROC curve analyses were performed using SPSS version 21 (IBM Corp., Armonk, NY, USA), and Rasch analysis was performed using Winsteps 4.8. Statistical significance was set at < 0.05.

4. Results

The category characteristics of the 25-item PPQ are summarised in Table 2. The original version of the PPQ was rated on a 7-point Likert scale (1 = disagree very strongly; 2 = disagree strongly; 3 = disagree; 4 = neither disagree nor agree; 5 = agree; 6 = agree strongly; 7 = agree very strongly), and whether the 7-point category responses were in an increasing order was examined accordingly. The total counting numbers of each category exceeded 10, and their outfit MnSq levels were below 2.0. However, the step calibration or threshold scale for category 4 (“neither agree nor disagree”) decreased more than that of category 3 (“disagree”), indicating that both categories 3 and 4 were disordered among the category responses. Figure 1(a) shows the probability curve of question 1 (“I have a cough”), according to the 7-point Likert scale, where the peak of category 3 overlapped with that of category 4, consistent with the results of step calibration. This peak overlapping of category 3 with category 4 for question 1 was similarly found for the other 24 question items. Therefore, categories 3 and 4 were unified, and a 6-point Likert scale was used for the Rasch analysis. The step calibration of the 6-point categories maintained an increasing order (Table 2). Figure 1(b) shows that the category curves were ordered correctly without overlapping of the peaks, although the peak of category 4 was barely exposed.

(a)

(b)

Table 3 lists the DIF results according to gender and age. The logit values for “cough (Q1),” “sputum (Q2),” “abdominal rumbling (Q8),” “mucousy stool (Q17),” and “itching (Q24)” in men were higher than those in women, while the logit values for “palpitation (Q14),” “startled by faint noise (Q15),” “joint pain (Q19),” “limb heaviness (Q20),” and “yellow face (Q23)” in women were higher than those in men. In age groups, the logit values for “sputum (Q2),” “feeling of foreign body (Q3),” “abdominal rumbling (Q8),” “sickness (Q9),” “headache (Q11),” and “dark circle (Q21)” were higher in the younger group than those in the older group, while logit values for “tinnitus (Q13),” “palpitation (Q14),” “startled by faint noise (Q15),” “joint pain (Q19),” and “itching (Q24)” were higher in the older group than those in the younger group. Therefore, a total of 16 items with DIF by gender or age were removed and nine items, including “breath shortness (Q4),” “stomach fullness (Q6),” “poor appetite (Q7),” “head unclearness (Q10),” “dizziness (Q12),” “chest discomfort (Q16),” “flank pain (Q18),” “lumps (Q22),” and “fatigue (Q25)” were selected for the Rasch analysis.

Table 4 lists the fit levels of the nine questionnaire items. In the first analysis, “lumps (Q22)” showed fitting error (infit = 1.64 and outfit = 1.62). Therefore, the second analysis was conducted after removing “lumps” from the item pool. As a result, eight items except for “lumps” were free of fitting error, showing a range of infit and outfit values from 0.79 to 1.39, and hence, another iteration for fitting analysis was not considered. Among the raw or overall scores for the eight items, “poor appetite (Q22)” was the lowest (score = 697), while “fatigue (Q25)” was the highest (score = 1150), indicating that “fatigue” was the most frequently answered symptom for the subjects with PP. Table 5 lists the dimensionality results of the 8 items for the Rasch analysis. Unexplained variance in the first contrast was 1.598 (<3.0), implying that the 8-item questionnaire was unidimensional. According to the category response, DIF, fitting, and dimensionality tests of the Rasch analysis, the 8-item PPQ (PPQ-8) rated on a 6-point Likert scale was finally determined.

Table 6 lists the EITC results by three percentile (25%, 50%, and 75%) points. The Rasch analysis suggested the reduction of the 25-item PPQ to eight items; hence, the top three items were extracted from each percentile and summed up to 9 items. While matching the numbers of the EITC items with those of the PPQ-8, “stomach fullness (Q6),” showing the lowest EITC (r = 0.453), was removed from the 9 items. Finally, 8 items, including “breath shortness (Q4),” “indigestion (Q5),” “head unclearness (Q10),” “headache (Q11),” “dizziness (Q12),” “palpitation (Q14),” “chest discomfort (Q16),” and “limb heaviness (Q20),” were determined as the 8-item PPQ by EITC. Principal component analysis revealed that the 8-item PPQ by EITC was unidimensional like the PPQ-8 (percentage of variance = 53.637).

The Cronbach’s alpha coefficient for the EITC questionnaire was 0.875 and 2.23 for PPQ-8. Table 7 lists the ROC curve analyses of the 8-item questionnaire extracted from the EITC and Rasch analyses. A previous study reported that the sensitivity, specificity, AUC, and cut-off points of the 25-item PPQ were 83.8%, 83.3%, 0.860 (95% confidence interval: 0.759–0.960), and 5 points, respectively. The AUC levels for the 8-item PPQ using EITC and Rasch analysis were 0.799 (95% confidence interval: 0.668–0.930) and 0.759 (95% confidence interval: 0.620–0.898), respectively. This indicated that the two 8-item questionnaires had moderate accuracy for the determination of the PPQ, similar to the 25-item PPQ. While calculating the maximum Youden index, the sensitivity, specificity, and cut-off points of the 8-item questionnaire were 61.4%, 88.2%, and 28 points, respectively, using ETIC and 70.5%, 76.5%, and 23 points, respectively, for the Rasch analyses. While calculating the minimum Euclidean distance, the sensitivity, specificity, and cut-off points of the 8-item questionnaire were 70.5%, 76.5%, and 25 points, respectively, using EITC, and 70.5%, 76.5%, and 23 points, respectively, for the Rasch analyses.

5. Discussion

In this study, a reduced version of the 8 items of the PPQ was developed using Rasch analysis. As EITC analysis has been utilised in some studies to shorten the original questionnaire, another short-form PPQ was developed using EITC analysis, and its results were compared with the results of the PPQ-8, developed through Rasch analysis [14, 18]. Furthermore, the discriminative power of the two versions of the short form of the PPQ was compared with that of the 25-item PPQ using ROC curve analysis. Like most questionnaires developed by classical test theory, the original PPQ version was limited in that it could not present the information of item hierarchy relating to the respondents’ ability and item difficulty. Therefore, Rasch analysis was utilised to address concerns regarding the difficulty of items and the ability of the subjects to answer the PPQ.

This study found that among the 7 response categories of the 25-item PPQ, categories 3 (“disagree”) and 4 (“neither disagree nor agree”) were disordered or did not differentiate as predicted. One possibility behind this disordering might be the confusing semantics of category labels [32]. Specifically, participants might have been confused with the neutral response (“neither disagree nor agree”) and slight negative response (“disagree”) among the 7 response categories. After combining the two categories, six response categories satisfied the criteria for the minimum number of each category, outfit MnSq, and step calibration ordering. Moreover, the probability curve showed that the peaks of the six categories did not overlap. Therefore, a 6-point Likert scale, excluding the neutral response, was recommended for future use of the PPQ-8.

The DIF emerged when the heterogeneous groups within the sample responded differently to an item, despite equal levels of the construct that was measured. The DIF analysis compares the logit values of the two groups within a sample. A logit is defined as the natural log of an odds ratio, and greater logits represent increasing item severity [13]. In this study, 16 items were removed from the 25-item PPQ because there were significant differences in the logit values between gender and age. The remaining 9 items were not affected by gender and age, indicating that these 9 items were robust against bias due to the subgroup differences.

The fit analysis found that there were outfit or infit errors for “lumps (Q22).” The outfit is more sensitive to unexpected responses in items that are far from person measure, while the infit is more sensitive to unexpected responses in items that are close to the person measure [33]. The following fit analysis excluding “lumps” showed that the other 8 items were free of fitting errors. Therefore, it appeared that the overall scale of the 8-item PPQ measured something related to the PP without any overestimation or redundancy. From the item response theory point of view, person reliability refers to the differences between high and low respondents and is presented as a separation index. A low separation index indicates the limitation of a questionnaire to assess changes in the underlying trait of an individual [34]. This study showed that the PPQ-8 separation index was 2.23, indicating a satisfactory ability to distinguish between high and low respondents. The 8-item PPQ, according to the EITC analysis, had a “good” internal consistency level (Cronbach’s alpha coefficient = 0.875) and was unidimensional, similar to the 8-item PPQ developed via Rasch analysis. Among the 8 items, 4 including “breath shortness (Q4),” “head unclearness (Q10),” “dizziness (Q12),” and “chest discomfort (Q16)” were included in the two versions of the short form PPQ.

In the ROC analysis, the discriminative ability of the 8-item PPQ by EITC (AUC = 0.799) was “moderate,” which was similar to that of the PPQ-8 by Rasch analysis (AUC = 0.759). Considering that the AUC level of the original 25-item PPQ was 0.860, it seemed that the two 8-item PPQs through EITC or Rasch analysis might not have decreased the discriminative ability of the 25-item PPQ. In terms of determination of the cut-off points, the sensitivity levels at the maximum Youden index were lower than the specificity levels for the EITC, indicating an increased possibility of false negativity. Alternatively, the sensitivity levels at the minimum Euclidean distance were similar to the specificity levels, and the cut-off points by the minimum Euclidean distance were lower than those by the maximum Youden index. Therefore, 25 points for the EITC-PPQ, using a minimum Euclidean distance, were recommended. Interestingly, the PPQ-8 by Rasch analysis showed the same sensitivity, specificity, and cut-off points (70.5%, 76.5%, and 23 points, respectively) as the maximum Youden index and minimum Euclidean distance.

However, it should be noted that despite satisfactory reliability and discriminative ability, a limitation of the 8-item PPQ by EITC, that it did not present the information of item hierarchy or DIF characteristics for the subgroups, might remain. Another concern of the 8-item PPQ by EITC was that the determination of the item numbers of the PPQ was somewhat arbitrary because the item numbers in the EITC analysis were forced to match those in the Rasch analysis. Therefore, this study suggested that PPQ-8 by Rasch analysis might be preferable to EITC for future use to evaluate PP.

It should also be noted that this study did not include an examination of the content validity of the short-form PPQ. Previously, the content validity of the pilot version of the PPQ was examined, where 17 clinicians were asked to rate the importance of each questionnaire item for the PP, using a 7-point scale [35]. The clinical importance of “sputum” for the PP was top-ranked (6.4 points), and the importance of “sickness (6.2 points),” “feeling of foreign body (5.9 points),” “dizziness (5.7 points),” and “dark circle (5.6 points)” followed in the study. Additionally, the reduced items via the EITC and Rasch analyses were not related to the rank of clinical importance for the pilot version of the PPQ. Considering that the 25-item PPQ was developed from the items that were rated only on at least 4 points of clinical importance by clinicians and the PPQ-8 items were reduced from those of the 25-item PPQ, it appears that satisfactory content validity of the 25-item PPQ may guarantee the content validity of the 8-item PPQ.

6. Limitations

This study had some limitations. Although Rasch analysis presented information on DIF, it was affected by sample characteristics, such as environmental and racial differences. Therefore, item reduction of the original PPQ had to be performed in the other population using Rasch analysis. In this study, item reduction was conducted for normal participants, whereas ROC analysis was conducted for inpatients. Therefore, the differences between the two samples may have affected the results of the ROC curve analysis. Further studies are needed to overcome these limitations regarding the environmental and racial differences and the sample characteristics.

7. Conclusion

In this study, the short-form PPQ was developed using Rasch analysis based on retrospective data from 291 normal participants and 61 inpatients. Together with Rasch analysis, another short-form PPQ was developed using EITC analysis, and the results of the 2 short-form PPQs and the original version of the PPQ were compared. The Rasch analysis results suggested a 6-point response category for the PPQ and finally determined the PPQ-8 consisting of eight items, free of fitting errors or DIF variability. Furthermore, the PPQ-8 had satisfactory reliability, concurrent validity, unidimensionality, fitting levels, sensitivity, and specificity, as well as the moderate discriminative ability of PP. Despite the 8-item PPQ using EITC analysis showed similar levels of reliability, validity, and discriminative ability of PP to those of the PPQ-8, it could not present the information of item hierarchy and DIF. In conclusion, the PPQ-8 by Rasch analysis was recommended for future use to evaluate the clinical severity of PP, reduce the response burden, and minimise differences between gender and age.

Data Availability

The data used to support the findings of this study have not been made available because the data contain personal information.

Conflicts of Interest

The author declares no conflicts of interest associated with this work.

References

S. Clavey, “Phlegm: etiology and symptomatology,” in Phlegm: Etiology and Symptomatology, pp. 265–312, Churchill Livingstone, London, UK, 2003.
View at: Publisher Site | Google Scholar
X. F. Ma and Q. Wang, “Argument about application of constitution identification in health management and its significance,” Traditional Chinese Medicine for Treatment, vol. 25, no. 11, pp. 2265–2267, 2007.
View at: Google Scholar
Q. Bai, Y. Chuang, and Y. Zhao, “The correlation between demographical and lifestyle factors and traditional Chinese medicine constitution among Macau elderly individuals,” Evidence-Based Complementary and Alternative Medicine, vol. 2021, Article ID 5595235, 9 pages, 2021.
View at: Google Scholar
Q. Wang, R. L. Wang, and Y. S. Li, “Comments on development of Chinese medical constitution,” Traditional Chinese Medicine Network Pharmacology, vol. 22, no. 9, pp. 627–630, 2007.
View at: Google Scholar
J. Zou, D. Tian, and L. Cong, Basic Theory of Traditional Chinese Medicine (II), Shanghi university of traditional Chinese medicine, Shanghi, China, 1999.
Y.-J. Park, J.-S. Park, M.-Y. Kim, and Y.-B. Park, “Development of a valid and reliable phlegm pattern questionnaire,” Journal of Alternative & Complementary Medicine, vol. 17, no. 9, pp. 851–858, 2011.
View at: Publisher Site | Google Scholar
A. Shakeri, M. H. Hashempur, A. Beigomi et al., “Strategies in traditional Persian medicine to maintain a healthy life in the elderly,” Journal of Complementary and Integrative Medicine, vol. 18, no. 1, pp. 29–36, 2020.
View at: Publisher Site | Google Scholar
World Health Organization, WHO International Standard Terminologies on Traditional Medicine in the Western Pacific Region, WHO Western Pacific Regional Office, Manila, 2007.
S. W. Cho, Y. J. Park, and S. C. Lee, “Relationships between pathological patterns and quality of life: pathway analysis,” Evidence-Based Complementary and Alternative Medicine, vol. 2013, Article ID 453096, 9 pages, 2013.
View at: Publisher Site | Google Scholar
Y.-J. Park, J.-M. Lee, S.-Y. Yoo, and Y.-B. Park, “Reliability and validity of tongue color analysis in the prediction of symptom patterns in terms of East Asian Medicine,” Journal of Traditional Chinese Medicine, vol. 36, no. 2, pp. 165–172, 2016.
View at: Publisher Site | Google Scholar
Y.-J. Park and Y.-B. Park, “Relationships between pathological patterns and vocal qualities estimated by acoustic parameters,” Chinese Journal of Integrative Medicine, vol. 21, no. 5, pp. 346–354, 2015.
View at: Publisher Site | Google Scholar
J. M. Ok and Y. J. Park, “Disruption of pathological patterns in a young population with dysfunctional breathing,” Evidence-Based Complementary and Alternative Medicine, vol. 2020, Article ID 9614574, 2020.
View at: Publisher Site | Google Scholar
L. Prieto, J. Alonso, and R. Lamarca, “Classical test theory versus Rasch analysis for quality of life questionnaire reduction,” Health and Quality of Life Outcomes, vol. 1, no. 1, p. 27, 2003.
View at: Publisher Site | Google Scholar
D. E. Beaton, J. G. Wright, J. N. Katz, and Upper Extremity Collaborative Group, “Development of the QuickDASH,” The Journal of Bone and Joint Surgery, vol. 87, no. 5, pp. 1038–1046, 2005.
View at: Publisher Site | Google Scholar
X. Badia, L. Prieto, M. Roset, A. Dı́ez-Pérez, and M. Herdman, “Development of a short osteoporosis quality of life questionnaire by equating items from two existing instruments,” Journal of Clinical Epidemiology, vol. 55, no. 1, pp. 32–40, 2002.
View at: Publisher Site | Google Scholar
S.-H. Kim, “Revision of SF-36 for Korean elderly women using Rasch model,” Journal of Korean Association of Physical Education and Sport for Girls and Women, vol. 30, no. 4, pp. 441–457, 2016.
View at: Publisher Site | Google Scholar
K. Niere and A. Quin, “Development of a headache-specific disability questionnaire for patients attending physiotherapy,” Manual Therapy, vol. 14, no. 1, pp. 45–51, 2009.
View at: Publisher Site | Google Scholar
R. G. Marx, C. Bombardier, S. Hogg-Johnson, and J. G. Wright, “Clinimetric and psychometric strategies for development of a health measurement scale,” Journal of Clinical Epidemiology, vol. 52, no. 2, pp. 105–111, 1999.
View at: Publisher Site | Google Scholar
G. N. Masters, “A Rasch model for partial credit scoring,” Psychometrika, vol. 47, no. 2, pp. 149–174, 1982.
View at: Publisher Site | Google Scholar
A. Rouquette, J.-B. Hardouin, A. Vanhaesebrouck, V. Sébille, and J. Coste, “Differential Item Functioning (DIF) in composite health measurement scale: recommendations for characterizing DIF with meaningful consequences within the Rasch model framework,” PLoS One, vol. 14, no. 4, Article ID e0215073, 2019.
View at: Publisher Site | Google Scholar
P. W. Holland and H. Wainer, Differential Item Functioning, Lawrence Erlbaum Associates, New Jersey, USA, 1993.
M. H. Anshel, N. L. Weatherby, M. Kang, and T. Watson, “Rasch calibration of a unidimensional perfectionism inventory for sport,” Psychology of Sport and Exercise, vol. 10, no. 1, pp. 210–216, 2009.
View at: Publisher Site | Google Scholar
J. C. Nunnally and I. H. Bernstein, Psychometric Theory, McGraw-Hill, New York, NY, USA, 3rd ed. edition, 1994.
J. M. Linacre, “Optimizing rating scale category effectiveness,” Journal of Applied Measurement, vol. 3, pp. 85–106, 2002.
View at: Google Scholar
A. Apezetxea, L. Carrillo, and F. Casanueva, “Rasch analysis in the development of the NutriQoL® questionnaire, a specific health-related quality of life instrument for home enteral nutrition,” Journal Patient Report Outcomes, vol. 2, no. 1, p. 25, 2017.
View at: Google Scholar
2021, https://www.winsteps.com/winman/principalcomponents.htm Dimensionality: Contrasts & Variances.
K. Pesudovs, J. M. Burr, C. Harley, and D. B. Elliott, “The development, assessment, and selection of questionnaires,” Optometry and Vision Science, vol. 84, no. 8, pp. 663–674, 2007.
View at: Publisher Site | Google Scholar
D. Streiner, “Starting at the beginning: an introduction to coefficient alpha and internal consistency,” Journal of Personality Assessment, p. 3679277, 2003.
View at: Publisher Site | Google Scholar
J. E. Fischer, L. M. Bachmann, and R. Jaeschke, “A readers’ guide to the interpretation of diagnostic test properties: clinical example of sepsis,” Intensive Care Medicine, vol. 29, no. 7, pp. 1043–1051, 2003.
View at: Publisher Site | Google Scholar
N. J. Perkins and E. F. Schisterman, “The inconsistency of “optimal” cutpoints obtained using two criteria based on the receiver operating characteristic curve,” American Journal of Epidemiology, vol. 163, no. 7, pp. 670–675, 2006.
View at: Publisher Site | Google Scholar
R. Froud and G. Abel, “Using ROC curves to choose minimally important change thresholds when sensitivity and specificity are valued equally: the forgotten lesson of Pythagoras. Theoretical considerations and an example application of change in health status,” PLoS One, Article ID 0114468, 2014.
View at: Google Scholar
J. M. Linacre, “Investigating rating scale category utility,” Journal of Outcome Measurement, vol. 3, no. 2, pp. 103–122, 1999.
View at: Google Scholar
P. Anselmi, G. Vidotto, O. Bettinardi, and G. Bertolotti, “Measurement of change in health status with Rasch models,” Health and Quality of Life Outcomes, vol. 13, no. 1, p. 16, 2015.
View at: Publisher Site | Google Scholar
D. A. Leske, S. R. Hatt, L. Liebermann, and J. M. Holmes, “Evaluation of the adult strabismus-20 (AS-20) questionnaire using Rasch analysis,” Investigative Opthalmology & Visual Science, vol. 53, no. 6, pp. 2630–2639, 2012.
View at: Publisher Site | Google Scholar
J. S. Park, D. H. Yang, M. Y. Kim, S. C. Lee, and Y. J. Park, “Development of questionnaire for Damum patternization,” J Korean Inst Orient Med Diagn, vol. 10, no. 1, pp. 64–77, 2006.
View at: Google Scholar

Copyright

Copyright © 2021 Young-Jae Park. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

366

Downloads

527

Citations