Accuracy of Estimating Periodontitis and Its Risk Association Using Partial-Mouth Recordings for Surveillance Studies: A Systematic Review and Meta-Analysis

Alawaji, Yasmine N.; Alshammari, Abdulsalam; Aleksejuniene, Jolanta

doi:https://doi.org/10.1155/2022/7961199

International Journal of Dentistry

On this page

Abstract Introduction Methods Results Discussion Conclusions Data Availability Conflicts of Interest Supplementary Materials References Copyright Related Articles

Research Article | Open Access

Volume 2022 | Article ID 7961199 | https://doi.org/10.1155/2022/7961199

Accuracy of Estimating Periodontitis and Its Risk Association Using Partial-Mouth Recordings for Surveillance Studies: A Systematic Review and Meta-Analysis

Yasmine N. Alawaji,^1,2,3Abdulsalam Alshammari,^1,2and Jolanta Aleksejuniene³

Academic Editor: Halim Issever

Received14 Sept 2021

Accepted09 Feb 2022

Published17 Mar 2022

Abstract

Objectives. Our aim is to conduct an up-to-date systematic review and meta-analysis pertaining to the accuracy of using the partial-mouth recording protocol (PRP) in surveillance studies to estimate the periodontitis prevalence, extent, severity, and its risk associations. Methods. Medline and Embase databases were searched for studies which assessed the periodontitis prevalence, severity, extent, or its risk associations using PRPs versus full-mouth recording protocols (FRPs); searches were conducted up until May 26, 2021. The risk of bias and the applicability of the studies were assessed using the QUADAS-2 tool. Both qualitative data synthesis and quantitative data synthesis were performed, and comparisons were done for the accuracy and precision of PRPs for different periodontitis outcomes. The study’s protocol was registered through the International Platform of Registered Systematic Review and Meta-analysis Protocols (registration number: INPLASY202160032). Results. A total of 14 studies were included. The studies had a considerable degree of heterogeneity, along with a moderate risk of bias and applicability concerns. Several factors influenced the accuracy or precision of using PRPs, including the age, distribution of periodontitis in the studied population, PRP selection, total PRP sites, the threshold for minimum sites with CAL, and the severity of periodontitis case definitions. Overall, the PRP with the highest accuracy and precision mainly included (1) a full-mouth protocol at the following partial sites: mesiobuccal-midbuccal-distolingual (MB-B-DL), mesiobuccal-distolingual (MB-DL), mesiobuccal-midbuccal-distobuccal (MB-B-DB), mesiobuccal-distobuccal (MB-DB), and 84 sites using the random site selection method (RSSM) and (2) random-half-mouth (RHM) protocols. Conclusions. The PRPs with the highest overall accuracy and precision in estimating the periodontitis prevalence, extent, severity, and risk associations included the full-mouth assessment at the following partial sites: MB-B-DL, MB-DL, MB-B-DB, MB-DB, and 84 sites using RSSM and RHM protocols.

1. Introduction

Epidemiological studies mainly focus on the assessment of certain disease distributions in populations and their risks [1]. A full-mouth recording protocol (FRP) examines six sites per tooth in all teeth except for the third molars and is considered the gold standard for periodontal examinations [2, 3]. However, due to the extensive time, cost, and the number of examiners needed to conduct population-based studies, the use of a partial-mouth recording protocol (PRP) can be an alternative to FRP [2].

Several PRPs were tested for accuracy, including the protocol examining index teeth such as the Ramfjord teeth and Community Periodontal Index of Treatment Needs (CPITN), the random-half-mouth (RHM) protocol, and fixed or random selection of partial site protocols [4–8]. In a 2013 systematic review [9], various PRPs were tested for their accuracy and found that the highest accuracy when examining the prevalence, severity, and extent of periodontitis resulted from using the RHM protocol at six sites per tooth and full-mouth recordings at Mesiobuccal-Midbuccal-Distobuccal sites [(FM)MB-B-DB]. Conducting half-mouth examinations at the Mesiobuccal-Midbuccal-Distolingual [(HM)MB-B-DL] or (FM)MB-B-DL sites were also effective in assessing the prevalence and severity of periodontitis. However, the (HM)MB-B-DL or (FM)MB-B-DL protocols were not used to evaluate the extent of periodontitis.

Previous studies that evaluated the accuracy of PRPs mainly focused on examining periodontitis prevalence and/or summarizing its extent and severity [4, 7, 9–12]. Only recently have studies started to assess the precision of using PRPs to estimate the risks associated with periodontitis [13, 14]. A previous 2013 systematic review assessed the validity of PRPs for studying periodontitis severity, extent, and prevalence using a single disease threshold, and the precision of using PRPs to assess the risk associated with periodontitis was not evaluated. In addition, the factors that could impact the accuracy or precision of PRPs were not addressed in the previous systematic review; therefore, the evidence needs to be updated [15].

The main research question was “Should we rely on PRP for assessment of periodontitis in surveillance surveys?” There were two specific objectives in this study: (1) to conduct an up-to-date systematic review and meta-analysis regarding the accuracy of PRPs to estimate periodontitis prevalence, extent, severity, and its risk associations, and (2) to identify the factors that may impact the performance of PRPs.

2. Methods

This review was prepared using the Preferred Reporting Items for Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies (PRISMA-DTA) [16]. The study’s protocol was registered in the International Platform of Registered Systematic Review and Meta-analysis Protocols (Registration number: INPLASY202160032) [17].

2.1. Eligibility

The following inclusion criteria were used: full-text papers in English about studies that employed a cross-sectional study design or that analyzed the baseline data of longitudinal studies, including subjects of any age with permanent dentitions, where all the PRP findings were verified with the FRP. FRP data assessed six sites or four interproximal sites per tooth in all teeth, except third molars. The studies reported the following outcomes: periodontitis prevalence, its risk associations, mean, and standard deviation (SD) for estimates of severity or extent. Studies used clinical attachment loss (CAL) since CAL is an irreversible indicator of periodontitis. The exclusion criteria are as follows if the studies included any of the following: a simulation study, hypothetical data, subjects with primary dentition, studies using other periodontal parameters such as the periodontal pocket depth (PPD), or bleeding upon probing without assessment of CAL.

2.2. Search Strategy

The search was conducted up until May 26, 2021, using keywords and MeSH or Emtree terms based on several field searches including titles, abstracts, and author keywords. The following search concepts were considered: periodontitis, prevalence, extent, severity, and partial-mouth recording. Limits or filters were not used when conducting the search to increase the search sensitivity. Medline and Embase were mainly searched via Ovid, and grey literature was searched at different sources as outlined in the protocol [17]. Manual searches were done for reference lists and related citations in PubMed.

2.3. Outcomes

There exist accuracy and precision of each of the following: (1) periodontitis prevalence as indicated by the measures of sensitivity, specificity, positive predictive value (PPV), Negative Predictive Value (NPV), and absolute bias; (2) periodontitis-related risk associations indicated by absolute bias and/or relative bias; (3) extent of periodontitis indicated by absolute bias; and (4) severity of periodontitis indicated by absolute bias.

Prevalence of periodontitis was defined using the two most commonly used thresholds in the previous studies: (1) severe periodontitis (≥1 site with CAL ≥6 mm) and (2) moderate-severe periodontitis (≥1 site with CAL ≥4 mm). Suboutcomes for periodontitis prevalence were defined using the case definitions from the Centers for Disease Control and Prevention and the American Academy of Periodontology (CDC/AAP) [18, 19]. The CDC/AAP severe periodontitis was defined as CAL ≥6 mm at ≥2 interproximal sites (not on the same tooth) and PPD ≥5 mm at ≥1 interproximal site (can be one of the two sites with CAL). Moderate-severe periodontitis was defined as CAL ≥4 mm at ≥2 interproximal sites (not on the same tooth) or PPD ≥5 mm at ≥2 interproximal sites (not on the same tooth).

Periodontitis extent was defined as the mean percentage of sites with CAL ≥3 mm or ≥5 mm [2]. Periodontitis severity was defined as the population mean of CAL. Absolute bias was calculated for each of the periodontal outcomes as follows:(i)Absolute bias_prevalence = prevalence _PRP − prevalence _FRP(ii)Absolute bias_extent = mean extent _PRP − mean extent _FRP(iii)Absolute bias_severity = mean CAL _PRP − mean CAL _FRP

In order to estimate the potential for systematic error concerning the risk associations with the periodontal disease when comparing PRPs to FRPs, the absolute bias and relative bias were calculated based on the natural logarithm (ln) scale of odds ratios (OR) as follows [13, 14]:(i)Absolute bias of OR = ln (OR_PRP) − ln (OR_FRP)(ii)Relative bias of OR = [ln (OR_PRP) − ln (OR_FRP)]/ln (OR_FRP)

2.4. Study Selection and Data Extraction

The preliminary study selection was done by screening the titles and abstracts, and the final selection was based on eligibility criteria after retrieval of the full texts. A single data selection and extraction were completed and then verified by another reviewer. Any disagreements in the study selection or data extraction were resolved by discussion until a consensus was reached. A data extraction form was customized using Microsoft Excel software, version 16.0 [20]. The following information about each extracted study was collected: author names, publication date, study title, sample size, study design, study settings/country, included age range, eligibility criteria, examiner training/calibration, intraexaminer/interexaminer reliability, management of missing data, the minimum number of included sites/teeth, PRP type, definition of FRP, periodontitis thresholds, and mean results of periodontitis extent and severity using the PRP and FRP. Total subjects with or without periodontitis in the PRP and FRP were used to construct a 2 × 2 table to calculate the prevalence of periodontitis using the following diagnostic accuracy indicators: sensitivity, specificity, and predictive values. For each periodontitis-associated risk such as diabetes mellitus, obesity, and cigarette smoking, both unadjusted and adjusted OR were extracted along with their 95% CI.

2.5. Assessment of Risk of Bias and the Applicability of Individual Studies

The second version of the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS)-2 tool [21] was used for the assessment of the risk of bias (4 domains) and the applicability concerns (3 domains). Based on the suggestions by QUADAS-2, the signaling questions for each domain were customized for the current review, and their revised versions are presented in a supplementary table (Table S-1). For the overall judgment, a high risk of bias or high applicability concerns were determined if the study was rated as such in at least one of the domains. The customization of the tool and the risk of bias assessment were done by two reviewers, and any disagreement was resolved by discussion until a consensus was reached.

2.6. Data Synthesis

We used OpenMeta-Analyst software [22] to analyze data extracted from eligible studies to summarize and compare different accuracy and precision indicators for the prevalence, extent, and severity of periodontitis using different PRPs. Meta-analysis was used to compare the different PRPs and study methods rather than relying on the pooled estimates. The statistical heterogeneity was assessed as outlined in the Cochrane handbook [23] using the following assessments: (1) visual examination of the forest plots, where minimal or no overlap of studies’ 95% confidence intervals and/or the variation of bias direction (positive or negative) indicates heterogeneity; (2) a Chi-square test where α = 0.100 indicates a statistical significance; and (3) I² used to quantify the heterogeneity, where I² range from 0.0% to 40.0% indicates negligible heterogeneity, I² ≥ 75% indicates a considerable heterogeneity, and I² values between 40.0% and 75.0% indicate moderate to substantial heterogeneity. For the meta-analysis, we chose a random effect model (DerSimonian and Laird inverse variance) for pooling the results of different PRPs. In order to identify sources of heterogeneity and to identify the factors that impact the performance of PRPs, the clinical and methodological diversity of the included studies were assessed. Subanalyses were done for estimating the prevalence of sensitivity and absolute bias of studies that used case definitions provided by the CDC/AAP.

3. Results

3.1. Study Selection

A total of 614 papers were retrieved for preliminary screening of titles and abstracts. Total numbers of included and excluded studies are presented in Figure 1. A detailed explanation of the reasons for exclusion is presented in the appendix (Table A-1). The main types of PRPs in the included studies were the full mouth at partial sites, RHM, half mouth at partial sites, and index teeth. The risk of bias and applicability assessment of 14 selected studies are presented in Table 1. A summary of study characteristics and potential concerns are described in Table 2. Most of the studies did not describe how the sample size was calculated or how they handled the missing data. A majority of studies limited the inclusion of subjects if they had ≥6 teeth remaining. Few studies had strict eligibility criteria such as subjects being required to have ≥16–24 teeth present [24–26], limited to subjects with periodontitis [25], or untreated individuals [27, 28], which can limit their external validity.

3.2. Prevalence of Periodontitis

For moderate-severe periodontitis, the prevalence ranged from 22.0% to 96.9%, the absolute bias_prevalence was −12.3% [(95% CI: −14.8%, −9.7%), I² = 96.3%, ] in Figure 2, and the sensitivity was 81.0% [(95% CI: 76.9%, 84.6%), I² = 99.1%, ] in Figure 3. For severe periodontitis, the prevalence ranged from 11.8% to 55.1%, the absolute bias_prevalence was −8.9% [(95% CI: −10.9%, −7.0%), I² = 95.6%, ] in Figure 4, and the sensitivity was 70.1% [(95% CI: 64.6%, 75.1%), I² = 98.6%, ] in Figure 5. Moderate-severe periodontitis had larger absolute bias_prevalence (−12.3% versus −8.9%), higher sensitivity (81.0% versus 70.1%), and lower overall NPV compared with severe periodontitis (Figures 2–5). In a subanalysis of studies that used the CDC/AAP definitions for periodontitis, a similar pattern was seen when absolute bias, sensitivity, and NPV measures were compared between moderate-severe and severe periodontitis thresholds (refer to supplementary Figures S-1–S-4).

Figure 2

Summary of the absolute bias (AB)_prevalence of moderate-severe periodontitis using partial-mouth recording protocols (PRP). Total PRP sites for each PRP and the minimal number of sites with clinical attachment loss (CAL) are listed. AB_prevalence values <0.0 underestimate the prevalence while values >0.0 overestimate it. FRP: full-mouth recording protocol, N: sample size, CI: confidence interval, MB: mesiobuccal, B: Midbuccal, DB: distobuccal, ML: mesiolingual, L: midlingual, DL: distolingual, FM: full-mouth, HM: half-mouth, 84 RSSM: 84 sites selected using random site selection method, 42 RSSM: 42 sites selected using random site selection method, 36 RSSM: 36 sites selected using random site selection method, (RHM): random-half-mouth, CPITN: Community Periodontal Index of Treatment Needs, and ?: not clear.

Figure 3

Summary of the sensitivity of moderate-severe periodontitis prevalence using partial-mouth recording protocols (PRP). Specificity and positive predictive value are 100% for all PRPs. PRP sites, the minimal number of sites with clinical attachment loss (CAL), and negative predictive value (NPV) are listed. FRP: full-mouth recording protocol, N: sample size, CI: confidence interval, MB: mesiobuccal, B: midbuccal, DB: distobuccal, ML: mesiolingual, L: midlingual, DL: distolingual, FM: full-mouth, HM: half-mouth, 84 RSSM: 84 sites selected using random site selection method, 42 RSSM: 42 sites selected using random site selection method, 36 RSSM: 36 sites selected using random site selection method, RHM: random-half-mouth, CPITN: Community Periodontal Index of Treatment Needs, and ?: not clear.

Figure 4

Summary of the absolute bias (AB)_prevalence of severe periodontitis using partial-mouth recording protocols (PRP). Total PRP sites for each PRP and the minimal number of sites with clinical attachment loss (CAL) are listed. AB_prevalence values <0.0 underestimate the prevalence while values >0.0 overestimate it. FRP: full-mouth recording protocol, N: sample size, CI: confidence interval, MB: mesiobuccal, B: midbuccal, DB: distobuccal, ML: mesiolingual, L: midlingual, DL: distolingual, FM: full-mouth, HM: half-mouth, 84 RSSM: 84 sites selected using random site selection method, 42 RSSM: 42 sites selected using random site selection method, 36 RSSM: 36 sites selected using random site selection method, RHM: random-half-mouth, CPITN: Community Periodontal Index of Treatment Needs, and ?: not clear.

Figure 5

Summary of the sensitivity of severe periodontitis prevalence using partial-mouth recording protocols (PRP). Specificity and positive predictive value are 100% for all PRPs. PRP sites, the minimal number of sites with clinical attachment loss (CAL), and negative predictive value (NPV) are listed. FRP: full-mouth recording protocol, N: sample size, CI: confidence interval, MB: mesiobuccal, B: midbuccal, DB: distobuccal, ML: mesiolingual, L: midlingual, DL: distolingual, FM: full-mouth, HM: half-mouth, 84 RSSM: 84 sites selected using random site selection method, 42 RSSM: 42 sites selected using random site selection method, 36 RSSM: 36 sites selected using random site selection method, RHM: random-half-mouth, CPITN: Community Periodontal Index of Treatment Needs, and ?: not clear.

For both periodontitis thresholds, the heterogeneity among studies was considerable for the absolute bias_prevalence and sensitivity as indicated by the I² > 95.0 and significant Chi-square results () (Figures 2–5). Sources of heterogeneity and the factors that may impact the performance of PRPs include prevalence and severity of periodontitis case definition, using CAL measurements alone or in combination with PPD in case definitions, different minimal number of sites to used define periodontitis (≥1 or ≥2 sites) as presented in Table 3, the PRP type, and the total PRP sites (some studies used the midbuccal and midlingual sites, while others included only interproximal sites).

3.3. Estimate of Periodontitis Severity

The absolute bias_severity was −0.01 (95% CI: −0.03, 0.01) which is considered small and the majority of PRPs had their 95% CI including the null value. The use of index teeth: Ramfjord teeth, and CPITN protocols mainly overestimated the severity, and the largest absolute bias_severity was 0.4. The heterogeneity for absolute bias_severity, as indicated by I² = 6.25 and a chi-square test (Figure 6), can be considered negligible [23].

Figure 6

Summary of absolute bias (AB)_severity, background characteristics of studies, PRP sites, and severity estimates are listed. FRP: full-mouth recording, SD: standard deviation, N: sample size, CI: confidence interval, NHANES: National Health and Nutrition Examination Survey, ARIC: atherosclerosis risk in communities, MB: mesiobuccal, B: midbuccal, DB: distobuccal, ML: mesiolingual, L: midlingual, DL: distolingual, FM: full-mouth, 84 RSSM: 84 sites selected using random site selection method, 42 RSSM: 42 sites selected using random site selection method, 36 RSSM: 36 sites selected using random site selection method, HM: Half-mouth, and CPITN: Community Periodontal Index of Treatment Needs.

3.4. Estimate of the Periodontitis Extent

The absolute bias_extent was −0.6 [(95% CI: −1.1, 0.0), I² = 0.00%, ] for moderate-severe periodontitis (Figure 7) and −0.1 [(95% CI: −0.4, 0.1), I² = 0.0%, ] for severe periodontitis (Figure 8). The extent of periodontitis was mainly underestimated when using PRPs; however, the use of index teeth: Ramfjord teeth, and CPITN protocols overestimated the periodontitis extent. The overall heterogeneity for moderate-severe and severe periodontitis was negligible as indicated by the I² = 0.0 and the nonsignificant Chi-square findings for moderate-severe and severe periodontitis (Figures 7 and 8).

Figure 7

Summary estimates of the absolute bias (AB)_extent of moderate-severe periodontitis. Background characteristics of studies, PRP sites, and specific thresholds of clinical attachment loss (CAL) are listed. FRP: full-mouth recording protocol, N: sample size, SD: standard deviation, CI: confidence interval, NHANES: national health and nutrition examination survey, MB: mesiobuccal, B: midbuccal, DB: distobuccal, ML: mesiolingual, L: midlingual, DL: distolingual, FM: full-mouth, HM: half-mouth, and CPITN: Community Periodontal Index of Treatment Needs.

Figure 8

Summary of the absolute bias (AB)_extent of severe periodontitis using partial-mouth recording protocols (PRP). Total PRP sites for each PRP are listed. AB_extent values <0.0 underestimate the extent, while values >0.0 overestimate it. FRP: full-mouth recording protocol, N: sample size, SD: standard deviation, CI: confidence interval, MB: mesiobuccal, B: midbuccal, DB: distobuccal, ML: mesiolingual, L: midlingual, DL: distolingual, FM: full-mouth, HM: half-mouth, 84 RSSM: 84 sites selected using random site selection method, 42 RSSM: 42 sites selected using random site selection method, 36 RSSM: 36 sites selected using random site selection method, RHM: random-half-mouth, and CPITN: Community Periodontal Index of Treatment Needs.

3.5. Periodontitis-Related Risk Associations

A few studies assessed the accuracy of the risk associations of periodontitis using PRPs compared with FRP, which precluded us from conducting a meta-analysis. We chose to summarize the risk determinants that were reported in two or more studies: diabetes mellitus, obesity, and current cigarette smoking status (Table 4). The measurement of these risk determinants varied among studies. Diabetes mellitus was either defined as present/absent [13, 14] or based on self-reported glycemic control [28]. Obesity was defined as present/absent [28] or based on Body Mass Index [13, 14]. Current smoking was defined as currently smoking any number of cigarettes daily [28] or smoking ≥100 cigarettes during the lifetime [13].

4. Discussion

The current systematic review and meta-analyses aimed to answer the research question “should we rely on PRPs to study periodontal diseases in surveillance studies?”. The two main objectives were to examine the accuracy and precision of determining the prevalence, severity, extent, and risk associations of periodontitis using PRP as compared to FRP and to identify the factors that may influence accuracy using PRP.

4.1. Prevalence of Periodontitis

Specificity and positive predictive values were 100.0% for all PRPs because PRPs can only identify positive cases that were already identified using an FRP [32]. The average sensitivity was 81.0% for moderate-severe periodontitis (CAL ≥4 mm), which can be considered a high sensitivity [33]. The sensitivity measures of individual PRPs for moderate-severe periodontitis were mainly above 80.0% for the RHM and full-mouth assessments at partial sites such as the (FM)MB-B-DL, MB-DL, MB-B-DB, MB-DB, and 84, 42, and 36 RSSM. The NPV varied considerably among different studies and ranged from as low as 0.6% to 94.8%, which highlights the fact that the accuracy of PRPs can be influenced by the prevalence of periodontitis in specific populations [34].

When the periodontitis threshold increased from moderate (CAL ≥4 mm) to severe (CAL ≥6 mm), the average sensitivity decreased to 70.1%, which is considered only a moderate sensitivity [33]. The PRPs that resulted in sensitivity above 70.0% were the RHM and full-mouth assessments at partial sites such as (FM)MB-B-DL, MB-DL, MB-B-DB, MB-DB, 84, 42, and 36 RSSM.

The minimum number of sites with CAL used in the included studies was either ≥1 or ≥2 sites. A higher sensitivity from 7.4 to 21.8% resulted when CAL was assessed at ≥1 site compared to CAL at ≥2 sites. However, the use of CAL measurements at ≥2 sites is preferable in order to preclude sites with CAL due to other etiologies such as having a single isolated PPD due to endodontic involvements or root fractures.

4.2. Periodontitis Severity and Extent

In general, absolute bias and heterogeneity were low across different studies, PRPs, and CAL thresholds. The index teeth, Ramfjord teeth, and CPITN teeth protocols overestimated the extent and severity of periodontitis and, thus, resulted in the highest absolute bias.

4.3. Risk Associations with Periodontitis

The three risk determinants summarized in this study were diabetes mellitus, obesity, and cigarette smoking. In general, the absolute bias was small and ranged from −0.5 to 0.9. This means that the use of PRP can marginally underestimate or overestimate the risk associations with periodontitis. However, the evidence was limited for several reasons. Until now, only a few studies evaluated the precision of using PRPs to assess the risk determinants of periodontitis compared to FRPs. Importantly, the risk determinants depend to some degree on the prevalence of periodontitis and the use of adjusted or nonadjusted odds ratios. Also, the size of the adjusted risk association will change based on other variables included in the multivariate models. In addition, the definitions and the measurements of the risk associations varied among studies. Diabetes mellitus was defined as present/absent in two of the included studies [13, 14]. However, based on current knowledge, a lack of glycemic control is more important than the presence or absence of diabetes mellitus because diabetic subjects with good glycemic control (e.g., HbA1c <7%) have a similar risk for periodontal disease as nondiabetic individuals [35–37]. Therefore, we recommend using objective measurements such as the glycemic control of individuals when studying periodontitis-related risk associations.

The majority of studies included a wide age range of subjects (13–103 years). However, a limited number of studies reported the comparisons based on age cohorts. Two studies analyzed the precision of estimating periodontitis extent and/or severity and did not find clear patterns based on age cohorts [9, 27]. One study [28] compared subjects 13–34 years of age to an older group 35–80 years of age and found that the accuracy of estimating the prevalence of periodontitis was lower in younger subjects, while the extent of periodontitis was either underestimated or overestimated; this is consistent with previous findings [38].

4.4. Review Limitations and Implications

The majority of the studies used nonrepresentative and nonrandomly selected samples [24–29] or randomly selected subjects without reporting the extent of the missing data [4, 7–10, 13, 14, 39]. In addition, some studies restricted their samples to subjects with periodontitis [25] and untreated subjects [27, 28], or they excluded subjects with 14 to 23 teeth remaining [24–26]. Studies that limited their assessment of periodontitis to measuring the PPD without assessment of CAL were excluded. The use of PPD alone can be a reversible indicator of periodontitis; i.e., periodontal treatment may reduce the PPD and thus underestimate the periodontitis prevalence [40, 41].

Most of the studies in the literature compared the performance of PRPs to FRPs in terms of accuracy, validity, and/or precision. However, there is no published evidence that compares the actual time, effort, and resources needed to conduct any of the PRPs compared to the FRPs. Also, the feasibility of applying some of the PRPs, such as the RSSM at 36, 42, or 84 sites, can be challenging in surveillance studies [4].

4.5. Review Implications

Including a wide age range, four periodontitis outcomes, and several disease thresholds make our findings more generalizable. We investigated the methodological factors that may impact the performance of PRPs which can guide the selection of protocols in future surveillance studies. In addition, our review highlights some of the limitations in the literature and methodological considerations that need to be addressed in future studies.

4.6. Future Directions

Some of the recent studies [42, 43], despite the fact that they were excluded due to the deficiency of their clinical data, have used promising approaches for the assessment of optimal PRP selection and the optimal case definitions. The optimal selection of PRPs was tested using the item response theory model, where they aimed to select a PRP that examines the least number of sites while retaining the highest accuracy compared to an FRP [43]. This study suggests using a PRP with only 12 sites, which is one of the PRPs with the least number of sites while still providing high accuracy; however, further testing of this approach and its feasibility is recommended. For the selection of the optimal periodontal disease thresholds, the receiver operating characteristic curve and the area under the curve should be used to evaluate the selected disease thresholds versus the optimal disease thresholds using PRPs rather than FRPs [42].

We reiterate the following recommendations for the use of PRPs for surveillance studies.

Before conducting a national survey using a PRP, pilot studies should first be conducted in a subset sample of a specific population with an adequate representation of subgroups [2, 8]. In these pilot studies, several accuracy measures should be used, as well as absolute bias and relative bias. If necessary, a correction factor for the PRP can be calculated to acquire valid estimates of disease prevalence in a specific population [7, 44].

The use of CAL measurements at ≥1 interproximal sites to define the periodontal disease prevalence increased the sensitivity and slightly decreased the specificity. However, the use of these measurements at ≥2 interproximal sites is preferable to exclude sites with CAL due to other etiologies, such as trauma from brushing, orthodontic treatments that may result in midbuccal or midlingual CAL, isolated sites with endodontic involvements, vertical root fractures, and external root resorption.

Objective measurements of medical conditions, such as an assessment of glycemic control using HbA1c, are needed to confirm the risk associated with diabetes mellitus. Also, both adjusted and unadjusted effects of risk determinants should be presented in order to compare the results of different studies.

5. Conclusions

Several factors influenced the accuracy and precision of PRPs and need to be considered before conducting surveillance studies; these include the age, prevalence, and severity of periodontitis in a specific population, type of PRP, total PRP sites, and use of a minimum number of sites with CAL in periodontitis case definitions. Based on our results, the PRPs with the highest accuracy and precision to assess periodontitis prevalence included full-mouth recordings at the following partial sites: MB-B-DL, MB-DL, MB-B-DB, MB-DB, 84 randomly selected sites (84 RSSM), and the RHM protocol at 6 sites per tooth (or 4 interproximal sites). Overall, the PRPs estimated the periodontitis extent and severity with a relatively high degree of precision. Risk factors associated with periodontitis resulted in only marginal information loss, regardless of the type of the PRP; however, this evidence is based on a small number of studies.

Data Availability

The data that support the findings of this study are available upon request from the corresponding author.

Conflicts of Interest

The authors have no conflicts of interest.

Supplementary Materials

Appendix Table A-1: list of excluded studies from the systematic review and the reasons for exclusion. Supplementary figures and tables which were referred to in the result section are listed in a separate document. (Supplementary Materials)

References

D. E. Lilienfeld, “Definitions of epidemiology,” American Journal of Epidemiology, vol. 107, no. 2, pp. 87–90, 1978.
View at: Publisher Site | Google Scholar
B. Holtfreter, J. M. Albandar, T. Dietrich et al., “Standards for reporting chronic periodontitis prevalence and severity in epidemiologic studies: proposed standards from the Joint EU/USA Periodontal Epidemiology Working Group,” Journal of Clinical Periodontology, vol. 42, no. 5, pp. 407–412, 2015.
View at: Publisher Site | Google Scholar
P. I. Eke, B. A. Dye, L. Wei et al., “Update on prevalence of periodontitis in adults in the United States: NHANES 2009 to 2012,” Journal of Periodontology, vol. 86, no. 5, pp. 611–622, 2015.
View at: Publisher Site | Google Scholar
J. D. Beck, D. J. Caplan, J. S. Preisser, and K. Moss, “Reducing the bias of probing depth and attachment level estimates using random partial-mouth recording,” Community Dentistry and Oral Epidemiology, vol. 34, no. 1, pp. 1–10, 2006.
View at: Publisher Site | Google Scholar
P. I. Eke, G. O. Thornton-Evans, L. Wei, W. S. Borgnakke, and B. A. Dye, “Accuracy of NHANES periodontal examination protocols,” Journal of Dental Research, vol. 89, no. 11, pp. 1208–1213, 2010.
View at: Publisher Site | Google Scholar
A. Kingman, E. Morrison, H. Löe, and J. Smith, “Systematic errors in estimating prevalence and severity of periodontal disease,” Journal of Periodontology, vol. 59, no. 11, pp. 707–713, 1988.
View at: Publisher Site | Google Scholar
C. Susin, A. Kingman, and J. M. Albandar, “Effect of partial recording protocols on estimates of prevalence of periodontal disease,” Journal of Periodontology, vol. 76, no. 2, pp. 262–267, 2005.
View at: Publisher Site | Google Scholar
A. Kingman, C. Susin, and J. M. Albandar, “Effect of partial recording protocols on severity estimates of periodontal disease,” Journal of Clinical Periodontology, vol. 35, no. 8, pp. 659–667, 2008.
View at: Publisher Site | Google Scholar
D. T. Tran, I. C. Gay, X. L. Du et al., “Partial‐mouth periodontal examination protocol for estimating periodontitis extent and severity in a US population,” Clinical and Experimental Dental Research, vol. 2, no. 1, pp. 73–79, 2016.
View at: Publisher Site | Google Scholar
D. T. Tran, I. Gay, X. L. Du et al., “Assessment of partial-mouth periodontal examination protocols for periodontitis surveillance,” Journal of Clinical Periodontology, vol. 41, no. 9, pp. 846–852, 2014.
View at: Publisher Site | Google Scholar
R. J. Hunt, “The efficiency of half-mouth examinations in estimating the prevalence of periodontal disease,” Journal of Dental Research, vol. 66, no. 5, pp. 1044–1048, 1987.
View at: Publisher Site | Google Scholar
R. J. Hunt and S. J. Fann, “Effect of examining half the teeth in a partial periodontal recording of older adults,” Journal of Dental Research, vol. 70, no. 10, pp. 1380–1385, 1991.
View at: Publisher Site | Google Scholar
A. A. Akinkugbe, V. M. Saraiya, J. S. Preisser, S. Offenbacher, and J. D. Beck, “Bias in estimating the cross-sectional smoking, alcohol, obesity and diabetes associations with moderate-severe periodontitis in the Atherosclerosis Risk in Communities study: comparison of full versus partial-mouth estimates,” Journal of Clinical Periodontology, vol. 42, no. 7, pp. 609–621, 2015.
View at: Publisher Site | Google Scholar
T. S. Alshihayb, E. A. Kaye, Y. Zhao, C. W. Leone, and B. Heaton, “The impact of periodontitis exposure misclassification bias from partial‐mouth measurements on association with diabetes and cardiovascular disease,” Journal of Clinical Periodontology, vol. 47, no. 00, pp. 1–9, 2020.
View at: Publisher Site | Google Scholar
D. T. Tran, I. Gay, X. L. Du et al., “Assessing periodontitis in populations: a systematic review of the validity of partial-mouth examination protocols,” Journal of Clinical Periodontology, vol. 40, no. 12, pp. 1064–1071, 2013.
View at: Publisher Site | Google Scholar
J. P. Salameh, P. M. Bossuyt, T. A. McGrath et al., “Preferred reporting items for systematic review and meta-analysis of diagnostic test accuracy studies (PRISMA-DTA): explanation, elaboration, and checklist,” BMJ, vol. 370, 2020.
View at: Publisher Site | Google Scholar
Y. Alawaji, A. Alshammari, R. Carvalho, N. Mostafa, and J. Aleksejuniene, “Accuracy of estimating periodontitis and its risk association using partial-mouth recordings for surveillance studies,” A systematic review and meta-analysis, INPLASY, 2021, https://inplasy.com/inplasy-2021-6-0032/.
View at: Google Scholar
R. Page and P. Eke, “Case definitions for use in population-based surveillance of periodontitis,” Journal of Periodontology, vol. 78, 2007.
View at: Publisher Site | Google Scholar
P. I. Eke, R. C. Page, L. Wei, G. Thornton-Evans, and R. J. Genco, “Update of the case definitions for population-based surveillance of periodontitis,” Journal of Periodontology, vol. 83, no. 12, pp. 1449–1454, 2012.
View at: Publisher Site | Google Scholar
Microsoft Corporation, “Microsoft Excel,” 2018, https://office.microsoft.com/excel.
View at: Google Scholar
P. F. Whiting, “QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies,” Annals of Internal Medicine, vol. 155, no. 8, p. 529, 2011.
View at: Publisher Site | Google Scholar
B. C. Wallace, I. Dahabreh, T. Trikalinos, J. Lau, P. Trow, and C. H. Schmid, “OpenMetaAnalyst, closing the gap between methodologist and end-Users: R as a computational back-end,” Journal of Statistical Software, vol. 49, no. 5, 2012.
View at: Publisher Site | Google Scholar
J. J. Deeks, J. P. T. Higgins, and D. G. Altman, Cochrane Handbook for Systematic Reviews of Interventions, John Wiley & Sons, London, England, 2021, https://training.cochrane.org/handbook Analysing data and undertaking meta-anlaysis.
M. Relvas, I. Tomás, F. Salazar, C. Velazco, J. Blanco, and P. Diz, “Reliability of partial-mouth recording systems to determine periodontal status: a pilot study in an adult Portuguese population,” Journal of Periodontology, vol. 85, no. 6, pp. e188–e197, 2014.
View at: Publisher Site | Google Scholar
Y. Chu and X. Ouyang, “Accuracy of partial-mouth examination protocols for extent and severity estimates of periodontitis: a study in a Chinese population with chronic periodontitis,” Journal of Periodontology, vol. 86, no. 3, pp. 406–417, 2015.
View at: Publisher Site | Google Scholar
M. V. Vettore, G. d. A. Lamarca, A. T. T. Leão, A. Sheiham, and M. d. C. Leal, “Partial recording protocols for periodontal disease assessment in epidemiological surveys,” Cadernos de Saúde Pública, vol. 23, no. 1, pp. 33–42, 2007.
View at: Publisher Site | Google Scholar
S. A. Dowsett, G. J. Eckert, and M. J. Kowolik, “The applicability of half-mouth examination to periodontal disease assessment in untreated adult populations,” Journal of Periodontology, vol. 73, no. 9, pp. 975–981, 2002.
View at: Publisher Site | Google Scholar
Y. N. Alawaji, N. Mostafa, R. M. Carvalho, A. Alshammari, and J. Aleksejuniene, “Accuracy and precision of using partial-mouth recordings to study the prevalence, extent and risk associations of untreated periodontitis,” The Saudi Dental Journal, vol. 34, no. 2, pp. 142–149, 2022.
View at: Publisher Site | Google Scholar
F. C. F. Teixeira, L. M. Leon, E. P. Gomes, A. M. N. Pedrao, A. d. Costa Pereira, and P. M. S. B. Francisco, “Comparative evaluation of indices and partial-mouth periodontal protocols for epidemiological surveys,” Journal of Dental Health, Oral Disorders & Therapy, vol. 11, no. 4, pp. 108–114, 2020.
View at: Publisher Site | Google Scholar
B. Heaton, P. Sharma, R. I. Garcia, and T. Dietrich, “Evaluating periodontal disease misclassification mechanisms under partial-mouth recording protocols,” Journal of Clinical Periodontology, vol. 45, no. 4, pp. 422–430, 2018.
View at: Publisher Site | Google Scholar
D. M. Agerholm and F. P. Ashley, “Clinical assessment of periodontitis in young adults - evaluation of probing depth and partial recording methods,” Community Dentistry and Oral Epidemiology, vol. 24, no. 1, pp. 56–61, 1996.
View at: Publisher Site | Google Scholar
J. S. Preisser, A. E. Sanders, and R. H. Lyles, “Differential misclassification of disease under partial-mouth sampling,” JDR Clinical & Translational Research, vol. 3, no. 4, pp. 388–394, 2018.
View at: Publisher Site | Google Scholar
D. Nelson, D. Holtzman, J. Bolen, and K. Mack, “Reliability and validity of measures from the behavioral risk factor surveillance system (BRFSS),” Soz Praventivmed, vol. 46, no. Suppl 1, pp. S3–S42, 2001.
View at: Google Scholar
S. Tenny and M. R. Hoffman, Prevalence, NCBI Books, Bethesda, Maryland, USA, 2021.
I. L. C. Chapple and R. Genco, “Workshop working group 2 of the joint E. Diabetes and periodontal diseases: consensus report of the Joint EFP/AAP workshop on periodontitis and systemic diseases,” Journal of Clinical Periodontology, vol. 40, 2013.
View at: Publisher Site | Google Scholar
J. M. Albandar, C. Susin, and F. J. Hughes, “Manifestations of systemic diseases and conditions that affect the periodontal attachment apparatus: case definitions and diagnostic considerations,” Journal of Periodontology, vol. 89, pp. S183–S203, 2018.
View at: Publisher Site | Google Scholar
E. Lalla, I. B. Lamster, and A. M. Schmidt, “Enhanced interaction of advanced glycation end products with their cellular receptor RAGE: implications for the pathogenesis of accelerated periodontal disease in diabetes,” Annals of Periodontology, vol. 3, no. 1, pp. 13–19, 1998.
View at: Publisher Site | Google Scholar
K. A. Eaton, S. Duffy, G. S. Griffiths, M. S. Gilthorpe, and N. W. Johnson, “The influence of partial and full mouth recordings on estimates of prevalence and extent of lifetime cumulative attachment loss: a study in a population of young male military recruits,” Journal of Periodontology, vol. 72, no. 2, pp. 140–145, 2001.
View at: Publisher Site | Google Scholar
F. Romano, S. Perotto, A. Castiglione, and M. Aimetti, “Prevalence of periodontitis: misclassification, under-recognition or over-diagnosis using partial and full-mouth periodontal examination protocols,” Acta Odontologica Scandinavica, vol. 77, no. 3, pp. 189–196, 2019.
View at: Publisher Site | Google Scholar
R. Leroy, K. Eaton, and A. Savage, “Methodological issues in epidemiological studies of periodontitis - how can it be improved?” BMC Oral Health, vol. 10, no. 8, 2010.
View at: Publisher Site | Google Scholar
E. D. Beltrán-Aguilar, P. I. Eke, G. Thornton-Evans, and P. E. Petersen, “Recording and surveillance systems for periodontal diseases,” Periodontology, vol. 60, no. 1, pp. 40–53, 2012.
View at: Publisher Site | Google Scholar
J. Botelho, V. Machado, L. Proença, and J. J. Mendes, “The 2018 periodontitis case definition improves accuracy performance of full-mouth partial diagnostic protocols,” Scientific Reports, vol. 10, no. 1, p. 7093, 2020.
View at: Publisher Site | Google Scholar
Y. Nomura, T. Morozumi, M. Fukuda et al., “Optimal examination sites for periodontal disease evaluation: applying the item response theory graded response model,” Journal of Clinical Medicine, vol. 9, no. 11, pp. 1–17, 2020.
View at: Publisher Site | Google Scholar
B. A. Dye, “Global periodontal disease epidemiology: global periodontal disease epidemiology,” Periodontology, vol. 58, no. 1, pp. 10–25, 2000.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2022 Yasmine N. Alawaji et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

363

Downloads

548

Citations