Interrater Reliability of Motion Palpation in the Thoracic Spine

Walker, Bruce F.; Koppenhaver, Shane L.; Stomski, Norman J.; Hebert, Jeffrey J.

doi:https://doi.org/10.1155/2015/815407

Evidence-Based Complementary and Alternative Medicine

On this page

Abstract Introduction Methods Results Discussion Conclusion Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 815407 | https://doi.org/10.1155/2015/815407

Interrater Reliability of Motion Palpation in the Thoracic Spine

Bruce F. Walker,¹Shane L. Koppenhaver,²Norman J. Stomski,¹and Jeffrey J. Hebert³

Academic Editor: Lise Hestbaek

Received18 Mar 2015

Accepted25 May 2015

Published11 Jun 2015

Abstract

Introduction. Manual therapists commonly use assessments of intervertebral motion to determine the need for spinal manipulation, but the reliability of these procedures demonstrates conflicting results. The objectives of this study were to investigate the interrater reliability of thoracic spine motion palpation for perceived joint restriction and pain. Methods. Twenty-five participants between the ages of 18 and 70, with or without mid-back pain, were enrolled. Two raters motion palpated marked T5–T12 levels using two methods (standardised and pragmatic) and noted any restricted or painful segments. We calculated agreement between two raters by generating raw agreement percentages and Kappa coefficients with 95% confidence intervals. Results. There was poor to low level of agreement between the raters for both joint stiffness and pain localization using both pragmatic and standardized approaches. The results did not improve significantly when we conducted a post hoc analysis where three spinal levels were collapsed as one and right and left sides were also combined. Conclusions. The results for interrater reliability were poor for motion restriction and pain. These findings may have unfavourable implications for all manual therapists who use motion palpation to select patients appropriate for spinal manipulation.

1. Introduction

Assessment of intervertebral motion is considered a fundamental component of the clinical examination by many manual therapy providers. In addition to a clinical history such assessment is often used to identify primary areas of joint restriction in patients with spinal pain. Additionally, assessment of intervertebral motion is commonly performed in patients with primary complaints of other regions (e.g., shoulder, hip pain) in order to identify changes in movement that may be related to such complaints [1–3]. Restricted intervertebral motion has classically been considered a key indicator of spinal dysfunction by many chiropractors [4]. Moreover, a recent survey among Australian physiotherapists found that the great majority (98%) of manual therapy physiotherapists use manual assessments of spinal motion during their exam and base treatment decisions on their findings [5].

Establishing reliability of an examination procedure is generally considered a prerequisite for its validity and clinical utility [6, 7]. In the context of this study reliability is defined as the degree of stability exhibited when a measurement is repeated under identical conditions [8]. The reliability of intervertebral motion assessment has been extensively studied and systematically reviewed for the cervical and lumbar regions [9–12]. Although reliability estimates of intervertebral motion assessment vary widely, systematic reviews report substantial methodological shortcomings with the majority of these studies [10–12]. The latest systematic review focusing solely on reliability studies of intervertebral motion assessment of the lumbar and cervical spine [12] found that only four out of 19 included studies were performed in participants with musculoskeletal complaints and that only three of the 19 studies included examiners that were blinded to each other’s assessments. Although inconclusive due to these limitations, the majority of studies, especially those of higher quality [9, 12], report poor reliability, often no better than chance [10–12].

Few original studies have specifically investigated intervertebral motion assessment of the thoracic spine and these have provided inconsistent evidence regarding the reliability of motion palpation [13–16]. However, a growing body of research [17] and clinical commentary [18] supports the importance of including thoracic spine function in the evaluation of people with neck and shoulder complaints. Specifically, recent studies suggest that the use of spinal manipulation to the thoracic spine may be beneficial to patients with neck pain [19–23] and shoulder impingement syndrome [24–26]. Since manual therapy practitioners commonly use assessments of intervertebral motion to determine what specific segment or region of the thoracic spine to apply spinal manipulation, there remains a need to investigate the reliability of such procedures. Accordingly, we investigated the interrater reliability of assessments of thoracic spine intervertebral motion and pain in a sample that included participants with both primary complaints of thoracic pain and those without primary complaints of thoracic pain. Additionally, we evaluated reliability of assessments both when experienced examiners applied pragmatic and highly standardized approaches.

2. Methods

2.1. Participants

Twenty-five volunteers between the ages of 18 and 70, with or without mid-back pain, were recruited from a university campus. Participants were excluded if they had fibromyalgia, rheumatoid arthritis, ankylosing spondylitis, or other inflammatory spinal disease or could not tolerate the physical examination. The study protocol was approved by the Murdoch University Human Research Ethics Committee, and all participants provided written informed consent prior to enrolment.

2.2. Examiners

Two experienced chiropractors (raters A and B) participated as examiners for the study. Both had current academic appointments, came from a clinical background, and had taught motion palpation in an academic setting. Each examiner had their own style of motion palpation but was also familiar with other standardised techniques. We assessed the reliability of using both their own pragmatic approach and a standardised technique of intervertebral motion assessment.

2.3. Examination Procedures

Participants were examined by both raters twice, once with their own pragmatic motion palpation method and once with a standardised method of motion palpation as described by Bergman and Peterson [1]. During the pragmatic procedures, examiners used the method they would normally use to assess intervertebral motion in a clinical setting. The standardized procedure consisted of assessing passive physiologic motion of flexion, extension, bilateral side bending, and bilateral rotation, followed by segmental intervertebral mobility testing. Each rater was blinded to whether or not each participant had back pain and to the findings of the other rater. In addition the order in which participants were examined by each rater was changed on the second round to minimise any memory of findings. Participants were seated on a fixed examination table separated from each other so that the raters could not hear each other’s conversation. The examiner was free to move into a position comfortable for them to examine the participant.

2.3.1. Nonstandardized Assessment

Participants were seated on an examination table separated from each other so that the raters could not hear each other’s conversation. A third experienced examiner labelled the spinous processes of each participant from the T5 to T12 spinal levels in order to eliminate potential error in identifying the correct spinal level. The raters conducted their motion palpation assessment (Figure 1) and then moved on to the next participant. Rater A was the first to commence using his own usual approach. Then rater B followed and examined the same 25 participants.

2.3.2. Standardised Assessment

Following the nonstandardised assessment, we conducted a 30-minute training session, followed by a practice series involving 4 student volunteers to demonstrate and standardize the motion palpation approach [1]. Once both raters were satisfied that they were competent in the new procedure, the testing session was repeated using this standardised motion palpation method.

First, the participants were seated on a chair with arms by their sides, the mid back skin exposed, and the marks on the spinal processes visible. Raters were asked to motion palpate the marked T5–T12 levels and note any restricted or painful segments and whether it was on the right or the left. To simulate clinical practice the rater was free to ask the participants if “it hurts” during their segmental examination and pain was recorded if they received an affirmative answer. A restricted segment was defined as having a loss of joint play [27] which was perceived as hypomobile such that the examiner would consider it appropriate for manipulation.

2.4. Data Analysis

Data management and analyses were performed using the Statistical Package for the Social Sciences version 17 software (SPSS, Chicago, IL). Descriptive statistics, including estimates of central tendency and variability, were calculated to describe the sample of participants.

Interrater reliability of motion assessment was estimated separately for judgments of motion restriction (yes/no) and pain with motion (yes/no), each during the nonstandardized (pragmatic) approach and the standardized approach. We calculated agreement between two raters by generating raw agreement percentages and Kappa coefficients with 95% confidence intervals. Kappa statistics represent the proportion of agreement greater than that expected by chance and are traditionally interpreted as representing excellent agreement above 0.80, substantial agreement between 0.61 and 0.80, moderate agreement between 0.41 and 0.60, fair agreement between 0.21 and 0.40, and slight agreement between 0.00 and 0.20 [28]. Negative Kappa values indicate agreement less than chance. When interpreting Kappa coefficients, however, it is important to understand that both bias and prevalence have potential to influence the agreement estimates. Bias occurs when there is disagreement in the proportion of yes and no judgments between each rater. As bias increases, chance agreement decreases, resulting in inflation of the Kappa coefficient. With large differences in the prevalence of yes versus no judgments, there is increased chance agreement, which lowers the Kappa coefficient. To account for these potential sources of error and enhance the interpretation of the Kappa statistics, we additionally calculated indices of prevalence and bias as well as prevalence-adjusted and bias-adjusted Kappa coefficients (PABAK) [29, 30].

3. Results

The demographic and clinical characteristics of the 25 participants are listed in Table 1. Five participants had mid-back pain on the day of assessment and 18 had previous mid-back pain. Interexaminer agreement estimates are listed in Table 2. Kappa statistics for judgments of segmental restriction ranged between −0.27 and 0.36 depending on the spinal level. Point estimates for level of agreement using the nonstandardized (pragmatic) approach were generally worse than would be expected by chance alone. Point estimates for level of agreement using the standardized approach were generally better than would be expected by chance alone, although the 95% CI of all but one estimate (T6–8) included zero.

Findings regarding agreement of segmental pain were similar. Kappa statistics ranged between −0.38 and 0.32 depending on the spinal level. Point estimates for level of agreement using the nonstandardized (pragmatic) approach were generally worse than would be expected by chance alone. Point estimates for level of agreement using the standardized approach were generally better than would be expected by chance, although the 95% CI of all estimates included zero.

4. Discussion

This was the first study to evaluate the interrater reliability of motion palpation of the thoracic spine both when experienced examiners were free to use their own nonstandardized assessment methodology and when assessments were highly standardized. Regardless of the standardization condition, reliability for pain and motion restriction results was poor and in many cases was not better than chance.

It can be argued that it may be more challenging to determine intersegmental motion of the thoracic spine using motion palpation compared to the cervical and lumbar regions due to the inherent reduced thoracic intersegmental movement due to the attachment of the rib cage. However, this is speculative and there is no evidence to substantiate this notion. Although assessment of motion palpation of the lumbar and cervical spine has been exhaustively studied, the few studies that have investigated intervertebral motion assessment of the thoracic spine have reported conflicting results [13–16]. Using methodology very similar to that of the current study, Christensen et al. [14] found interexaminer reliability of motion palpation of the thoracic spine that was in-line with our findings of essentially no better than chance with Kappa (95% CI) = 0.00 . Reliability was improved slightly when they allowed for “expanded agreement” in which they considered examiners to agree if they were within one spinal level of each other, but still statistically not different than chance (Kappa (95% CI) = 0.22 ). Also using very similar methodology of the current study, Brismée et al. [13] found slightly better reliability ( = 0.27 to 0.65) depending on the examining pair. Lastly, using a different methodology, Cooperstein et al. [15] assessed prone participants for the most restricted thoracic vertebral segment and then measured it as distance from S1. Interexaminer agreement overall was poor [ICC (95% CI) = 0.31 ] except when examiners reported being “very confident” about their results [ICC (95% CI) = 0.83 ].

The lack of reliability of pain assessment in the current study was unanticipated. Previous studies in the lumbar and cervical spine have generally found that assessments of pain provocation during intervertebral motion assessments are much more reliable than assessments of limited mobility [10, 11]. In the current study, assessments of segmental pain were not consistently more reliable than assessments of segmental motion restriction. In the single previous study to evaluate reliability of segmental pain assessment in the thoracic spine, Christensen et al. [14] found interexaminer reliability of zygapophyseal joint tenderness to be low to moderate (Kappa = 0.38) when using strict agreement criteria and good (Kappa = 0.67–0.70) when they considered examiners to agree if they were within one spinal level of each other. Although the reason for our differing findings is unknown, they might simply be due to methodological differences between the current and previous studies.

Establishing reliability of an examination procedure is generally considered a prerequisite for its validity and clinical utility [6, 7]. If this is the case, then assessment procedures demonstrated to be unreliable should not be useful clinically. However, although no studies to our knowledge have evaluated the validity of thoracic motion palpation, numerous studies have evaluated validity of motion palpation in the cervical and lumbar spine with mixed results [31–34]. In a recent study in the lumbar spine, Koppenhaver et al. [34] found essentially no correlation between manual assessment of segmental stiffness and a criterion measure using spinal indentation. Conversely, Humphreys et al. [33] found that manual practitioners were able to identify the level of restricted cervical motion in individuals with congenitally blocked vertebrae. However, the question arises whether congenitally blocked vertebrae would have a similar end-feel to that of a notionally restricted segment. Moreover, some research in the lumbar spine suggests that assessment of intervertebral motion is helpful in making treatment decisions. Specifically Fritz et al. [32] performed secondary analyses of data from a randomized controlled trial and found that patients who were judged as “hypermobile” did best with lumbar stabilization exercises and those that were judged as “hypomobile” did best with spinal manipulation treatment. Such findings suggest that manual assessments of spinal mobility may be sufficiently reliable to be a useful component of the clinical examination. Unlike the current study, however, spinal mobility was generally classified across the entire lumbar spine rather than segment by segment.

Previous research has reported improved reliability when more broadly categorizing a region of the spine than when judging mobility at a specific spinal level [10] or when considering agreement to occur when within one spinal level [14]. To evaluate the impact of this in the current study, we performed additional post hoc analysis in which we collapsed the data for levels in the following way: right and left sides for each vertebral level were collapsed and then the data reanalyzed and similarly we further collapsed vertebral level to 3 contiguous vertebrae and then also reanalyzed the data. The rationale for collapsing the side of involvement and level of involvement was to allow for the contingency that the rater was palpating some functional loss of joint play at a specific level which may have been caused by similar stiffness from the contralateral side or from a level above or below. This further analysis did not show an improvement in agreement between raters.

Study Limitations. This study had several limitations. The sample size was under the number contained in recommendations [7], which may have resulted in an underestimation of the Kappa values. Nonetheless, all Kappa values reported in this study were consistently low and the confidence intervals commonly crossed zero, which suggests that the results are unlikely to appreciably change with an increased sample size. The examiner training was brief and appeared to be adequate, but more extensive training may have resulted in a higher level of agreement. Our outcome measures were perceived stiffness and subjective pain/tenderness, and whether these measures remained constant in individuals between examinations is unclear. Finally, if a rater put their finger on a marked line then the level was left to the interpretation of the recorder; however, as the results did not change when levels were collapsed this is unlikely to have provided any bias.

5. Conclusion

Regardless of the degree of standardization, interrater reliability of motion palpation of the thoracic spine for identifying pain and motion restriction performed by experienced examiners was poor and often not better than chance. These findings question the continued use of motion palpation as part of the clinical assessment as an isolated tool to detect loss of intersegmental joint play.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

The study group wishes to thank chiropractors Brian Nook and Barrett Losco for agreeing to act as raters, the chiropractic students who helped conduct the study, and the 25 participants who gave up their time to be involved in the study. The opinions or assertions contained herein are the private views of the authors and are not to be construed as official or as reflecting the views of the United States of America Departments of the Army or Defense.

References

T. F. Bergman and D. H. Peterson, Chiropractic Technique: Principles and Procedures, Mosby, St. Louis, Mo, USA, 3rd edition, 2010.
P. E. Greenman, Principles of Manual Medicine, Lippincott Williams & Wilkins, Baltimore, Md, USA, 1996.
G. Maitland, Maitland's Vertebral Manipulation, Butterworth-Heinemann, 6th edition, 2000.
C. N. R. Henderson, “The basis for spinal manipulation: chiropractic perspective of indications and theory,” Journal of Electromyography and Kinesiology, vol. 22, no. 5, pp. 632–642, 2012.
View at: Publisher Site | Google Scholar
J. H. Abbott, T. W. Flynn, J. M. Fritz, W. A. Hing, D. Reid, and J. M. Whitman, “Manual physical assessment of spinal segmental motion: intent and validity,” Manual Therapy, vol. 14, no. 1, pp. 36–44, 2009.
View at: Publisher Site | Google Scholar
L. G. Portney and M. P. Watkins, Foundations of Clinical Research: Applications to Practice, Pearson Prentice Hall, Upper Saddle River, NJ, USA, 3rd edition, 2008.
D. Streiner and G. Norman, Health Measurement Scales: A Practical Guide to Their Development and Use, Oxford University Press, New York, NY, USA, 2003.
M. Porta, Ed., A Dictionary of Epidemiology, Oxford University Press, Oxford, UK, 5th edition, 2008.
M. Schneider, R. Erhard, J. Brach, W. Tellin, F. Imbarlina, and A. Delitto, “Spinal palpation for lumbar segmental mobility and pain provocation: an interexaminer reliability study,” Journal of Manipulative and Physiological Therapeutics, vol. 31, no. 6, pp. 465–473, 2008.
View at: Publisher Site | Google Scholar
M. A. Seffinger, W. I. Najm, S. I. Mishra et al., “Reliability of spinal palpation for diagnosis of back and neck pain: a systematic review of the literature,” Spine, vol. 29, no. 19, pp. E413–E425, 2004.
View at: Publisher Site | Google Scholar
M. J. Stochkendahl, H. W. Christensen, J. Hartvigsen et al., “Manual examination of the spine: a systematic critical literature review of reproducibility,” Journal of Manipulative and Physiological Therapeutics, vol. 29, no. 6, pp. 475–485, 2006.
View at: Publisher Site | Google Scholar
E. Van Trijffel, Q. Anderegg, P. M. M. Bossuyt, and C. Lucas, “Inter-examiner reliability of passive assessment of intervertebral motion in the cervical and lumbar spine: a systematic review,” Manual Therapy, vol. 10, no. 4, pp. 256–269, 2005.
View at: Publisher Site | Google Scholar
J.-M. Brismée, D. Gipson, D. Ivie et al., “Interrater reliability of a passive physiological intervertebral motion test in the mid-thoracic spine,” Journal of Manipulative and Physiological Therapeutics, vol. 29, no. 5, pp. 368–373, 2006.
View at: Publisher Site | Google Scholar
H. W. Christensen, W. Vach, K. Vach et al., “Palpation of the upper thoracic spine: an observer reliability study,” Journal of Manipulative and Physiological Therapeutics, vol. 25, no. 5, pp. 285–292, 2002.
View at: Publisher Site | Google Scholar
R. Cooperstein, M. Haneline, and M. Young, “Interexaminer reliability of thoracic motion palpation using confidence ratings and continuous analysis,” Journal of Chiropractic Medicine, vol. 9, no. 3, pp. 99–106, 2010.
View at: Publisher Site | Google Scholar
L. Potter, C. McCarthy, and J. Oldham, “Intraexaminer reliability of identifying a dysfunctional segment in the thoracic and lumbar spine,” Journal of Manipulative and Physiological Therapeutics, vol. 29, no. 3, pp. 203–207, 2006.
View at: Publisher Site | Google Scholar
G. Bronfort, M. Haas, R. Evans, B. Leininger, and J. Triano, “Effectiveness of manual therapies: the UK evidence report,” Chiropractic and Osteopathy, vol. 18, article 3, 2010.
View at: Publisher Site | Google Scholar
D. G. Sueki, J. A. Cleland, and R. S. Wainner, “A regional interdependence model of musculoskeletal dysfunction: research, mechanisms, and clinical implications,” Journal of Manual and Manipulative Therapy, vol. 21, no. 2, pp. 90–102, 2013.
View at: Publisher Site | Google Scholar
J. A. Cleland, P. Glynn, J. M. Whitman, S. L. Eberhart, C. MacDonald, and J. D. Childs, “Short-term effects of thrust versus nonthrust mobilization/manipulation directed at the thoracic spine in patients with neck pain: a randomized clinical trial,” Physical Therapy, vol. 87, no. 4, pp. 431–440, 2007.
View at: Publisher Site | Google Scholar
J. A. Cleland, M. J. D. Childs, M. McRae, J. A. Palmer, and T. Stowell, “Immediate effects of thoracic manipulation in patients with neck pain: a randomized clinical trial,” Manual Therapy, vol. 10, no. 2, pp. 127–135, 2005.
View at: Publisher Site | Google Scholar
J. González-Iglesias, C. Fernández-De-Las-Peñas, J. A. Cleland, and M. D. R. Gutiérrez-Vega, “Thoracic spine manipulation for the management of patients with neck pain: a randomized clinical trial,” Journal of Orthopaedic and Sports Physical Therapy, vol. 39, no. 1, pp. 20–27, 2009.
View at: Publisher Site | Google Scholar
J. González-Iglesias, C. Fernández-de-las-Peñas, J. A. Cleland, F. Alburquerque-Sendín, L. Palomeque-del-Cerro, and R. Méndez-Sánchez, “Inclusion of thoracic spine thrust manipulation into an electro-therapy/thermal program for the management of patients with acute mechanical neck pain: a randomized clinical trial,” Manual Therapy, vol. 14, no. 3, pp. 306–313, 2009.
View at: Publisher Site | Google Scholar
A. Savolainen, J. Ahlberg, H. Nummila, and M. Nissinen, “Active or passive treatment for neck-shoulder pain in occupational health care? A randomized controlled trial,” Occupational Medicine, vol. 54, no. 6, pp. 422–424, 2004.
View at: Publisher Site | Google Scholar
G. J. D. Bergman, J. C. Winters, K. H. Groenier et al., “Manipulative therapy in addition to usual medical care for patients with shoulder dysfunction and pain: a randomized, controlled trial,” Annals of Internal Medicine, vol. 141, no. 6, pp. 432–439, 2004.
View at: Google Scholar
R. E. Boyles, B. M. Ritland, B. M. Miracle et al., “The short-term effects of thoracic spine thrust manipulation on patients with shoulder impingement syndrome,” Manual Therapy, vol. 14, no. 4, pp. 375–380, 2009.
View at: Publisher Site | Google Scholar
S. Muth, M. F. Barbe, R. Lauer, and P. W. Mcclure, “The effects of thoracic spine manipulation in subjects with signs of rotator cuff tendinopathy,” Journal of Orthopaedic and Sports Physical Therapy, vol. 42, no. 12, pp. 1005–1016, 2012.
View at: Publisher Site | Google Scholar
S. Haldeman, Principles and Practices of Chiropractic, McGraw-Hill, New York, NY, USA, 3rd edition, 2004.
J. R. Landis and G. G. Koch, “The measurement of observer agreement for categorical data,” Biometrics, vol. 33, no. 1, pp. 159–174, 1977.
View at: Publisher Site | Google Scholar
T. Byrt, J. Bishop, and J. B. Carlin, “Bias, prevalence and kappa,” Journal of Clinical Epidemiology, vol. 46, no. 5, pp. 423–429, 1993.
View at: Publisher Site | Google Scholar
J. Sim and C. C. Wright, “The kappa statistic in reliability studies: use, interpretation, and sample size requirements,” Physical Therapy, vol. 85, no. 3, pp. 257–268, 2005.
View at: Google Scholar
J. H. Abbott, B. McCane, P. Herbison, G. Moginie, C. Chapple, and T. Hogarty, “Lumbar segmental instability: a criterion-related validity study of manual therapy assessment,” BMC Musculoskeletal Disorders, vol. 6, no. 1, article 56, 2005.
View at: Publisher Site | Google Scholar
J. M. Fritz, J. M. Whitman, and J. D. Childs, “Lumbar spine segmental mobility assessment: an examination of validity for determining intervention strategies in patients with low back pain,” Archives of Physical Medicine and Rehabilitation, vol. 86, no. 9, pp. 1745–1752, 2005.
View at: Publisher Site | Google Scholar
B. K. Humphreys, M. Delahaye, and C. K. Peterson, “An investigation into the validity of cervical spine motion palpation using subjects with congenital block vertebrae as a 'gold standard',” BMC Musculoskeletal Disorders, vol. 5, no. 1, article 19, 2004.
View at: Publisher Site | Google Scholar
S. L. Koppenhaver, J. J. Hebert, G. N. Kawchuk et al., “Criterion validity of manual assessment of spinal stiffness,” Manual Therapy, vol. 19, no. 6, pp. 589–594, 2014.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2015 Bruce F. Walker et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

6113

Downloads

1838

Citations