Table of Contents Author Guidelines Submit a Manuscript
Pain Research and Management
Volume 18, Issue 6, Pages e124-e128
Original Article

Establishing Intra- and Inter-Rater Agreement of the Face, Legs, Activity, Cry, Consolability Scale for Evaluating Pain in Toddlers During Immunization

Rebecca J Gomez,1 Nick Barrowman,1 Sonja Elia,2 Elizabeth Manias,3 Jenny Royle,2 and Denise Harrison1,3,4,5

1Children’s Hospital of Eastern Ontario and the Children’s Hospital of Eastern Ontario Research Institute, Ottawa, Ontario, Canada
2Royal Children’s Hospital, Melbourne, Australia
3University of Melbourne, Victoria, Australia
4University of Ottawa, Faculty of Health Sciences, Ottawa, Ontario, Canada
5Murdoch Children’s Research Institute, Melbourne, Australia

Copyright © 2013 Hindawi Publishing Corporation. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


BACKGROUND: The Face, Legs, Activity, Cry, Consolability (FLACC) scale is a five-item tool that was developed to assess postoperative pain in young children. The tool is frequently used as an outcome measure in studies investigating acute procedural pain in young children; however, there are limited published psychometric data in this context.

OBJECTIVE: To establish inter-rater and intrarater agreement of the FLACC scale in toddlers during immunization.

METHODS: Participants comprised a convenience sample of toddlers recruited from an immunization drop-in service, who were part of a larger pilot randomized controlled trial. Toddlers were video- and audiotaped during immunization procedures. The first rater scored each video twice in random order over a period of three weeks (intrarater agreement), while the second rater scored each video once and was blinded to the first rater’s scores (inter-rater agreement). The FLACC scale was scored at four time-points throughout the procedure. Intraclass correlation coefficients were used to assess agreement of the FLACC scale.

RESULTS: Thirty toddlers between 12 and 18 months of age were recruited, and video data were available for 29. Intrarater agreement coefficients were 0.88 at baseline, 0.97 at insertion of first needle, and 0.80 and 0.81 at 15 s and 30 s following the final injection, respectively. Inter-rater coefficients were 0.40 at baseline, 0.95 at insertion of first needle, and 0.81 and 0.78 at 15 s and 30 s following the final injection, respectively.

CONCLUSIONS: The FLACC scale has sufficient agreement in assessing pain in toddlers during immunizations, especially during the most painful periods of the procedure.