Table 2: Test-retest reliability and validity of Incidents of Harm Questionnaire.

Response ( 𝑁 ) 𝑁 with agreementValid 𝑁 Analysis 𝑃 value

Test-retest reliabilityTime 1Time 2
Incident occurred (yes/no)yes = 4yes = 43838Kappa = 1.0<0.01
no = 34no = 34
Type of incident 38 38percent agreement = 100%

Validity: medical chart (only incidents with medical visit, 𝑛 = 1 5 )CaregiverMedical chart
Incident occurred (yes/no)yes = 15yes = 151515Kappa = 1.0<0.01
no = 0no = 0
Type of incident 3 6percent agreement = 50%

Validity: caregiver daily logPhoneLog
Incident occurred (yes/no)yes = 8yes = 83636Kappa = 1.0<0.01
no = 28no = 28
Type of incident 36 36percent agreement = 100%