Teamwork Assessment Tools in Modern Surgical Practice: A Systematic Review

Table 2

Sources of validation evidence for teamwork assessment tools in surgery.

Study	Assessment tool name	Method of validation	Participants	Types of validity established
Sevdalis et al. [11]	OTAS	Assessment of teamwork during surgical procedures	Surgical trainees, human factors experts, and psychologists	Construct
Hull et al. [12]	OTAS	Content validity metric scoring by expert panel performing surgical procedures	Expert surgeons, nurses, anaesthetists supervisors, anaesthetists, and scrub nurses	Content
Yule et al. [13]	NOTSS	Structured interviews regarding difficult nonroutine cases	Consultant surgeons	Face
Crossley et al. [15]	NOTSS	Assessment of NTS during surgical procedures	Surgical trainees, surgical care practitioners, scrub nurses, and anaesthetists	Concurrent
Beard et al. [14]	NOTSS	Assessment of trainees performing surgical procedures	Surgical trainees, clinical supervisors, anaesthetists, and scrub nurses	Construct and content
Mishra et al. [16]	NOTECHS	Assessment of NTS during laparoscopic cholecystectomies	Surgical trainees, nurses, and anaesthetists	Concurrent, convergent, face, content, and construct
Fletcher et al. [17]	ANTS	Assessment of NTS observed in 8 clinical scenario videos	Consultant anaesthetists	Content
Violato et al. [18]	MSF	Assessment of surgeons using MSF	Surgeons from various specialties and their nominated colleagues	Content and face
Paisley et al. [20]	EBSTAF	Assessment of trainees before and after 1 year of training	Surgical trainees (SHO)	Construct
Mitchell et al. [22]	SPLINTS	Assessment of scrub practitioners in 7 scenarios	Scrub practitioners	Content

OTAS, Observational Teamwork Assessment for Surgery; NOTSS, Nontechnical Skills for Surgeons; NOTECHS, Oxford
Nontechnical Skills; ANTS, Anaesthetists’ Nontechnical Skills; MSF, Multisource Feedback; EBSTAF, Edinburgh
Basic Surgical Training Assessment Form; SPLINTS, Scrub Practitioners’ List of Intraoperative Nontechnical Skills.