Abstract
Background. The proper implementation of cardiopulmonary resuscitation (CPR) is crucial in saving patients. Purpose. This study was aimed at evaluating the difference in educating nursing students on CPR when using the traditional simulation training with a mannequin versus a more novel serious game training on the smartphone platform. Methods. This randomized control trial was conducted in 2018-2019. Through purposive sampling, 56 nursing students were selected and randomly assigned to three groups: a simulation-based CPR training, CPR training using a serious game on the smartphone platform, and a control group that received no CPR training. Each student was evaluated pre- and posttraining on CPR knowledge and skill. Results. Both the simulation and serious game training groups increased CPR abilities two weeks after training. The control group did not show improvement in skill or knowledge of CPR. The simulation and serious game intervention groups demonstrated better scores on the knowledge questionnaire and on the CPR skill demonstration in comparison to the control group. However, the simulation group and the serious game group showed no significant difference in knowledge ( vs. ; ) or CPR skill demonstration ( vs. ; ). The overall scores for CPR knowledge did not meet minimum expectations (70% score) in either the simulation (47.75%) or serious game (38.85%) group. However, both groups demonstrated adequate CPR skill on demonstration (simulation 87.64% and serious game 83.06%). Conclusions. Both the simulation and serious game training groups were found to increase CPR skill. CPR training would likely benefit from a multimodal approach to education.
1. Background
Cardiac arrest (CA) is one of the most common causes of mortality and morbidity throughout the world. In North America and Europe, the annual incidence of sudden CA is approximately 50 to 100 per 100,000 in the general population [1]. Evidence shows that despite advocacy to improve CA treatment in recent years, overall survival rates following CA remain low [2]. Immediate initiation of cardiopulmonary resuscitation (CPR) is necessary to preserve and resuscitate the heart and brain [3]. The International Liaison Committee on Resuscitation that describes data on systems of care and outcomes following out-of-hospital cardiac arrest (OHCA) from nine national and seven regional registries across the world reported that the provision of bystander CPR was 19.1-79.0% in all registries. Survival to hospital discharge or 30-day survival after emergency medical service-treated OHCA was 3.1-20.4% across all registries [4].
Studies show that the CA and CPR knowledge in nursing and medical students needs to be improved [5, 6]. So the European Resuscitation Council promotes a guidance note to improve CPR knowledge among healthcare students [7]. Studies have pointed positive impact of using new training methods [8, 9]. Researchers suggest that new and alternative methods to improve CPR knowledge and skill among healthcare students could be useful [5, 6, 10]. The success rate of CPR depends on appropriate and effective training. Currently the most popular form of CPR training involves a model of theoretical introduction and individual mannequin-based simulation procedural training. This allows the learner to engage actively in their learning process and practice patient care, in a controlled and safe environment. Mannequin-based simulation training has been determined to be effective in training nursing students and medical students [11–13].
With increasing computer literacy, online learning and gaming technology for education have increased in popularity [14]. Serious games or applied games are virtually based games designed with a primary purpose other than pure entertainment. Serious game development and implementation for medical education are a growing domain which attempts to deliver affordable, accessible, and usable interactive virtual learning, supporting applications for education [15, 16]. The use of serious games and virtual patients engages learners and avoids the risks associated with practicing on real patients. Serious games provide flexible learning, enhance learning outcomes, and improve collaboration across participants [10]. Theoretical benefits of serious games in medical education include increasing availability in remote settings, providing use at a flexible time for the user, and the opportunity for the program or game itself to tailor the educational material to match the learner’s level of skill [17]. Preliminary evidence suggests the effectiveness of serious games and virtual patient interventions in medical education [15, 18, 19]. More specifically, virtual game learning has been rated highly by nursing students with students reporting successful skill acquisition [20].
The use of serious games to provide CPR training includes a virtual emergency scenario where the learner is cued to save the life of a victim requiring CPR. CPR training using the serious game platform has shown feasibility, popularity, increased student concentration, self-efficacy, and a higher level of preparedness in students receiving the game training [21, 22].
While research exists noting the relative advantages of both simulation and serious game training methods, to our knowledge, no research directly compares the two. This study was aimed at estimating the effect of a simulation-based CPR training using a mannequin in comparison with serious game training on the smartphone platform in terms of learning outcomes among nursing students. We hypothesized that the knowledge and skills related to CPR performance would be significantly improved in the serious game group or the simulator group.
2. Methods
2.1. Study Design
This randomized control trial was conducted from 2018 to 2019 and registered in the Iranian Registry of Clinical Trials (No. IRCT20150801023446N19).
2.2. Participants and Setting
Through purposive sampling, 56 first semester nursing students (nursing students typically take eight semesters prior to graduation) from a nursing school in Tehran were selected and randomly assigned to one of three groups (simulation using a mannequin, serious game using a smart phone platform, and control group which included no training). Eligibility criteria encompassed agreement and informed consent to participate in the study, had not ever participated in any CPR training, and access to a smartphone. Exclusion criteria included reluctance to continue in the research or missing any of the CPR courses.
2.3. Sample Size
Previous research where education was provided to skill acquisition of nursing students [12] afforded a type I and II error, respectively, of 0.05 and 0.1 and , , , and , thus suggesting the appropriate sample size for each group in the current study to be 16 participants. Predicting a 10% dropout rate, we considered a minimum of 18 subjects per group.
Nursing students were randomly assigned into a simulation-based CPR training using a mannequin (), a serious game on the smartphone platform group (), or a control group () before the baseline assessment. A researcher assistant generated the random allocation sequence by throwing the dice, and she assigned participants to three groups. She was not involved in the intervention or outcome assessment. It should be noted that in the control group, two students did not participate in the posttest and were excluded from the study. A total of 54 students were evaluated.
2.4. Instruments and Data Collection
Before the trial, the students were evaluated individually for their CPR knowledge and skill using three different measurements: a demographic questionnaire, knowledge questionnaire (Appendix A), and an appraisal checklist (Appendix B). The demographic questionnaire provided information on sex, age, living situation (whether the student lived in the dormitory or off campus), marital status, university entrance exam score, history of theoretical nursing training on CPR (yes/no), history of practical nursing training on CPR (yes/no), and see others doing CPR (yes/no).
A 20-item, multiple-choice questionnaire for assessing CPR knowledge was created for this study. The knowledge questionnaire assessed the student’s understanding of CA, when to use CPR, understanding of basic life support (BLS), and the steps involved in CPR. The knowledge questionnaire scores ranged between 0 and 20, with 20 as the most proficient score. It was chosen as the arbitrary cut-off to classify three categories: “low level (0-35%),” “moderate level (35%-70%),” and “high level (<70%)”. Low-level scores range from 0 to 7; moderate-level scores range from 7.1 to 14; and high-level scores range from 14.1 to 20. Higher scores indicate greater knowledge. A score of 14 (70%) and higher indicates adequate understanding of CPR.
In addition, CPR skill performance was assessed using a live 10-minute simulated scenario of CA on a training mannequin. Each student’s performance was scored using a 31-item checklist for appraising CPR skill which was created for this study. Scores on this CPR skill appraisal checklist ranged from 0 to 31, with 31 as the most proficient score. We considered three categories: “low level (0-35%),” “moderate level (35%-70%),” and “high level (<70%)”. Low-level scores range from 0 to 11; moderate-level scores range from 11.1 to 21; and high-level scores range from 21.1 to 31. Higher scores indicate greater skill. A score of 21 (70%) indicates adequate performance of CPR. The CPR skill appraisal checklist included evaluation of the BLS skill.
The CPR knowledge questionnaire and CPR skill appraisal checklist were developed by the research team based on the 2015 American Heart Association (AHA) guidelines for CPR [23]. To determine the qualitative content validity, ten professors of nursing with expertise in the field of CPR and three experts in the field of instrumentation evaluated the knowledge questionnaire and appraisal checklist. For the face validity of the tools, 15 nursing students previously trained in the emergency course were interviewed face to face regarding the knowledge questionnaire and appraisal checklist. They provided critical information on the items assessed, and changes were made to the measures to reflect and modify any concerns. Pearson correlation coefficient was used to determine the test-retest reliability of the knowledge questionnaire (0.72), indicating strength in association between the measures over time. Cronbach’s alpha coefficient was used for the knowledge questionnaire and appraisal checklist, indicating internal consistency, 0.80 and 0.88, respectively. Raters for the appraisal checklist included two research assistants trained in CPR and subject assessment. The interrater reliability of the skill appraisal checklist was determined using Cohen’s kappa coefficient with an agreement of 0.93.
The knowledge questionnaire and appraisal checklist were used as both a pretest and a posttest for all three intervention groups. One of the researchers rated the students’ CPR performance. The pretest was given 30 minutes before the training intervention and the posttest was given two weeks after the training intervention.
2.5. Intervention
The first intervention group included CPR training using simulation on a mannequin (KAR/CPR180S×1PCS, Made in China). The mannequin was specifically designed for CPR instruction and included electronic verification of proper CPR operation. It therefore allowed students to correct mistakes as they were engaging with the mannequin. The training scenario was developed according to the 2015 AHA guidelines [23]. The CPR simulator trainer was a postgraduate critical care nurse with ten years’ experience in critical care nursing, and certified in CPR. Training was conducted in the simulation lab of the nursing school. Before each training, study mannequins were examined and calibrated. Students were divided into two groups of nine students. Training was completed in one day. Students participated in two sessions, each at least 45 minutes. Each student practiced and performed CPR on the simulator until they were determined to master CPR. Students were encouraged to ask questions of the instructor during and after each workshop.
The second intervention group included use of a serious game on the smartphone platform. The serious game was based on the latest version of the Basic Critical Action Algorithm and AHA Guide [24]. The serious game was created by the Virtualware Group (Figure 1) and translated into Persian by the researchers for this study. Firstly, students were instructed on how to install and play the serious game. Then, the player was guided throughout the step-by-step instructions. In fact, it was a self-learning modality without a face-to-face instructor. The player experienced a self-assessment after the completed task and she/he received feedback. When the player failed a task, she/he tried again. Students in this group were able to connect to the researchers and ask questions via group chat on Telegram. Students were given two weeks to engage with the serious game. The serious game training takes approximately two minutes in total to complete.
The third group was the control where no intervention was performed. The control group received the pretest and posttest, completed two weeks apart. The control group received education on CPR through simulation at the end of the data collection. Since most students lived in dormitories and would likely discuss the tests among themselves, we ordered the tests to prevent contamination bias between groups. The pretest and posttest were completed in the control group first, then in the simulator group, and finally in the serious game group. The study process is shown in Figure 2.
2.6. Data Analysis
The data were analyzed in the SPSS software (version 16) using the descriptive statistics (mean, standard deviation, frequency, percentage) and analytical (Fisher’s exact test, Kruskal Wallis, Mood’s Median test, Wilcoxon, and Mann–Whitney ). The Kolmogorov-Smirnov test was used to evaluate the normality of the data. Statistical analyst was blinded. She was not aware of the allocation of students to the groups. A was considered significant. Of note, Bonferroni-adjusted significance tests for pairwise comparisons were used with an alpha set at 0.05. With three comparisons, the LSD value required for significance is 0.0167.
2.7. Ethical Approval
The study followed principles of the Helsinki declaration and was approved by the Ethics Committee of the Aja University of Medical Sciences (No. IR.AJAUMS.REC.1396.69) and principles of the Committee on Publication Ethics. All students were informed about the study details, and verbal informed consent was obtained. The researchers assured the students about their right to refuse to participate or withdraw from the study at any time. The researchers also assured the students that they would not be harmed and that their personal information would be anonymous and confidential.
3. Results
3.1. Background and Demographics
The mean age of the nursing students was years. Slightly over half of the students were male (55.6%), 92.6% were single, 96.3% lived in dormitories, 98.1% had no CPR training (theoretical or practical), and only 7.4% had exposure to CPR prior to this study. None of the students were licensed practical in nursing. There was no significant difference between the three groups in terms of any of the background characteristics () (see Table 1).
3.2. CPR Knowledge
The scores for the pretest CPR knowledge questionnaire ranged from 1 to 12 with a mean of , which indicates knowledge below minimum standards. Mood’s median test noted no significant difference between the three groups on the pretest knowledge questionnaire (). There was no difference between pretest scores in the simulation and serious game groups (Mann–Whitney test, , ns). Wilcoxon test showed a significant difference in the simulator and serious game intervention groups between the pretest and posttest on the knowledge questionnaire ( and , respectively), whereas, the control group showed no difference between the pretest and posttest (). Mood’s median test indicated a significant difference between the knowledge score of three groups after the training (). On the posttest knowledge questionnaire, there was no significant difference between the simulation intervention group and the serious game group ( versus ; Mann–Whitney test, , ns). On the posttest, mean knowledge scores for all three groups (47.75%% simulation group, 38.85% serious game group, 27.2% control group) were less than the 70% level, which was initially set as a score of adequate CPR knowledge (see Table 2).
3.3. CPR Skill
The Kruskal-Wallis test noted that the CPR skill appraisal checklist was not significantly different across the three groups in the pretest (). The Wilcoxon test showed that CPR appraisal skill scores significantly improved between the pretest and posttest in the simulation and serious game intervention groups ( for both). There was no significant difference in the pre- and posttest scores for the control group (). On the posttest, the simulation and serious game groups were significantly different from the control group () (see Table 3). However, the simulation and serious game groups were not significantly different from each other at the posttest ( vs. , Mann–Whitney test, , ns). Mean scores in the intervention groups (87.64% simulation group, 83.06% serious game group) are greater than 70% and determined to be above adequate skill level.
4. Discussion
The current study demonstrated that nursing students provided with CPR education through a traditional simulation training or a more novel serious game platform improved from baseline in their CPR knowledge and skill development. Both the simulation training and serious game groups showed improved CPR knowledge in comparison to the control group. Overall, the simulation training and serious game groups did not significantly differ in their posttest scores indicating both provided a similar amount of learning for nursing students. Of note, neither group provided enough training to increase the nursing students’ ability to increase their knowledge score on a questionnaire, but both the simulation and serious game groups showed adequate demonstration of CPR skills. It could be due to insufficient motivation of students to increase knowledge.
In the present study, the researchers anticipated that the knowledge and skills related to CPR performance would be significantly improved in the serious game group or the simulator group. This hypothesis was derived from literature suggesting that serious games are more effective than other self-learning methods [25]. We found that the simulator and the serious game groups increased the performance on a test of CPR knowledge and skill demonstration. However, the simulation and serious game groups did not differ in their ability to provide education to nursing students in the current study. Most studies demonstrate the usefulness of either the simulation or the serious game education. For example, Akhu-Zaheya et al. examined the effectiveness of simulation on knowledge acquisition and knowledge retention of nursing students. Their findings showed that students who were trained with traditional teaching and high-fidelity simulation earned higher scores in BLS knowledge as compared to those that received only traditional teaching [11]. Heidarzadeh et al. compared the effect of heart and lung examination training using simulation and lectures on midwifery students’ knowledge. Training by simulation was found to be effective in enhancing students’ knowledge compared to those that received only lecture teaching [26]. In a study conducted by Li et al., they used 3-dimensional virtual technology (3D CPR game) for freshman medical students who had no previous CPR training experience. This technology was applied to assess its effect on three-month CPR skill retention. The findings of their study showed that the use of 3D games was effective in increasing and retaining the CPR skill for medical students [27]. In another study, Low et al. showed that the use of the iResus application (that is a free application that includes current adult and pediatric algorithms in an interactive and intuitive format while remaining entirely faithful to the original content) significantly enhanced physicians’ capability in advanced life support [28]. The previous studies differed in their study population characteristics, specific aspects of training such as if they included direct instruction or were purely self-learning, and the actual platform of the training. These slight differences likely play a role in learning and knowledge gained from the different learning methods investigated. It is possible that in our current study, the use of a group facilitator who encouraged questions from the students leads to more similar results between the groups, making it difficult to tease apart the invention of simulation and serious game from the use of the facilitator/educator.
Of concern with both the simulation and serious groups’ training is the lack of knowledge gained, as measured by questionnaire, from both types of education. Neither group was able to demonstrate on the knowledge questionnaire a level above 70% at posttest. However, they were able to demonstrate adequate skill on demonstration. At this time, it is difficult to determine if the knowledge questionnaire was too tough for the students and could not adequately measure their knowledge or whether the two intervention groups were unable to relay the underlying concepts and knowledge of CPR. It is possible that students would have benefited from direct instruction via a lecture format to relay information regarding CPR knowledge. Nevertheless, as many evidences show that CPR knowledge and skill are poor in more nursing and medical students [5, 6], it is recommended to use these training methods along with other traditional methods. Further ongoing investigation is needed.
4.1. Limitations
This study is a single-center study, which possibly limits the generalizability of the findings to other centers. The small sample size can be considered another limitation of the study, and a larger sample might find more accurate results. Furthermore, the researcher evaluated the effects of the training two weeks after intervention and it is unclear if the results would continue after a longer period posttraining. The evaluation methods were created and tested for the first time for this study. It is possible that other measurements might find different results and these measures should be evaluated in other studies to determine their effectiveness more clearly. Also, we tried to prevent the contamination bias between groups by order of the interventions. Also, the researchers did not include the nursing students who performed a CPR course before entering in nursing school.
5. Conclusions
Overall, this study indicated that CPR training for nursing students using the traditional simulation training and the novel serious game training on a smartphone platform both increased CPR knowledge and skill equally. Neither method increased knowledge to a satisfactory level but both increased skill performance to a level that was determined adequate. The serious game is a self-learning modality without face-to-face instructor-led training; while simulation has access to real-time CPR feedback devices. We speculate that creating a CPR training for nurses that includes either simulation or a serious game component would provide adequate CPR skill obtainment. The serious game training can be a substitute for the conventional hands-on training for CPR. In addition, direct instruction is needed to support CPR understanding and knowledge. Further studies with higher sample sizes and longitudinal follow-up are recommended.
Appendix
A. Knowledge Questionnaire
Dear students, the following questions are to assess your knowledge and perceptions of the basic life support (BLS) in adults according to the 2015 American Heart Association (AHA) guidelines for cardiopulmonary resuscitation (CPR). Please read the questions carefully and choose the correct option for each one. Each question has only one correct option. (1)How many chest compressions are advocated to administer per minute? (a)A minimum of 30 and a maximum of 60 compressions per minute(b)A minimum of 60 and a maximum of 80 compressions per minute(c)A minimum of 100 and a maximum of 120 compressions per minute(d)A minimum of 120 and a maximum of 150 compressions per minute(2)How deep are chest compressions practiced during CPR in adults? (a)2-3 centimeters(b)3-5 centimeters(c)4-6 centimeters(d)5-6 centimeters(3)What is the compression-ventilation ratio in adults? (a)3 : 1(b)5 : 1(c)15 : 2(d)30 : 2(4)What time should the patient’s pulse rate be rechecked after initial assessments during CPR? (a)10 seconds after each CPR cycle(b)Immediately 2 seconds after each CPR cycle(c)Immediately after 30 chest compressions(d)After 120 chest compressions(5)Upon performing CPR, the patient has a return of pulse rates but there is no sign of breathing. How much ventilation must be given to the patient? (a)6-8 breaths of air per minute(b)10-12 breaths of air per minute(c)18-20 breaths of air per minute(d)It depends on the patient’s skin color(6)For a 45-year-old unconscious person, chest compressions are administered by 30 repeats following no pulse rate and breathing, what is the next step? (a)Re-check the pulse rate and breathing after 30 compressions(b)Open the airway and give two resuscitations(c)Give two resuscitations and recheck the pulse rate(d)Give resuscitations and discontinue chest compressions(7)What is the next step after a two-minute full cycle of chest compressions and resuscitations while you are practicing CPR on a patient in an intensive care unit (ICU)? (a)Performing the next cycle of compression and ventilation(b)Checking the patient’s pulse rate in less than 5 seconds(c)Controlling vital signs in less than 5 seconds(d)Checking the pulse rate and breathing simultaneously(8)In a team-based CPR procedure in the hospital, you are administering chest compressions and your teammates are engaged in resuscitations. When is the best time to change over? (a)Every two minutes or after five CPR cycles(b)After each CPR cycle(c)If one member gets tired(d)After every 10 minutes of CPR practice(9)A patient has fallen on the ground with no movements, what is the first thing you do as a nurse in this case? (a)Checking the pulse rate and breathing before CPR(b)Examining the pupils and checking their responses to the light(c)Controlling the patient’s responses to assess their consciousness level(d)Notifying supervisors to announce the CPR code immediately(10)As you suddenly see a person fallen next to one’s desk with no responses, you first examine the scene and then assess consciousness level at the nonresponsive stage. What do you do at first? (a)Controlling vital signs(b)Calling emergency(c)Placing the patient in a proper position(d)Checking the carotid pulse rate(11)A patient has fallen off the bed and you realize an unconscious level with abnormal breathing and no pulse rate as you carry out the initial assessments. What do you do respectively until the code group arrives? (a)Opening the airway-giving resuscitations-compressing the chest(b)Compressing the chest-opening the airway-giving resuscitations(c)Taking environmental pulse rate-opening the airway-giving resuscitations(d)Performing abdominal thrusts (Heimlich maneuver)-opening the airway-giving resuscitations(12)The image you are at the bedside of a 45-year-old patient, who is at an unconscious level. After the announcement of the code and the initial assessments, you realize pulse rate but no proper breathing. What do you do? (a)Open the airway and deliver resuscitations 10-12 times per minute(b)Open the airway and give two breaths of air to the patient and administer chest compressions(c)Perform resuscitations in five consecutive cycles of heart compressions and ventilations(d)Check the pulse rate every 2 minutes and start resuscitations immediately if the pulse rate cannot be felt(13)As a relief worker, you see an injured person who has drowned. During the initial assessments, the patient is found unconscious with no breathing but pulse rates. You also check the patient’s airway and open it up. What is the next step? (a)Check the pulse rate every 2 minutes and start resuscitations immediately if the pulse cannot be felt(b)Deliver resuscitations every 5-6 seconds for 2 minutes and then check the pulse rate(c)Perform resuscitations in five consecutive cycles of heart compressions and ventilations(d)Give resuscitations every 5-6 seconds in a row until the patient regains consciousness(14)As a relief worker, you see an injured person who has become unconscious due to asphyxiation. The pulse rate can be felt, but there is no breathing. You immediately start resuscitations but you notice no pulse rates after 2 minutes. What do you do? (a)Continuation of resuscitations(b)Naloxone injection(c)Immediate heart compressions(d)Recontrol of breathing(15)A person is suspected of spinal injury due to fall from height. What procedure do you use to open the patient’s airway? (a)Head back/neck lift(b)Jaw trust(c)Chin lift/head tilt(d)Flat/chin lift(16)As a relief worker, you see an injured person who has become unconscious due to asphyxiation and there is no breathing. There are also no pulse rates during the initial assessments and you are not certain about it. What do you do? (a)Practice resuscitations(b)Open the airway(c)Start heart compressions(d)Recontrol pulse rates with more precision(17)You are at a patient’s bedside, who does not respond to stimuli. During the initial assessments, the carotid pulse rate can be felt but there is no breathing. What is the next step after asking for help? (a)Giving a resuscitation any 5-6 seconds(b)Checking the airway in terms of obstructions(c)Staying at the bedside until the relief team arrives(d)Starting resuscitation with chest compressions(18)After leaving home, you suddenly see the man living next door has become unconscious on the ground with no responses. You immediately call emergency via your cellphone. In the meantime, you check the pulse rate and breathing and find no problem with carotid pulse and breathing. What is the next step? (a)Administering immediate resuscitation until the relief team arrives(b)Performing only heart compressions until the relief team arrives(c)Checking the patient’s airway for openness and no obstructions(d)Staying at the patient’s bedside until the relief team arrives(19)Imagine you are at the bedside of a 52-year-old patient suffering from an obstructed airway. The patient has no breathing but shows consciousness levels. What do you do? (a)Carrying out the back-blow maneuver(b)Opening the airway and removing foreign objects(c)Taking immediate resuscitation measures(d)Performing abdominal thrusts (Heimlich maneuver)(20)During ventilation through mouth-to-mouth resuscitation, the injured case suddenly vomits and has subsequent aspiration. What is your immediate action? (a)Laying the patient on one side and lowering the head to remove the vomited contents(b)Stopping resuscitation and placing the patient in a supine position(c)Maintaining resuscitation in the same way and giving ventilation for about a second(d)Continuing to breathe through the mouth to the nose and putting firm pressures on the epigastric region
B. Appraisal Checklist (Table 4)
Data Availability
The data used to support the findings of this study are included within the article.
Disclosure
The funders did not play any role in the conceptualization, design, drafting, and approval of the manuscript.
Conflicts of Interest
The authors declare that they have no conflict of interest.
Authors’ Contributions
ZF involved in the study conception, planning, data analysis, interpretation, writing, and critically revising the paper. MY contributed to the planning, data collection, interpretation, and writing of the paper. SB involved in the study interpretation and critically revising the paper. MN contributed to the planning and data collection. JM involved in the revision of the paper. All authors collaborated in the study, and all read and approved the final manuscript.
Acknowledgments
We would like to appreciate the nursing students who participated in this study and the experts who provided feedback on the measurements. This article is a main part of the MSc thesis of critical care nursing, which was supported by the Aja University of Medical Sciences (grant number 596372, July 20, 2017).