Methods: A prospective, pretest/posttest design was used to measure knowledge, self-confidence, and competency. Knowledge was measured using a 25-question researcher developed multiple-choice assessment. Self-confidence was measured by a researcher developed 10-item Likert Scale questionnaire. And Competency was measure by a researcher developed Critical Element Checklist. All three instrument were sent to experts for content validity and has a CVI of > .90. The intervention and control group completed the knowledge assessment and the self-confidence survey related to pediatric emergencies at baseline prior to the intervention, and at month eleven, one month after the final scenario for both groups. The sample included an intervention group that participated in 3 mock codes with structured debriefing. The control group completed one mock code without the debriefing at the 10-month time period. Data analysis included paired t-tests to determine differences in knowledge assessment scores and self confidence between the intervention and control groups, and independent t tests to determine differences in the Critical Element Checklist scores between the internvetion and control groups on the final scenario. Cronbach’s alpha reliabilities were conducted, and inter-rate reliability was established for the Critical Element Checklist.
Results: There was a statistically significant difference in knowledge between the intervention and control group on the knowledge assessment, with the intervention group scoring higher than the control group (p = .016). There were no statistically differences in self-confidence between the groups. Cronbach’s alpha reliability was:.88 for the knowledge pretest was; .96 for the knowledge posttest. Reliabilities for Self-Confidence Pretest r = .76, and Posttest r = .95. Independent t tests comparing group means on the Critical Elements Checklist showed no statistically significant differences between and within groups for all simulations. Interrater reliability for the Critical element checklist was .85 overall. A limitation of this study was the small number of participants, due to low enrollment. Of the 300 potential nurses eligible to participate, only 25 responded and were consented. Of the 25 participants, 7 were lost due to attrition. A second limitation was the lack of follow up by particpants in completing the final survey. Despite multiple attempts to get the particpants to complete the posttest surveys, several that participated in all three interventions still failed to complete the final survey.
Conclusions: Despite the small sample size, nurses in the intervention group did have statistically significant higher scores on the knowledge test. Additionally, the investigators were able to confirm the validity and initial reliability of the knowledge test, self-confidence survey, and Critical Element Chekclist. The recommendation for future research is to conduct a replication study with a larger sample in order to determine in whether of the educational design of simulation and debriefing has a significant influence on nurses’ knowledge, self-confidence, and competency with pediatric emergency preparedness.