The NLN's Project to Explore the Use of Simulation for High Stakes Assessment

Saturday, 16 November 2013: 3:35 PM

Mary Anne Rizzolo, EdD, RN, ANEF, FAAN
Research and Professional Development, National League for Nursing, New York, NY

Learning Objective 1: Communicate the goals, intended outcomes and findings of the NLN's High Stakes assessment project to nursing colleagues.

Learning Objective 2: List 5 recommendations for the design and implementation of simulation for use in high stakes assessment.

This 3-year project was designed by the National League for Nursing to lay the groundwork for use of simulation for high stakes assessment in pre-licensure RN programs. Phase 1 began by gathering experts in the use of simulation in nursing and medical education, outcomes assessment, and clinical judgment for a two day Think Tank meeting. These experts identified end-of-program outcomes that are amenable to assessment through simulation, outlined scenarios that could be designed for that purpose, and provided recommendations for their implementation.

During Phase 2 one team of experts developed and piloted four simulation scenarios along with three parallel forms for each. Each of the four scenarios has a primary focus on one of the following areas: assessment and intervention, clinical judgment, collaboration, and safety. Communication is a thread throughout all.

A second team constructed the research plan, reviewed tools, selected a modified version of the Creighton tool, and designed the training for the evaluators. Evaluators were selected who had experience in simulation and clinical evaluation of students. Video recorded scenarios from the two pilot phases were used to train the selected evaluators. Two videotaped scenarios were reviewed by the evaluators monthly to determine intra-rater reliability.

Field testing took place during the spring and summer of 2012 at schools of nursing across the country that were geographically diverse and represented different types of RN pre-licensure programs. Evaluators scored video recorded scenarios using the modified Creighton tool to evaluate performance. Statistical results will be presented along with recommendations to the nursing education community regarding (a) the use of simulation for high-stakes evaluation in nursing education and (b) areas for future research related to this practice.