Researching Inter-Rater Reliability of Faculty Evaluation for Nursing Simulation in Bengaluru, India

Monday, 19 September 2016

Kathryn Logan Liller
Louise Herrington School of Nursing, Baylor University, Dallas, TX, USA

Abstract:

Background: Nursing simulation is a new educational concept in India. The traditional methods for teaching science in Indian culture are didactic lecture and rote memory (Umashankar & Dutta, 2007). While evidence suggests simulation is effective in promoting critical thinking and clinical decision making in the US (Hayden, Smiley, Alexander, Kardong-Edgren, & Jeffries, 2014), research is needed to determine if simulation education is effective among faculty and students in India. In order for simulation to be fairly evaluated, reliability and validity of data produced from observations of students’ performance, must be considered carefully (Adamson, K., 2016).

Purpose:To evaluate interrater reliability of faculty during nursing simulation in Bengaluru, India

Methods: A quantitative interrater reliability study will be performed. Faculty in this study will evaluate eight nursing students participating in two simulations. In order to determine the consistency of faculty ratings of student performance as measured by The Seattle University Simulation Evaluation Tool© (Mikasa, Cicerno & Adamson, 2013), inter-rater reliability will be assessed using intra-class correlations (ICCs). ICCs greater than .80 are considered acceptable.

Results: The study will be conducted in July of 2016 and results will be presented in the poster presentation at the Sigma Theta Tau International Leadership Conference.

Discussion: In conducting interrater reliability research among faculty members of simulations in Bengaluru, we are answering the call to improve the nursing education throughout India as well as producing rigorous and quality research in the area of nursing simulation. Evaluating faculty's observations and judgement of their students during simulation will create consistency in the learning process. This consistency will help validate the effectiveness of nursing simulation as a learning tool. Results will contribute to the science of nursing by establishing interrater reliability in India and improving nursing education as well as contribute more rigorous and quality research to the existing literature of medical simulation.