Assessment of Interprofessional Collaboration Before and After a Disaster Drill Experience

Tuesday, 19 November 2019: 8:20 AM

Heiddy DiGregorio, MSN, APRN, PCNS-BC, CHSE, CNE1
Jennifer Graber, EdD, APRN, PMHCNS-BC2
Michelle M. Ness, MSN2
Jennifer L. Saylor, PhD, APRN, ACNS-BC2
(1)School of Nursing, University of Delware, Newark, DE, USA
(2)School of Nursing, University of Delaware, Newark, DE, USA

Introduction/ Significance

Health care providers should have competencies in providing team-based care; however, current team-training efforts do not address needs in current professional practice. Price, Doucet, and Hall (2014) suggested early socialization can contribute to building team-based collaborative skills. The National League of Nursing [NLN] (2015) reported recent graduates are not prepared to fully provide competent team-based care and proposes to transform healthcare education to include deliberate, meaningful experiences in inter-professional collaboration and practice.

The Inter-professional Education Collaborative Expert Panel (2011) reports that care provided by a collaborative team results in better patient outcomes. This is consistent with the guiding principles for transforming healthcare as stated by the Institute of Medicine (IOM) (2003). Inter-professional Education Collaborative Expert Panel (2011) states that our society functions as an interdependent system, therefore healthcare should be provided in the same manner. Inter-professional collaboration is essential to build a team-based workforce with an understanding of the various roles and responsibilities able to communicate in an effective manner to provide patient centered care.

Methods

Design: This pretest posttest descriptive research design assessed communication, collaboration, roles/responsibilities, patient focus, team functioning and conflict management of nursing students who participated in a simulated disaster drill. For the nursing students, this simulation was a required part of the Community Health Nursing course.

Participants: A convenience sample of 109 nursing students participated in the simulated disaster drill. For inclusion, participants had to be over the age of 18 and a nursing student enrolled in the Community Health Nursing course. Exclusion criteria included participants under the age of 18 and any student not enrolled in the Community Health Nursing course. Students had an opportunity to discuss questions or address concerns regarding participation to ensure that they understood that the disaster drill is a course requirement. Participation was voluntary and did not affect course grade.

Instruments: The Inter-professional Collaborator Assessment Rubric (ICAR) was used for all participants as the pretest and posttest instrument. The ICAR is designed to assess competencies stated by the Inter-professional Executive Committee collaborative competencies. Reliability analysis of modified versions of the ICAR demonstrated a high level of internal consistency (α = .981) and high levels of inter-rater percent agreement, 91.5% (CI = 90.3, 92.7). Permission was granted to adapt the tool and replace “resident” with “learner” and “not observable” with “not applicable”.

Study Procedure: This study represented a partnership between the university school of nursing and emergency medical technicians, and a local community college’s nuclear medicine program. Approximately one week prior to beginning the study, the researcher explained the study, reviewed the consent and the procedures involved in participation. Using REDCap (Research Electronic Data Capture), consented students from the Community Health Nursing course completed a demographic survey and two ICAR instruments, one before and one after the simulated disaster drill. Demographic information included age, grade point average, gender, ethnicity, and employment status, including job type, was used to describe the participants. The pretest and posttest instruments took approximately 10 minutes to complete. The pretest instrument was available via an e-mail link for the undergraduate nursing students. The posttest instrument was available to all participants using same mode of delivery immediately following the simulated disaster drill. The instrument remained open one week after the disaster drill and participants received one reminder three days after the disaster drill.

Data Collection: Study data was collected and managed using REDCap electronic data capture tools hosted at the University of Delaware. REDCap is a secure, web-based application designed to support data capture for research studies, providing 1) an intuitive interface for validated data entry; 2) audit trails for tracking data manipulation and export procedures; 3) automated export procedures for seamless data downloads to common statistical packages; and 4) procedures for importing data from external sources. In addition to traditional data capture functionality, REDCap’s survey function is a powerful tool for building and managing online surveys. REDCap users can design surveys and then distribute them to potential respondents with a variety of notification methods. Real-time validation rules (with automated data type and range checks) improve accuracy of data entry. Audit reports can be generated from REDCap’s logging records of data entry, viewing, importing and exporting. REDCap was developed specifically around HIPAA-Security guidelines.

Data Analysis

A research team member downloaded the data from REDCap. REDCap automatically strips identifying information from the data set when downloaded from the server. Data was encrypted, stripped of identifiers, and stored in a secure database, REDCap. The de-identified data is stored in a password protected file and will remain on a password protected computer, which is stored behind a locked door. De-identified data for which no identifying key exists will be kept for further analysis as the database is developed. All data were analyzed using using SPSS Version 25 (IBM, 2017). A total of 93 completed the electronic informed consent and the pre-ICAR. The final data only included the 58 participants who completed the pre and post-ICAR.

The ICAR instrument was totaled then the responses for each of the six sections (communication, collaboration, roles and responsibilities, collaborative patient/client-family centered approach, team functioning, conflict management and resolution) were totaled to examine the differences in each section. Due to non-normality of the data, the Wilcoxon Signed Ranks Test (Blair & Higgins 1985; Rietveld & van Hout, 2017) was used to measure the changes between the perceptions of competency in inter-professional collaboration both pre and post disaster drill training and event.

Results

Participants were nursing majors and primarily Caucasian females (n = 50, 89% and n = 56, 97% respectively), representative of the school of nursing population at the University. Students ranged in age from 20 to 30 years old with a mean of 21.59 (2.152). The students in this study were above average with a mean grade point average of 3.38 (0.306). Almost three-quarters (n = 41, 71%) of the participants were employed in a healthcare related field as a Certified Nursing Assistant or Emergency Medical Technician, or other medical positions (n= 41, 71%). Only 6 (10%) participants were employed in a non-medical position and 18 (31%) reported that they did not work while in school.

The Wilcoxon Signed-Ranks Test indicated that scores for the total ICAR Posttest were significantly lower than the Total ICAR Pretest (Z=-2.006, p=.045, r= -0.19). All the sections of the ICAR had a lower mean score on the ICAR posttest compared to the pretest. Only the collaborative patient/client family centered approach section on the ICAR was significantly significant ( Z=-3.153, p=.002, r= -.30).

Conclusion/Implications

Role identification is a significant aspect in disaster preparedness (Jose & Dufrene, 2013). Study participant's preliminary perceptions of interprofessional collaboration for a disaster drill did not reflect study participant's reflections following the disaster drill experience. While three disciplines were represented, nursing students reported less interprofessional competencies following the immersive experience. The findings may be the result of a student's perceived ability not reflecting actual inter-professional competencies. As a result, educational offerings focused on interprofessional team disaster preparedness training may further facilitate awareness of roles and responsibilities during a disaster experience.

See more of: J 14
See more of: Oral Paper & Poster: Education Sessions