Self-assessment of evidence-based practice and research knowledge tool: Psychometric analysis

Monday, 18 November 2013

Mary Hagle, PhD, RN, WCC1
Julie L. Millenbruch, PhD, RN, CRRN2
Sherry A, Tennies, MSN-Ed, BSN, BBA, RN2
(1)Nursing Education and Research, Clement J Zablocki VA Medical Center, Milwaukee, WI
(2)Nursing Education and Research, Clement J. Zablocki VA Medical Center, Milwaukee, WI

Learning Objective 1: Describe one component of psychometric analysis.

Learning Objective 2: Describe a new tool to assess evidence-based practice and research knowledge in the clinical setting.

Practice based on evidence and an understanding of research activities are expectations of professional nurses by national and international standards. Tools available to assess evidence-based practice (EBP) or research knowledge address one concept per tool, focus on beliefs or values, require payment, or are too long from a staff nurse perspective. Thus, a “Self-Assessment of Evidence-Based Practice and Research Knowledge” tool was developed for the clinical setting based on conceptualizations of EBP and research knowledge as well as content expectations from national standards and literature. Knowledge self-assessment items used a Likert scale of 0-3 indicating “none, some, moderate, or high” level of knowledge. From a sample of 154 RNs in one clinical setting, this study focused on the psychometric properties of the 21-item tool. Face and content validity were assessed by 10 nurses with doctoral, masters, and bachelor degrees using a structured evaluation form. The panel evaluated clarity and time to complete (5-15 minutes). Raw scores ranged from 0 to 3 for 20 of 21 items; overall, the highest mean was 2.52, the lowest was 0.86. Cronbach’s alpha was 0.96 for the total tool. Principal component factor analysis with varimax rotation resulted in two factors. This was determined by eigen values greater than one, scree plot, item loadings, and conceptual clarity. The factors were labeled EBP and research as expected.  Cut points were set at 0.5. It was hypothesized that a valid tool would demonstrate a significant relationship between education having research courses (BSN/graduate) and the research knowledge factor; this was supported (p=0.003). With internal reliability and validity, the psychometric properties warrant continued use and further study.  This is a clinically feasible tool for nurses to assess their knowledge of EBP and research based on the components of EBP and the steps of the research process.