Reliability and Validity Testing of a Telemetry Monitoring Competency TOOL ©

Monday, 30 July 2012

Rachel Choudhury, MSN, MS, RN, CNE
National Academics Department, Chamberlain College of Nursing, Columbus, OH

Learning Objective 1: Describe the reliability and validity testing of the Telemetry Monitoring Competency Tool©.

Learning Objective 2: Discuss the implications of using the Telemetry Monitoring Competency Tool© for clinical education and practice.

Purpose: The purpose of this study was to subject the tool to psychometric measurement analysis, specifically to determine the reliability and validity of the tool in evaluating the telemetry monitoring competency of nurses who practice in the medical-surgical and intensive care units of an acute care hospital. 

Methods: Purposive sampling for the panel of experts to determine validity of the tool. Content validity ratio (CVR) and content validity index (CVI) of the tool was analyzed using Lawshe's (1975) and Lynn's (1986) methods, respectively. A stratified random sampling method was used to obtain study participants for the written and observational two-rater reliability testing of the tool. The interrater reliability of the tool was calculated using the method for determining Cohen’s kappa (к) coefficient,

Results: The data analysis supported the hypothesis indicating that the tool has good content validity with scores of 0.89 and 0.99 using Lawshe’s (1975) and Lynn’s (1986) methods, respectively.  The instrument demonstrated moderate strength of agreement (к = 0.58) in the written method of evaluation and substantial strength of agreement (к = 0.78) in the clinical observation method of evaluation.

Conclusion: Application of appropriate theoretical frameworks and evidence-based practices contributed to the favorable results obtained in this study. Content validity testing of the tool demonstrated that the content experts agree, for the most part, on the necessity and relevance of the instrument items in determining telemetry monitoring competency of nurses.  Interrater reliability kappa (к) coefficient of the instrument demonstrated substantial evidence of the consistency and accuracy of the tool in assessing telemetry monitoring competency of the nurses with clinical observation method of evaluation. Implementation of the instrument in the healthcare practice setting is very promising.