Learning Objective #1: understand the importance of including quality assessment score in systematic reviews to help minimize misleading results due to poor study quality. | |||
Learning Objective #2: learn characteristics of rigorous interventions targeting adolescent risky sexual behavior using quality assessment tool. |
Reports of interventions aimed at preventing HIV/STDs and pregnancy among adolescents aged 13–21 years were obtained from online databases, relevant journals, conference proceedings, and references cited in articles. Other selection criteria included randomized experimental design; published in 1994–2004; and reported in English. An assessment scale with 22 Likert-type items was developed to quantify scientific rigor in four categories: introduction, methodology, data analysis/result, and conclusion/recommendation. A numeric score was calculated for each category and the overall study. Two researchers rated each study independently. Coding discrepancies were resolved through discussion and consultation with a third researcher knowledgeable in the field.
After a careful review of primary studies from multiple sources, 10 studies that met all inclusion criteria were selected for quality assessment. Studies were excluded for the following reasons: different sample age range, nonrandomized design, no quantifiable data provided, and redundant study. The mean quality score was 2.79 (range 0-3; sd = .16). The category “conclusion/recommendation” received the highest mean score (2.98), while “methodology” received the lowest (2.63). Common methodology flaws included limited information about psychometric properties of instruments and about unit of intervention and analysis, and inadequate control of validity threats.
Overall, the selected studies demonstrated high quality. Since prevention of risky sexual behavior is a top priority for promoting adolescent health, it is striking that so few rigorous studies have been done. Quality assessment should be included in systematic reviews (e.g., meta-analysis) to help minimize misleading results due to poor study quality.
See more of Poster Presentations II
See more of The 17th International Nursing Research Congress Focusing on Evidence-Based Practice (19-22 July 2006)