| Learning Objective #1: Describe the method used to determine reliability of the Web Depression Tool | |||
| Learning Objective #2: State the importance of valid and reliable tools to assess the quality of health information Web sites |
Objective: The purpose of the study was to evaluate the reliability and stability of an evaluation tool for depression web sites for use by health care providers. Although this study used measurement theory as the theoretical framework, its broad framework was the Technology Assessment Model. Design: A repeated measures design was used. Sample, Setting, Methods: The sample consisted of 61 volunteer senior nursing students enrolled in a baccalaureate psychiatric-mental health course at two different times. Students in one class (n 23) evaluated three depression web sites at two times, four weeks apart. Six months later, another class of students (n 38) evaluated the same web sites. Students completed the evaluation at school, work and home. Concept Studied: Students used the Web Depression Tool (WDT) each time they evaluated the web sites. The 44 question tool examined content, construction, and usefulness of the web site. Findings: WDT stability was assessed with the same group of students evaluating the web sites four weeks apart. The tool had very good stability between the two time periods (r=0.652, p=0.0001). With one item exception, all scales at all time periods showed good internal consistency. Intrarater reliability was very good (r=0.639, p=0.0001). During the three evaluation periods, there were no significant changes over time when the three web sites scores were combined. Conclusions: WDT demonstrated reliability and stability with 2 groups of student raters. Implications: Web-based evaluation tools need adequate psychometric properties so that health care providers can critically evaluate web sites that the public use to obtain health information. Further research should evaluate the tool's usefulness with different groups of Internet users.
Back to Health Informatics
Back to 14th International Nursing Research Congress
Sigma Theta Tau International
10-12 July 2003