L B Goldstein1, G P Samsa. 1. Division of Neurology, Duke University Medical Center, Durham, NC 27710, USA. golds004@mc.duke.edu
Abstract
BACKGROUND AND PURPOSE: The reliability of the National Institutes of Health Stroke Scale (NIHSS) has been established through testing its use in live and videotaped patients. This reliability testing has primarily focused on the use of the scale by neurologists. We sought to determine the reliability of the NIHSS as used by non-neurologists in the context of a clinical trial. METHODS: In anticipation of the initiation of a randomized trial of a new therapy for patients with acute ischemic stroke, 30 physician investigators (30% of whom were not neurologists) and 29 non-physician study coordinators were trained in the use of the NIHSS at an informational and training conference using standardized videotaped patient examinations. A series of 4 patients were rated initially. After 3 months, the same 4 patients were rerated, providing a measure of intraobserver reliability. An additional series of 4 new patients were also rated after 3 months and, with the initial 4 ratings, provided data for assessment of interobserver reliability. RESULTS: Overall, 28% of the raters had previous experience with the NIHSS, and 22% had previously used the videotapes as used in the present trial. The coefficients of determination (r2) were each greater than .95 when the means of the two ratings of the same 4 cases were compared between (1) neurologists and other types of physicians, (2) physicians and study coordinators, (3) raters who had prior experience with the NIHSS and those without prior experience, and (4) raters who had used the videotapes in the past and those who had never viewed the tapes. The calculated r2s were greater than .98 for the initial rating of the first 4 cases and for the later rating of the 4 new cases. The slopes of the regression lines were all near 1, indicating that the raters were similarly calibrated. The intraclass correlation coefficients were .93 and .95, reflecting high levels of intraobserver and interobserver reliability. CONCLUSIONS: These data extend the previously demonstrated reliability of the NIHSS to non-neurologists and show that both a variety of physician investigators and nurse study coordinators can be rapidly trained to reliably apply the scale in the context of an actual clinical trial.
RCT Entities:
BACKGROUND AND PURPOSE: The reliability of the National Institutes of Health Stroke Scale (NIHSS) has been established through testing its use in live and videotaped patients. This reliability testing has primarily focused on the use of the scale by neurologists. We sought to determine the reliability of the NIHSS as used by non-neurologists in the context of a clinical trial. METHODS: In anticipation of the initiation of a randomized trial of a new therapy for patients with acute ischemic stroke, 30 physician investigators (30% of whom were not neurologists) and 29 non-physician study coordinators were trained in the use of the NIHSS at an informational and training conference using standardized videotaped patient examinations. A series of 4 patients were rated initially. After 3 months, the same 4 patients were rerated, providing a measure of intraobserver reliability. An additional series of 4 new patients were also rated after 3 months and, with the initial 4 ratings, provided data for assessment of interobserver reliability. RESULTS: Overall, 28% of the raters had previous experience with the NIHSS, and 22% had previously used the videotapes as used in the present trial. The coefficients of determination (r2) were each greater than .95 when the means of the two ratings of the same 4 cases were compared between (1) neurologists and other types of physicians, (2) physicians and study coordinators, (3) raters who had prior experience with the NIHSS and those without prior experience, and (4) raters who had used the videotapes in the past and those who had never viewed the tapes. The calculated r2s were greater than .98 for the initial rating of the first 4 cases and for the later rating of the 4 new cases. The slopes of the regression lines were all near 1, indicating that the raters were similarly calibrated. The intraclass correlation coefficients were .93 and .95, reflecting high levels of intraobserver and interobserver reliability. CONCLUSIONS: These data extend the previously demonstrated reliability of the NIHSS to non-neurologists and show that both a variety of physician investigators and nurse study coordinators can be rapidly trained to reliably apply the scale in the context of an actual clinical trial.
Authors: Lauren A Beslow; Scott E Kasner; Sabrina E Smith; Michael T Mullen; Matthew P Kirschen; Rachel A Bastian; Michael M Dowling; Warren Lo; Lori C Jordan; Timothy J Bernard; Neil Friedman; Gabrielle DeVeber; Adam Kirton; Lisa Abraham; Daniel J Licht; Abbas F Jawad; Jonas H Ellenberg; Ebbing Lautenbach; Rebecca N Ichord Journal: Stroke Date: 2011-11-10 Impact factor: 7.914
Authors: Cassia R Overk; Christian C Felder; Yuan Tu; Doug A Schober; Kelly R Bales; Joanne Wuu; Elliott J Mufson Journal: J Chem Neuroanat Date: 2010-03-27 Impact factor: 3.052
Authors: James E Siegler; Amelia K Boehme; Andre D Kumar; Michael A Gillette; Karen C Albright; Sheryl Martin-Schild Journal: J Stroke Cerebrovasc Dis Date: 2012-06-21 Impact factor: 2.136
Authors: Vincenzo Di Stefano; Antonella Maria Pia De Novellis; Fedele Dono; Marco Onofrj; Maria Vittoria De Angelis Journal: Neurol Sci Date: 2019-06-20 Impact factor: 3.307
Authors: Jennifer Rengachary; Giovanni d'Avossa; Ayelet Sapir; Gordon L Shulman; Maurizio Corbetta Journal: Arch Phys Med Rehabil Date: 2009-12 Impact factor: 3.966