PURPOSE: The UK Functional Assessment Measure (UK FIM+FAM) is a widely used outcome measure in brain injury rehabilitation. An Extended Activities of Daily Living (EADL) module was included in its original development, but has never been formally evaluated. This study evaluated its scoring accuracy and reliability using vignettes (short clinical scenarios). METHOD: A set of vignettes was developed and tested by a panel of experienced UK FIM+FAM trainers to derive 'gold standard' scores. To evaluate scoring accuracy, these were subsequently compared with scores made by 12 rehabilitation professionals; first individually, and then together in four multi-disciplinary (MD) teams to reflect clinical practice. Scoring was repeated after 1 month. Inter-rater and intra-rater reliability were evaluated for both individual and MD team scores using weighted Cohen's kappa statistics. RESULTS: Agreement with 'gold standard scores' was excellent, ranging from k(w) = 0.88-0.97 (individuals) and k(w) = 0.93-1.00 (MD teams). Inter-rater agreement was good to excellent, ranging from k = 0.68-0.92 (individuals) and k = 0.74-1.00 (MD teams). Test-retest agreement was excellent, ranging from k(w) = 0.92-1.00 (individuals) and k(w) = 0.89-0.99 (MD teams). CONCLUSION: This vignette-based study demonstrated high levels of scoring accuracy and reliability for the EADL items of the UK FIM+FAM. Further testing in real-life situations is now warranted.
PURPOSE: The UK Functional Assessment Measure (UK FIM+FAM) is a widely used outcome measure in brain injury rehabilitation. An Extended Activities of Daily Living (EADL) module was included in its original development, but has never been formally evaluated. This study evaluated its scoring accuracy and reliability using vignettes (short clinical scenarios). METHOD: A set of vignettes was developed and tested by a panel of experienced UK FIM+FAM trainers to derive 'gold standard' scores. To evaluate scoring accuracy, these were subsequently compared with scores made by 12 rehabilitation professionals; first individually, and then together in four multi-disciplinary (MD) teams to reflect clinical practice. Scoring was repeated after 1 month. Inter-rater and intra-rater reliability were evaluated for both individual and MD team scores using weighted Cohen's kappa statistics. RESULTS: Agreement with 'gold standard scores' was excellent, ranging from k(w) = 0.88-0.97 (individuals) and k(w) = 0.93-1.00 (MD teams). Inter-rater agreement was good to excellent, ranging from k = 0.68-0.92 (individuals) and k = 0.74-1.00 (MD teams). Test-retest agreement was excellent, ranging from k(w) = 0.92-1.00 (individuals) and k(w) = 0.89-0.99 (MD teams). CONCLUSION: This vignette-based study demonstrated high levels of scoring accuracy and reliability for the EADL items of the UK FIM+FAM. Further testing in real-life situations is now warranted.
Authors: Kaisorn L Chaichana; Aditya N Halthore; Scott L Parker; Alessandro Olivi; Jon D Weingart; Henry Brem; Alfredo Quinones-Hinojosa Journal: J Neurosurg Date: 2010-06-04 Impact factor: 5.115