OBJECTIVE: Illness management and recovery (IMR) is an evidence-based, manualized illness self-management program for people with severe mental illness. This study sought to develop a measure of IMR clinician competence and test its reliability and validity. METHODS: Two groups of subject matter experts each independently created a clinician-level IMR competence scale based on the IMR Fidelity Scale and on two unpublished instruments used to evaluate provider competence. The two versions were merged, and investigators used the initial version to independently rate recordings of IMR sessions. Ratings were compared and discussed, discrepancies were resolved, and the scale was revised through 14 iterations. The resulting IMR Treatment Integrity Scale (IT-IS) includes 13 required items and three optional items rated only when the particular skill is attempted. Four independent raters then used the IT-IS to score tapes of 60 IMR sessions and 20 control group sessions. RESULTS: The IT-IS showed excellent interrater reliability (.92). A factor analysis supported a one-factor model that showed good internal consistency. The scale successfully differentiated between IMR and control groups. Reliability and validity of individual items varied widely. CONCLUSIONS: The IT-IS is a promising measure of clinician competence in providing IMR. The scale could be used for research and quality assurance and as a supervisory feedback tool. Future research is needed to examine item-level changes, predictive validity of the IT-IS, discriminant validity compared with other more structured interventions, and the reliability and validity of the scale for nongroup IMR.
OBJECTIVE: Illness management and recovery (IMR) is an evidence-based, manualized illness self-management program for people with severe mental illness. This study sought to develop a measure of IMR clinician competence and test its reliability and validity. METHODS: Two groups of subject matter experts each independently created a clinician-level IMR competence scale based on the IMR Fidelity Scale and on two unpublished instruments used to evaluate provider competence. The two versions were merged, and investigators used the initial version to independently rate recordings of IMR sessions. Ratings were compared and discussed, discrepancies were resolved, and the scale was revised through 14 iterations. The resulting IMR Treatment Integrity Scale (IT-IS) includes 13 required items and three optional items rated only when the particular skill is attempted. Four independent raters then used the IT-IS to score tapes of 60 IMR sessions and 20 control group sessions. RESULTS: The IT-IS showed excellent interrater reliability (.92). A factor analysis supported a one-factor model that showed good internal consistency. The scale successfully differentiated between IMR and control groups. Reliability and validity of individual items varied widely. CONCLUSIONS: The IT-IS is a promising measure of clinician competence in providing IMR. The scale could be used for research and quality assurance and as a supervisory feedback tool. Future research is needed to examine item-level changes, predictive validity of the IT-IS, discriminant validity compared with other more structured interventions, and the reliability and validity of the scale for nongroup IMR.
Authors: Alan B McGuire; Marina Kukla; Amethyst Green; Daniel Gilbride; Kim T Mueser; Michelle P Salyers Journal: Psychiatr Serv Date: 2014-02-01 Impact factor: 3.084
Authors: Kim T Mueser; Piper S Meyer-Kalos; Shirley M Glynn; David W Lynde; Delbert G Robinson; Susan Gingerich; David L Penn; Corrine Cather; Jennifer D Gottlieb; Patricia Marcy; Jennifer L Wiseman; Sheena Potretzke; Mary F Brunette; Nina R Schooler; Jean Addington; Robert A Rosenheck; Sue E Estroff; John M Kane Journal: Schizophr Res Date: 2018-08-20 Impact factor: 4.939
Authors: Alan B McGuire; Tom Bartholomew; Adrienne I Anderson; Sarah M Bauer; John H McGrew; Dominique A White; Lauren Luther; Angela Rollins; Angela Pereira; Michelle P Salyers Journal: Psychiatr Rehabil J Date: 2016-08-08
Authors: Alan B McGuire; Marina Kukla; Angela L Rollins; Jennifer Garabrant; Nancy Henry; Johanne Eliacin; Laura J Myers; Mindy E Flanagan; Marcia G Hunt; Gayle Y Iwamasa; Sarah M Bauer; Jessica L Carter; Michelle P Salyers Journal: Psychiatr Rehabil J Date: 2021-07-29