OBJECTIVE: To develop a model for adjusting patients' reports of behavioral health care experiences on the Experience of Care and Health Outcomes (ECHO) survey to allow for fair comparisons across health plans. DATA SOURCE: Survey responses from 4,068 individuals enrolled in 21 managed behavioral health plans who received behavioral health care within the previous year (response rate = 48 percent). STUDY DESIGN: Potential case-mix adjustors were evaluated by combining information about their predictive power and the amount of within- and between-plan variability. Changes in plan scores and rankings due to case-mix adjustment were quantified. PRINCIPAL FINDINGS: The final case-mix adjustment model included self-reported mental health status, self-reported general health status, alcohol/drug treatment, age, education, and race/ethnicity. The impact of adjustment on plan report scores was modest, but large enough to change some plan rankings. CONCLUSIONS: Adjusting plan report scores on the ECHO survey for differences in patient characteristics had modest effects, but still may be important to maintain the credibility of patient reports as a quality metric. Differences between those with self-reported fair/poor health compared with those in excellent/very good health varied by plan, suggesting quality differences associated with health status and underscoring the importance of collecting quality information.
OBJECTIVE: To develop a model for adjusting patients' reports of behavioral health care experiences on the Experience of Care and Health Outcomes (ECHO) survey to allow for fair comparisons across health plans. DATA SOURCE: Survey responses from 4,068 individuals enrolled in 21 managed behavioral health plans who received behavioral health care within the previous year (response rate = 48 percent). STUDY DESIGN: Potential case-mix adjustors were evaluated by combining information about their predictive power and the amount of within- and between-plan variability. Changes in plan scores and rankings due to case-mix adjustment were quantified. PRINCIPAL FINDINGS: The final case-mix adjustment model included self-reported mental health status, self-reported general health status, alcohol/drug treatment, age, education, and race/ethnicity. The impact of adjustment on plan report scores was modest, but large enough to change some plan rankings. CONCLUSIONS: Adjusting plan report scores on the ECHO survey for differences in patient characteristics had modest effects, but still may be important to maintain the credibility of patient reports as a quality metric. Differences between those with self-reported fair/poor health compared with those in excellent/very good health varied by plan, suggesting quality differences associated with health status and underscoring the importance of collecting quality information.
Authors: Elizabeth A McGlynn; Steven M Asch; John Adams; Joan Keesey; Jennifer Hicks; Alison DeCristofaro; Eve A Kerr Journal: N Engl J Med Date: 2003-06-26 Impact factor: 91.245
Authors: A James O'Malley; Alan M Zaslavsky; Marc N Elliott; Lawrence Zaborski; Paul D Cleary Journal: Health Serv Res Date: 2005-12 Impact factor: 3.402
Authors: Jay G Berry; Sara L Toomey; Alan M Zaslavsky; Ashish K Jha; Mari M Nakamura; David J Klein; Jeremy Y Feng; Shanna Shulman; Vincent W Chiang; Vincent K Chiang; William Kaplan; Matt Hall; Mark A Schuster Journal: JAMA Date: 2013-01-23 Impact factor: 56.272
Authors: Patricia Gallagher; Lin Ding; Hazen P Ham; Edward L Schor; Ron D Hays; Paul D Cleary Journal: Pediatrics Date: 2009-10-12 Impact factor: 7.124
Authors: Alisa Khan; Mari M Nakamura; Alan M Zaslavsky; Jisun Jang; Jay G Berry; Jeremy Y Feng; Mark A Schuster Journal: JAMA Pediatr Date: 2015-10 Impact factor: 16.193
Authors: Charlotte Paddison; Marc Elliott; Richard Parker; Laura Staetsky; Georgios Lyratzopoulos; John L Campbell; Martin Roland Journal: BMJ Qual Saf Date: 2012-05-23 Impact factor: 7.035
Authors: Farah Ahmad; Anuroop K Jhajj; Donna E Stewart; Madeline Burghardt; Arlene S Bierman Journal: BMC Health Serv Res Date: 2014-09-17 Impact factor: 2.655