Ron D Hays1, Laura J Berman2, Michael H Kanter3, Mildred Hugh2, Rachel R Oglesby4, Chong Y Kim2, Mike Cui5, Julie Brown5. 1. UCLA Division of General Internal Medicine and Health Services Research, Los Angeles, California. Electronic address: drhays@ucla.edu. 2. Regulatory Relations and Performance Assessment, Southern California Permanente Medical Group, Kaiser Permanente, Pasadena, California. 3. Southern California Permanente Medical Group, Kaiser Permanente, Pasadena, California. 4. Market Research, Kaiser Permanente Northwest, Portland, Oregon. 5. RAND, Santa Monica, California.
Abstract
OBJECTIVE: The goal of this study was to evaluate the reliability and validity of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Patient-Centered Medical Home (PCMH) survey. METHODS: We conducted a field test of the CAHPS PCMH survey with 2740 adults. We collected information by mail (n = 1746), telephone (n = 672), and from the Web (n = 322) from 6 sites of care affiliated with a West Coast staff model health maintenance organization. RESULTS: An overall response rate of 37% was obtained. Internal consistency reliability estimates for 7 multi-item scales were as follows: access to care, 5 items, α = 0.79; communication with providers, 6 items, α = 0.93; office staff courtesy and respect, 2 items, α = 0.80; shared decision making about medicines, 3 items, α = 0.67; self-management support, 2 items, α = 0.61; attention to mental health issues, 3 items, α = 0.80; and care coordination, 4 items, α = 0.58. The number of responses needed to get reliable information at the site of care level for the composites was generally acceptable (<300 for 0.70 reliability-level) except for self-management support and shared decision making about medicines. Item-scale correlations provided support for distinct composites except for access to care and shared decision making about medicines, which overlapped with the communication with providers scale. Shared decision making and self-management support were significantly, uniquely associated with the global rating of the provider (dependent variable), along with access and communication in a multiple regression model. CONCLUSIONS: This study provides further support for the reliability and validity of the CAHPS PCMH survey, but refinement of the self-management support and shared decision-making scales is needed. The survey can be used to provide information about the performance of different health plans on multiple domains of health care, but future efforts to improve some of the survey items is needed.
OBJECTIVE: The goal of this study was to evaluate the reliability and validity of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Patient-Centered Medical Home (PCMH) survey. METHODS: We conducted a field test of the CAHPS PCMH survey with 2740 adults. We collected information by mail (n = 1746), telephone (n = 672), and from the Web (n = 322) from 6 sites of care affiliated with a West Coast staff model health maintenance organization. RESULTS: An overall response rate of 37% was obtained. Internal consistency reliability estimates for 7 multi-item scales were as follows: access to care, 5 items, α = 0.79; communication with providers, 6 items, α = 0.93; office staff courtesy and respect, 2 items, α = 0.80; shared decision making about medicines, 3 items, α = 0.67; self-management support, 2 items, α = 0.61; attention to mental health issues, 3 items, α = 0.80; and care coordination, 4 items, α = 0.58. The number of responses needed to get reliable information at the site of care level for the composites was generally acceptable (<300 for 0.70 reliability-level) except for self-management support and shared decision making about medicines. Item-scale correlations provided support for distinct composites except for access to care and shared decision making about medicines, which overlapped with the communication with providers scale. Shared decision making and self-management support were significantly, uniquely associated with the global rating of the provider (dependent variable), along with access and communication in a multiple regression model. CONCLUSIONS: This study provides further support for the reliability and validity of the CAHPS PCMH survey, but refinement of the self-management support and shared decision-making scales is needed. The survey can be used to provide information about the performance of different health plans on multiple domains of health care, but future efforts to improve some of the survey items is needed.
Authors: Sarah Hudson Scholle; Oanh Vuong; Lin Ding; Stephanie Fry; Patricia Gallagher; Julie A Brown; Ron D Hays; Paul D Cleary Journal: Med Care Date: 2012-11 Impact factor: 2.983
Authors: Denise D Quigley; Marc N Elliott; Donna O Farley; Q Burkhart; Samuel A Skootsky; Ron D Hays Journal: J Gen Intern Med Date: 2013-10-26 Impact factor: 5.128
Authors: Ron D Hays; Steven Martino; Julie A Brown; Mike Cui; Paul Cleary; Sarah Gaillot; Marc Elliott Journal: Med Care Res Rev Date: 2013-11-13 Impact factor: 3.929
Authors: Robert M Cronin; Manshu Yang; Jane S Hankins; Jeannie Byrd; Brandi M Pernell; Adetola Kassim; Patricia Adams-Graves; Alexis A Thompson; Karen Kalinyak; Michael DeBaun; Marsha Treadwell Journal: Hematology Date: 2020-12 Impact factor: 2.269
Authors: Gerardo Moreno; Elizabeth H Lin; Eva Chang; Ron L Johnson; Heidi Berthoud; Cam C Solomon; Leo S Morales Journal: J Gen Intern Med Date: 2015-08-27 Impact factor: 5.128
Authors: Audrey L Jones; Stefan G Kertesz; Leslie R M Hausmann; Maria K Mor; Ying Suo; Warren B P Pettey; James H Schaefer; Adi V Gundlapalli; Adam J Gordon Journal: J Subst Abuse Treat Date: 2020-02-29
Authors: Richard L Kravitz; Christopher H Schmid; Maria Marois; Barth Wilsey; Deborah Ward; Ron D Hays; Naihua Duan; Youdan Wang; Scott MacDonald; Anthony Jerant; Joseph L Servadio; David Haddad; Ida Sim Journal: JAMA Intern Med Date: 2018-10-01 Impact factor: 21.873
Authors: Issidoros Sarinopoulos; Diane L Bechel-Marriott; Jean M Malouin; Shaohui Zhai; Jason C Forney; Clare L Tanner Journal: J Gen Intern Med Date: 2017-08-14 Impact factor: 5.128
Authors: Kathleen M Mazor; Richard L Street; Valerie M Sue; Andrew E Williams; Borsika A Rabin; Neeraj K Arora Journal: Patient Educ Couns Date: 2016-03-06