OBJECTIVE: To test the effect of survey conditioning (whether observed survey responses are affected by previous experience in the same survey or similar surveys) in a survey instrument used to assess mental health service use. DATA SOURCES: Primary data collected in the National Latino and Asian American Study, a cross-sectional household survey of Latinos and Asian Americans residing in the United States. STUDY DESIGN: Study participants are randomly assigned to a Traditional Instrument with an interleafed format placing service use questions after detailed questions on disorders, or a Modified Instrument with an ensemble format screening for service use near the beginning of the survey. We hypothesize the ensemble format to be less susceptible to survey conditioning than the interleafed format. We compare self-reported mental health services use measures (overall, aggregate categories, and specific categories) between recipients of the two instruments, using 2x2 chi(2) tests and logistic regressions that control for key covariates. DATA COLLECTION: In-person computer-assisted interviews, conducted in respondent's preferred language (English, Spanish, Mandarin Chinese, Tagalog, or Vietnamese). PRINCIPAL FINDINGS: Higher service use rates are reported with the Modified Instrument than with the Traditional Instrument for all service use measures; odds ratios range from 1.41 to 3.10, all p-values <.001. Results are similar across ethnic groups and insensitive to model specification. CONCLUSIONS:Survey conditioning biases downward reported mental health service use when the instrument follows an interleafed format. An ensemble format should be used when it is feasible for measures that are susceptible to survey conditioning.
RCT Entities:
OBJECTIVE: To test the effect of survey conditioning (whether observed survey responses are affected by previous experience in the same survey or similar surveys) in a survey instrument used to assess mental health service use. DATA SOURCES: Primary data collected in the National Latino and Asian American Study, a cross-sectional household survey of Latinos and Asian Americans residing in the United States. STUDY DESIGN: Study participants are randomly assigned to a Traditional Instrument with an interleafed format placing service use questions after detailed questions on disorders, or a Modified Instrument with an ensemble format screening for service use near the beginning of the survey. We hypothesize the ensemble format to be less susceptible to survey conditioning than the interleafed format. We compare self-reported mental health services use measures (overall, aggregate categories, and specific categories) between recipients of the two instruments, using 2x2 chi(2) tests and logistic regressions that control for key covariates. DATA COLLECTION: In-person computer-assisted interviews, conducted in respondent's preferred language (English, Spanish, Mandarin Chinese, Tagalog, or Vietnamese). PRINCIPAL FINDINGS: Higher service use rates are reported with the Modified Instrument than with the Traditional Instrument for all service use measures; odds ratios range from 1.41 to 3.10, all p-values <.001. Results are similar across ethnic groups and insensitive to model specification. CONCLUSIONS: Survey conditioning biases downward reported mental health service use when the instrument follows an interleafed format. An ensemble format should be used when it is feasible for measures that are susceptible to survey conditioning.
Authors: Steven G Heeringa; James Wagner; Myriam Torres; Naihua Duan; Terry Adams; Patricia Berglund Journal: Int J Methods Psychiatr Res Date: 2004 Impact factor: 4.035
Authors: J Piacentini; M Roper; P Jensen; C Lucas; P Fisher; H Bird; K Bourdon; M Schwab-Stone; M Rubio-Stipec; M Davies; M Dulcan Journal: J Abnorm Child Psychol Date: 1999-12
Authors: C P Lucas; P Fisher; J Piacentini; H Zhang; P S Jensen; D Shaffer; M Dulcan; M Schwab-Stone; D Regier; G Canino Journal: J Abnorm Child Psychol Date: 1999-12
Authors: P Jensen; M Roper; P Fisher; J Piacentini; G Canino; J Richters; M Rubio-Stipec; M Dulcan; S Goodman; M Davies Journal: Arch Gen Psychiatry Date: 1995-01
Authors: Jeffrey W Swanson; Nancy A Sampson; Maria V Petukhova; Alan M Zaslavsky; Paul S Appelbaum; Marvin S Swartz; Ronald C Kessler Journal: Behav Sci Law Date: 2015-04-08
Authors: Patrick E Shrout; Gertraud Stadler; Sean P Lane; M Joy McClure; Grace L Jackson; Frederick D Clavél; Masumi Iida; Marci E J Gleason; Joy H Xu; Niall Bolger Journal: Proc Natl Acad Sci U S A Date: 2017-12-18 Impact factor: 11.205
Authors: R Mojtabai; M Olfson; N A Sampson; R Jin; B Druss; P S Wang; K B Wells; H A Pincus; R C Kessler Journal: Psychol Med Date: 2010-12-07 Impact factor: 7.723