PURPOSE: To determine whether framing questions positively or negatively influences residents' apparent satisfaction with their training. METHOD: In 1993-94, 276 residents at five Canadian internal medicine residency programs responded to 53 Likert-scale items designed to determine sources of the residents' satisfaction and stress. Two versions of the questionnaire were randomly distributed: one in which half the items were stated positively and the other half negatively, the other version in which the items were stated in the opposite way. RESULTS: The residents scored 43 of the 53 items higher when stated positively and scored ten higher when stated negatively (p < .0001). When analyzed using an analysis-of-variance model, the effect of positive versus negative framing was highly significant (F = 129.81, p < .0001). While the interaction between item and framing was also significant, the effect was much less strong (F = 5.56, p < .0001). On a scale where 1 represented the lowest possible level of satisfaction and 7 the highest, the mean score of the positively stated items was 4.1 and that of the negatively stated items, 3.8, an effect of 0.3. CONCLUSIONS: These results suggest a significant "response acquiescence bias." To minimize this bias, questionnaires assessing attitudes toward educational programs should include a mix of positively and negatively stated items.
PURPOSE: To determine whether framing questions positively or negatively influences residents' apparent satisfaction with their training. METHOD: In 1993-94, 276 residents at five Canadian internal medicine residency programs responded to 53 Likert-scale items designed to determine sources of the residents' satisfaction and stress. Two versions of the questionnaire were randomly distributed: one in which half the items were stated positively and the other half negatively, the other version in which the items were stated in the opposite way. RESULTS: The residents scored 43 of the 53 items higher when stated positively and scored ten higher when stated negatively (p < .0001). When analyzed using an analysis-of-variance model, the effect of positive versus negative framing was highly significant (F = 129.81, p < .0001). While the interaction between item and framing was also significant, the effect was much less strong (F = 5.56, p < .0001). On a scale where 1 represented the lowest possible level of satisfaction and 7 the highest, the mean score of the positively stated items was 4.1 and that of the negatively stated items, 3.8, an effect of 0.3. CONCLUSIONS: These results suggest a significant "response acquiescence bias." To minimize this bias, questionnaires assessing attitudes toward educational programs should include a mix of positively and negatively stated items.
Authors: Karen E A Burns; Mark Duffett; Michelle E Kho; Maureen O Meade; Neill K J Adhikari; Tasnim Sinuff; Deborah J Cook Journal: CMAJ Date: 2008-07-29 Impact factor: 8.262
Authors: Sam J van Sambeeck; Sanne J Martens; Tim Hundscheid; Etienne J Janssen; Gijs D Vos Journal: Eur J Pediatr Date: 2014-10-23 Impact factor: 3.183
Authors: Alan R Teo; Jason I Chen; Hiroaki Kubo; Ryoko Katsuki; Mina Sato-Kasai; Norihiro Shimokawa; Kohei Hayakawa; Wakako Umene-Nakano; James E Aikens; Shigenobu Kanba; Takahiro A Kato Journal: Psychiatry Clin Neurosci Date: 2018-07-27 Impact factor: 5.188