OBJECTIVE: To investigate whether a training process that focused on a questionnaire-based diagnosis in Traditional Chinese Medicine (TCM), and developing diagnostic consensus, would improve the agreement of TCM diagnoses among 10 TCM practitioners evaluating patients with temporomandibular joint disorder (TMJD). DESIGN AND SETTING: Evaluation of a diagnostic training program at the Department of Family and Community Medicine, University of Arizona, Tucson, Arizona, and the Oregon College of Oriental Medicine, Portland, Oregon. SUBJECTS: Screened participants for a study of TCM for TMJD. PRACTITIONERS: Ten (10) licensed acupuncturists with a minimum of 5 years licensure and education in Chinese herbs. METHODS: A training session using a questionnaire-based diagnostic form was conducted, followed by waves of diagnostic sessions. Between sessions, practitioners discussed the results of the previous round of participants with a focus on reducing variability in primary diagnosis and severity rating of each diagnosis: 3 waves of 5 patients were assessed by 4 practitioner pairs for a total of 120 diagnoses. At 18 months, practitioners completed a recalibration exercise with a similar format with a total of 32 diagnoses. These diagnoses were then examined with respect to the rate of agreement among the 10 practitioners using inter-rater correlations and kappas. RESULTS: The inter-rater correlation with respect to the TCM diagnoses among the 10 practitioners increased from 0.112 to 0.618 with training. Statistically significant improvements were found between the baseline and 18 month exercises (p < 0.01). CONCLUSIONS: Inter-rater reliability of TCM diagnosis may be improved through a training process and a questionnaire-based diagnosis process. The improvements varied by diagnosis, with the greatest congruence among primary and more severe diagnoses. Future TCM studies should consider including calibration training to improve the validity of results.
OBJECTIVE: To investigate whether a training process that focused on a questionnaire-based diagnosis in Traditional Chinese Medicine (TCM), and developing diagnostic consensus, would improve the agreement of TCM diagnoses among 10 TCM practitioners evaluating patients with temporomandibular joint disorder (TMJD). DESIGN AND SETTING: Evaluation of a diagnostic training program at the Department of Family and Community Medicine, University of Arizona, Tucson, Arizona, and the Oregon College of Oriental Medicine, Portland, Oregon. SUBJECTS: Screened participants for a study of TCM for TMJD. PRACTITIONERS: Ten (10) licensed acupuncturists with a minimum of 5 years licensure and education in Chinese herbs. METHODS: A training session using a questionnaire-based diagnostic form was conducted, followed by waves of diagnostic sessions. Between sessions, practitioners discussed the results of the previous round of participants with a focus on reducing variability in primary diagnosis and severity rating of each diagnosis: 3 waves of 5 patients were assessed by 4 practitioner pairs for a total of 120 diagnoses. At 18 months, practitioners completed a recalibration exercise with a similar format with a total of 32 diagnoses. These diagnoses were then examined with respect to the rate of agreement among the 10 practitioners using inter-rater correlations and kappas. RESULTS: The inter-rater correlation with respect to the TCM diagnoses among the 10 practitioners increased from 0.112 to 0.618 with training. Statistically significant improvements were found between the baseline and 18 month exercises (p < 0.01). CONCLUSIONS: Inter-rater reliability of TCM diagnosis may be improved through a training process and a questionnaire-based diagnosis process. The improvements varied by diagnosis, with the greatest congruence among primary and more severe diagnoses. Future TCM studies should consider including calibration training to improve the validity of results.
Authors: Cheryl Ritenbaugh; Marja Verhoef; Susan Fleishman; Heather Boon; Ann Leis Journal: Altern Ther Health Med Date: 2003 Jul-Aug Impact factor: 1.305
Authors: Marja J Verhoef; George Lewith; Cheryl Ritenbaugh; Heather Boon; Susan Fleishman; Anne Leis Journal: Complement Ther Med Date: 2005-09 Impact factor: 2.446
Authors: Charles Elder; Mikel Aickin; Iris R Bell; Vinjar Fønnebø; George T Lewith; Cheryl Ritenbaugh; Marja Verhoef Journal: J Altern Complement Med Date: 2006-11 Impact factor: 2.579
Authors: J J Y Sung; W K Leung; J Y L Ching; L Lao; G Zhang; J C Y Wu; S M Liang; H Xie; Y P Ho; L S Chan; B Berman; F K L Chan Journal: Aliment Pharmacol Ther Date: 2004-11-15 Impact factor: 8.171
Authors: Grant G Zhang; Barker Bausell; Lixing Lao; Barry Handwerger; Brian M Berman Journal: Altern Ther Health Med Date: 2003 Jan-Feb Impact factor: 1.305
Authors: Cheryl Ritenbaugh; Richard Hammerschlag; Samuel F Dworkin; Mikel G Aickin; Scott D Mist; Charles R Elder; Richard E Harris Journal: J Pain Date: 2012-10-09 Impact factor: 5.820
Authors: Scott D Mist; Mikel Aickin; Paul Kalnins; Jim Cleaver; Roger Batchelor; Tracy Thorne; Steve Chamberlin; Kim Tippens; Agatha P Colbert Journal: Acupunct Med Date: 2011-05-20 Impact factor: 2.267
Authors: Rosa N Schnyer; Patrick McKnight; Lisa A Conboy; Eric Jacobson; Anna T Ledegza; Mary T Quilty; Roger B Davis; Peter M Wayne Journal: J Altern Complement Med Date: 2019-11 Impact factor: 2.579
Authors: Eric Jacobson; Lisa Conboy; Dolma Tsering; Monica Shields; Patrick McKnight; Peter M Wayne; Rosa Schnyer Journal: J Altern Complement Med Date: 2019-11 Impact factor: 2.579