Michael Popplewell1, John Reizes2, Chris Zaslawski3. 1. Wentworth Clinic, Sydney, Australia. 2. Faculty of Engineering, University of Technology, Sydney, Sydney, Australia. 3. School of Life Sciences, University of Technology, Sydney, Sydney, Australia.
Abstract
Objectives: An acceptable level of diagnostic agreement is a prerequisite for consistent administration of treatment. It is critical for investigating effectiveness of different treatment approaches using multiple practitioners. To the best of our knowledge, no previous investigation of diagnostic consensus using open populations in Chinese medicine (CM) has been reported. Investigations restricted to individual medical conditions, such as have been usually studied, do not reveal any information as to what occurs in real world clinical settings. This knowledge gap led to the current study being conducted. Design/Location/Subjects/Interventions: Investigating diagnostic agreement specifically in Traditional Chinese Medicine (TCM) in an open population, two or three practitioners diagnosed 35 subjects at the University of Technology, Sydney (UTS), TCM clinic. The practitioners were restricted to a list of the 56 most frequently used TCM diagnoses at the UTS clinic. Up to three diagnostic patterns per subject could be selected, with nominated patterns scored between 1 and 5. Outcome measures: Agreement was determined with two criteria, both expressed as simple percentages: pattern and linearly weighted agreements. Results: The results showed that 23% of practitioners obtained pattern agreement, while 19% demonstrated weighted agreement. Conclusion: There appears to be very low diagnostic agreement between practitioners. This is an important finding. If unchallenged by further investigation, the recognition of such poor diagnostic consensus may lead to rejection of TCM theory before it has been adequately assessed. Diagnostic agreement must be improved so that future investigations into treatment effectiveness or mechanisms of action are made on a valid basis. Additionally, the current TCM diagnostic format must be altered to allow the application of chance-removed statistics or the calculation of a standard error with open populations. This article is the first of a series of three that report problems in TCM diagnostic reliability and proposes solutions to the issues outlined.
Objectives: An acceptable level of diagnostic agreement is a prerequisite for consistent administration of treatment. It is critical for investigating effectiveness of different treatment approaches using multiple practitioners. To the best of our knowledge, no previous investigation of diagnostic consensus using open populations in Chinese medicine (CM) has been reported. Investigations restricted to individual medical conditions, such as have been usually studied, do not reveal any information as to what occurs in real world clinical settings. This knowledge gap led to the current study being conducted. Design/Location/Subjects/Interventions: Investigating diagnostic agreement specifically in Traditional Chinese Medicine (TCM) in an open population, two or three practitioners diagnosed 35 subjects at the University of Technology, Sydney (UTS), TCM clinic. The practitioners were restricted to a list of the 56 most frequently used TCM diagnoses at the UTS clinic. Up to three diagnostic patterns per subject could be selected, with nominated patterns scored between 1 and 5. Outcome measures: Agreement was determined with two criteria, both expressed as simple percentages: pattern and linearly weighted agreements. Results: The results showed that 23% of practitioners obtained pattern agreement, while 19% demonstrated weighted agreement. Conclusion: There appears to be very low diagnostic agreement between practitioners. This is an important finding. If unchallenged by further investigation, the recognition of such poor diagnostic consensus may lead to rejection of TCM theory before it has been adequately assessed. Diagnostic agreement must be improved so that future investigations into treatment effectiveness or mechanisms of action are made on a valid basis. Additionally, the current TCM diagnostic format must be altered to allow the application of chance-removed statistics or the calculation of a standard error with open populations. This article is the first of a series of three that report problems in TCM diagnostic reliability and proposes solutions to the issues outlined.
Keywords:
Chinese medicine; agreement; diagnosis; diagnostic format; diagnostic reliability; inter-rater
Authors: Eric Jacobson; Lisa Conboy; Dolma Tsering; Monica Shields; Patrick McKnight; Peter M Wayne; Rosa Schnyer Journal: J Altern Complement Med Date: 2019-11 Impact factor: 2.579