Viswas Chhapola1, Sandeep Kumar Kanwal2, Rekha Brar3. 1. Department of Paediatrics, Division of Paediatric Intensive Care, Lady Hardinge Medical College and Associated Kalawati Saran Children's Hospital, New Delhi, India viswaschhapola@gmail.com. 2. Department of Paediatrics, Division of Paediatric Intensive Care, Lady Hardinge Medical College and Associated Kalawati Saran Children's Hospital, New Delhi, India. 3. ESI Corporation, New Delhi, India.
Abstract
BACKGROUND AND OBJECTIVES: To carry out a cross-sectional survey of the medical literature on laboratory research papers published later than 2012 and available in the common search engines (PubMed, Google Scholar) on the quality of statistical reporting of method comparison studies using Bland-Altman (B-A) analysis. METHODS: Fifty clinical studies were identified which had undertaken method comparison of laboratory analytes using B-A. The reporting of B-A was evaluated using a predesigned checklist with following six items: (1) correct representation of x-axis on B-A plot, (2) representation and correct definition of limits of agreement (LOA), (3) reporting of confidence interval (CI) of LOA, (4) comparison of LOA with a priori defined clinical criteria, (5) evaluation of the pattern of the relationship between difference (y-axis) and average (x-axis) and (6) measures of repeatability. RESULTS AND INTERPRETATION: The x-axis and LOA were presented correctly in 94%, comparison with a priori clinical criteria in 74%, CI reporting in 6%, evaluation of pattern in 28% and repeatability assessment in 38% of studies. CONCLUSIONS: There is incomplete reporting of B-A in published clinical studies. Despite its simplicity, B-A appears not to be completely understood by researchers, reviewers and editors of journals. There appear to be differences in the reporting of B-A between laboratory medicine journals and other clinical journals. A uniform reporting of B-A method will enhance the generalizability of results.
BACKGROUND AND OBJECTIVES: To carry out a cross-sectional survey of the medical literature on laboratory research papers published later than 2012 and available in the common search engines (PubMed, Google Scholar) on the quality of statistical reporting of method comparison studies using Bland-Altman (B-A) analysis. METHODS: Fifty clinical studies were identified which had undertaken method comparison of laboratory analytes using B-A. The reporting of B-A was evaluated using a predesigned checklist with following six items: (1) correct representation of x-axis on B-A plot, (2) representation and correct definition of limits of agreement (LOA), (3) reporting of confidence interval (CI) of LOA, (4) comparison of LOA with a priori defined clinical criteria, (5) evaluation of the pattern of the relationship between difference (y-axis) and average (x-axis) and (6) measures of repeatability. RESULTS AND INTERPRETATION: The x-axis and LOA were presented correctly in 94%, comparison with a priori clinical criteria in 74%, CI reporting in 6%, evaluation of pattern in 28% and repeatability assessment in 38% of studies. CONCLUSIONS: There is incomplete reporting of B-A in published clinical studies. Despite its simplicity, B-A appears not to be completely understood by researchers, reviewers and editors of journals. There appear to be differences in the reporting of B-A between laboratory medicine journals and other clinical journals. A uniform reporting of B-A method will enhance the generalizability of results.
Authors: Lynn Zhu; Christian Duval; Patrick Boissy; Manuel Montero-Odasso; Guangyong Zou; Mandar Jog; Mark Speechley Journal: J Gerontol A Biol Sci Med Sci Date: 2020-11-13 Impact factor: 6.053
Authors: Ellen M Cody; Michael R Bennett; Gaurav Gulati; Qing Ma; Mekibib Altaye; Prasad Devarajan; Hermine I Brunner Journal: Kidney Int Rep Date: 2021-04-28
Authors: Pamela Barrios; Jennifer Martin-Biggers; Virginia Quick; Carol Byrd-Bredbenner Journal: BMC Med Res Methodol Date: 2016-05-04 Impact factor: 4.615
Authors: Manas R Gartia; Santosh K Misra; Mao Ye; Aaron Schwartz-Duval; Lisa Plucinski; Xiangfei Zhou; David Kellner; Leanne T Labriola; Dipanjan Pan Journal: Sci Rep Date: 2015-11-03 Impact factor: 4.379