Patrick Taffé1. 1. Center for Primary Care and Public Health (unisanté), DFRI/Division of Biostatistics, University of Lausanne, Switzerland. Electronic address: patrick.taffe@unisante.ch.
Abstract
OBJECTIVES: The Bland and Altman limits of agreement (LoA) method is almost universally used to compare two measurement methods, when the outcome is continuous. The method relies on strong statistical assumptions, which are unlikely to hold in practice. Given the popularity of this simple method, it is timely to explain when it can be safely used and when it should not be used. STUDY DESIGN AND SETTINGS: Based on a small sample of simulated data where the truth is known, we illustrate what happens when the LoA method is used and the underlying assumptions are violated. RESULTS: When each measurement method has a different precision or the systematic difference between the two methods is not constant, the LoA method should not be used. For this setting, we refer to an alternative unbiased statistical method, which comes at the cost of having to gather repeated measurements by at least one of the two measurement methods. CONCLUSION: The LoA method is valid under very restrictive conditions and when these conditions do not hold the only way out is to gather repeated measurements by at least one of the two measurement methods and use an alternative existing statistical methodology.
OBJECTIVES: The Bland and Altman limits of agreement (LoA) method is almost universally used to compare two measurement methods, when the outcome is continuous. The method relies on strong statistical assumptions, which are unlikely to hold in practice. Given the popularity of this simple method, it is timely to explain when it can be safely used and when it should not be used. STUDY DESIGN AND SETTINGS: Based on a small sample of simulated data where the truth is known, we illustrate what happens when the LoA method is used and the underlying assumptions are violated. RESULTS: When each measurement method has a different precision or the systematic difference between the two methods is not constant, the LoA method should not be used. For this setting, we refer to an alternative unbiased statistical method, which comes at the cost of having to gather repeated measurements by at least one of the two measurement methods. CONCLUSION: The LoA method is valid under very restrictive conditions and when these conditions do not hold the only way out is to gather repeated measurements by at least one of the two measurement methods and use an alternative existing statistical methodology.
Authors: Nicole Rübsamen; Eline A J Willemse; David Leppert; Heinz Wiendl; Matthias Nauck; André Karch; Jens Kuhle; Klaus Berger Journal: Front Neurol Date: 2022-06-14 Impact factor: 4.086