Marziyeh Doostfatemeh1, Seyyed Mohammad Taghi Ayatollah2, Peyman Jafari1. 1. Department of Biostatistics, Shiraz University of Medical Sciences, Shiraz, Iran. 2. Department of Biostatistics, Shiraz University of Medical Sciences, Shiraz, Iran. Electronic address: ayatolahim@sums.ac.ir.
Abstract
OBJECTIVES: To provide a valid sample size strategy based on simulation and to evaluate the statistical power in clinical trials with patient-reported outcomes (PROs) based on a polytomous item response theory model-the graded response model (GRM)-and to compare this framework with the classical test theory (CTT) approach. METHODS: One thousand randomized clinical trials were simulated using PRO based on the GRM and under various combinations of the number of patients in each arm, the group allocation ratio, the number of items and categories, and group effects. The power and sample size estimated in the simulations were then compared with those computed using the CTT framework. RESULTS: The results indicated that the impact of the most influential factors, including the number of patients, group allocation ratio, group effects, and the number of categories, on the power and sample size of the GRM-based and CTT-based approaches was similar. Nevertheless, the strong impact of the number of items on these issues distinguished the two approaches. CONCLUSIONS: It is crucial to use an adapted sample size formula in a GRM-based analysis because the classical formula designed for the CTT-based approach does not consider the impact of the number of items, which could result in an inadequately sized study and a decrease in power. Thus, when clinicians design a randomized clinical trial with polytomous PRO endpoints using classical sample size formula as the base, they should be aware of the possibility of making an incorrect clinical decision.
OBJECTIVES: To provide a valid sample size strategy based on simulation and to evaluate the statistical power in clinical trials with patient-reported outcomes (PROs) based on a polytomous item response theory model-the graded response model (GRM)-and to compare this framework with the classical test theory (CTT) approach. METHODS: One thousand randomized clinical trials were simulated using PRO based on the GRM and under various combinations of the number of patients in each arm, the group allocation ratio, the number of items and categories, and group effects. The power and sample size estimated in the simulations were then compared with those computed using the CTT framework. RESULTS: The results indicated that the impact of the most influential factors, including the number of patients, group allocation ratio, group effects, and the number of categories, on the power and sample size of the GRM-based and CTT-based approaches was similar. Nevertheless, the strong impact of the number of items on these issues distinguished the two approaches. CONCLUSIONS: It is crucial to use an adapted sample size formula in a GRM-based analysis because the classical formula designed for the CTT-based approach does not consider the impact of the number of items, which could result in an inadequately sized study and a decrease in power. Thus, when clinicians design a randomized clinical trial with polytomous PRO endpoints using classical sample size formula as the base, they should be aware of the possibility of making an incorrect clinical decision.
Authors: Cheryl Carrico; Philip M Westgate; Elizabeth Salmon Powell; Kenneth C Chelette; Laurie Nichols; L Creed Pettigrew; Lumy Sawaki Journal: Am J Phys Med Rehabil Date: 2018-11 Impact factor: 2.159
Authors: Yassine Kamal Lyauk; Daniël M Jonker; Trine Meldgaard Lund; Andrew C Hooker; Mats O Karlsson Journal: AAPS J Date: 2020-08-27 Impact factor: 4.009