Empirical comparison of four baseline covariate adjustment methods in analysis of continuous outcomes in randomized controlled trials.

BACKGROUND: Although seemingly straightforward, the statistical comparison of a continuous variable in a randomized controlled trial that has both a pre- and posttreatment score presents an interesting challenge for trialists. We present here empirical application of four statistical methods (posttreatment scores with analysis of variance, analysis of covariance, change in scores, and percent change in scores), using data from a randomized controlled trial of postoperative pain in patients following total joint arthroplasty (the Morphine COnsumption in Joint Replacement Patients, With and Without GaBapentin Treatment, a RandomIzed ControlLEd Study [MOBILE] trials).
METHODS: Analysis of covariance (ANCOVA) was used to adjust for baseline measures and to provide an unbiased estimate of the mean group difference of the 1-year postoperative knee flexion scores in knee arthroplasty patients. Robustness tests were done by comparing ANCOVA with three comparative methods: the posttreatment scores, change in scores, and percentage change from baseline.
RESULTS: All four methods showed similar direction of effect; however, ANCOVA (-3.9; 95% confidence interval [CI]: -9.5, 1.6; P=0.15) and the posttreatment score (-4.3; 95% CI: -9.8, 1.2; P=0.12) method provided the highest precision of estimate compared with the change score (-3.0; 95% CI: -9.9, 3.8; P=0.38) and percent change (-0.019; 95% CI: -0.087, 0.050; P=0.58).
CONCLUSION: ANCOVA, through both simulation and empirical studies, provides the best statistical estimation for analyzing continuous outcomes requiring covariate adjustment. Our empirical findings support the use of ANCOVA as an optimal method in both design and analysis of trials with a continuous primary outcome.

RCT Entities:   Population Interventions Outcomes

Introduction

Continuous outcomes are one of the most common types of outcomes used in clinical trials. They are easy to interpret for statistician and clinicians alike. For instance blood pressure, glucose level, or forced expiratory volume in one second (FEV1) are continuous in nature and understandable without requiring much manipulation to the data.

In a number of research fields, such as psychology, education, pain, and quality of life, a common randomized controlled trial (RCT) design involves the measurement of the primary outcome in the comparator groups at two time points. The measurement occurs before (commonly known as baseline or covariate values) and after the treatment.1 This type of baseline-controlled design can be a very statistically powerful design to evaluate causal factors since adjustment of unbalanced covariates can be properly done in order to isolate the factors at work.2–5 This design is often of great use to evaluators because it can control for all of the major threats to internal validity, such as maturation, selection, and instrumentation.6

Clinical problem: Inconsistency in choosing the method for baseline adjustment

Although seemingly straightforward, the statistical comparison of a continuous variable in an RCT that has both a pre- and posttreatment score presents an interesting challenge for clinician and statistician. The statistical properties of baseline adjustment methods are complex and often poorly understood, resulting in confusion about the choice of the most appropriate statistical strategy.7 Assman et al analyzed a sample of 50 trials from four top medical journals, British Medical Journal, Journal of the American Medical Association, The Lancet, and New England Journal of Medicine,8 and reported the use of seven different covariate-adjustment methods. The lack of consistency in the literature on pre–post design further contributes to the difficulty of establishing a standard statistical method. The inconsistency often relates to whether covariate adjustment is appropriate for the analysis and the selection of baseline factors for the adjustment.

Critical appraisal of four adjustment methods

There are a number of baseline adjustment methods commonly used in clinical trials, for reasons of ease of interpretation, ease of analysis, convenience, and historical factors. Statisticians have evaluated the methods to determine the most appropriate estimate of size, precision, and P-value for the treatment difference.9,10 The four methods examined are: posttreatment comparison (no baseline adjustment), analysis of covariance (ANCOVA), change score, and percent change score.2–4 Specifically, for each method, a brief description of the method and the advantages and disadvantages are described.

Posttreatment comparison

In this method, analysis is done on the outcome of interest, with no covariate adjustment, testing one or more continuous variables that predict the outcome of interest. There are a number of advantages of comparing simply the unadjusted outcome, including minimal influence by a secondary outcome, straightforward interpretation of the result, and the short time required for the analysis – this is the least time consuming method. Moreover, for most clinical trials, analyses adjusting for baseline covariates yield similar results compared with the simpler unadjusted treatment comparisons.8

Another rationale for using the posttreatment score method with a simple analysis of variance (ANOVA) or Student’s t-test is that in practice, randomization allows for a balanced baseline measure in both treatment groups, and thus, covariate adjustment is deemed unnecessary. This assumption of balanced baseline variable can, however, be violated even in the perfectly designed RCT, and the effect is especially magnified in trials with a small sample size.11 In fact, results from simulation studies have shown that when the baseline is adjusted, the analysis of posttreatment score can be different.12

Analysis of covariance

In recent published literature, the use of ANCOVA as the statistical method of choice for the analysis of intervention effect and adjustment for baseline variables has been advocated.13–18 ANCOVA uses the baseline result as a covariate in the analysis. In addition to the grouping factor and the outcome of the posttreatment score, an additional covariate term is introduced that allows for a statistical adjustment based on the baseline score.

There are three reasons for using ANCOVA in the analysis of continuous outcomes – efficiency, precision, and power. In RCTs, when the treatment and placebo group have the same expected mean baseline values, both the posttreatment score method and the ANCOVA model will provide an unbiased estimate of the true treatment effect.11 However, ANCOVA provides the advantage of greater efficiency and better statistical power, even under unbiased conditions and with controlled α-levels. Even in the presence of measurement error or other within-patient variations, the ANCOVA approach based on the observed data provides an unbiased estimate, and better precision and a more powerful test than the ANOVA.

The main disadvantage of ANCOVA is the underlying assumption of no difference across groups or treatment arms in terms of the covariate used in the analysis and the homogeneity of regression slopes. In RCTs where the covariates differ across the treatment arms, the overall regression model will provide inaccurate estimates and therefore use of ANCOVA should be avoided.

Change score between posttreatment and baseline

Clinical trials with quality of life as an outcome often calculate it by subtracting the baseline value from the follow-up or posttreatment value. This is often referred to as a change score or sometimes (optimistically) the gain score, and it directly represents the change that is reported or measured before and after the treatment. Using change score may provide an advantage over ANCOVA because it is not necessary to assume that baseline variables are measured without error.13 Even in ANCOVA models that attempt to adjust for measurement error, the estimate of treatment effect remains biased.19 However, one issue with the change score method is that the “regression to the mean” effect could be substantially different between the comparator groups.

Percent change score between posttreatment score and baseline

A modification of the change score that preserves some of the information of the baseline result is calculation of the change score as a percentage. Percent change score is calculated by normalizing the change score using the baseline data. It can be considered an improvement to represent the change pre-and posttreatment in a normalized fashion, which increases comparability across subjects. However, one major concern is that normalizing the data may alter the distribution of the data and may introduce additional complexity to the analysis.

Study objective

In this study, four methods of baseline adjustment were used to demonstrate empirically whether the ANCOVA is statistically efficient compared with statistical analysis by posttreatment score, change score, or percent change score. To compare methods, previously reported outcome data20 (flexion range of motion) was analyzed using ANCOVA and the other three methods outlined above. The robustness of the latter three methods was evaluated by qualitatively comparing the direction and magnitude of effect, the precision of the estimate, and the ease of interpretation of the results. The study also sought to identify the best approach to handle missing data in clinical trials. This was done through the use of multiple imputation (MI), where a sensitivity analysis was done by conducting a complete-case analysis (CCA).21

Methods

Current literature review and summary

A search of published literature on baseline adjustment methods was conducted to summarize the available information on the use of the statistical methods and their impact on the results of studies. Three different designs of studies were included in the search; descriptive, empirical, and simulation studies. Descriptive studies were defined, in this study, as “systematic reviews or compilation studies where a cohort of studies is summarized to address the current knowledge on the topic area.” Empirical studies were defined as “studies where data from another previously published study is subjected to reanalyses using different statistical methods to compare and contrast the methods and results.” Simulation studies were “studies where statistical methods are compared in terms of statistical power and other parameters, using statistical and mathematical simulation.” Studies of these designs were compiled and results were summarized in terms of the impact of the method on the results and the author’s assessment of the choice of the most appropriate statistical method.

We also sought to conduct an empirical study to examine the four baseline covariate adjustment methods. Empirical data from The Morphine COnsumption in Joint Replacement Patients, With and Without GaBapentin Treatment, a RandomIzed ControlLEd Study (MOBILE trial)20 was used to demonstrate the performance of different baseline adjustment methods and their effect on the statistical comparison. The statistical properties of covariate adjustments were examined in terms of several aims, including: 1) the direction of the treatment difference; 2) the magnitude of the treatment difference; and 3) the precision of the treatment difference.9,10

Description of MOBILE trial: total knee arthroplasty

In a single-center, blinded, randomized, placebo-controlled study, 102 patients were randomized to receive either gabapentin or placebo, in addition to standard of care, 2 hours before undergoing total knee arthroplasty.20 Morphine consumption at 72 hours was the primary end point of the trial. Secondary outcomes included knee flexion score, pain score on a visual analog scale, and side effects. In the trial, the statistical analysis was done without the adjustment of baseline covariates, and a posttreatment score comparison was reported for the knee flexion variable.

For patients undergoing total knee arthroplasty, the variables used for analysis were flexion range of motion preoperatively and at 1 year after the procedure. Other than patient identification, group assignment, and the two flexion range-of-motion values, the baseline and postoperative variables included in the data collection process were: sex, weight, height, American Society of Anesthesiologists (ASA) physical status classification system, systolic blood pressure, diastolic blood pressure, pain at rest at the four different time points, pain with passive movement at the time points, pain with weight-bearing at the same four different time points. The percentage of missing data for these variables ranged from 0.0% (five variables) to 15.9% (only pain with weight-bearing at time 3). To follow an intention-to-treat analysis, where all patients randomized were included in the analysis, these variables were included in the MI strategy. In the MI process, all of these variables were imputed in a coherent process, using the Markov chain Monte Carlo (MCMC) method.22 Five iterations of the MI process were used for the analyses of the knee flexion range-of-motion data, and MIANALYZE, a procedure in SAS (SAS Institute, Inc., Cary, NC, USA), was used to combine the estimates from each of the five iterations.22

Analysis of postoperative knee flexion range of motion, adjusting for baseline

Four baseline adjustment methods were used to obtain a statistical comparison of the control against the active group. ANCOVA was used and the pretreatment knee flexion range-of-motion score was used as a covariate to determine the treatment effect after data imputation by MI. The treatment effect estimate, 95% confidence interval (CI), and P-value were summarized. All statistical tests were performed using SAS (SAS 9.2 (32) English).

Sensitivity analysis

Two robustness tests were conducted to evaluate sensitivity. Specifically, a robustness test was done to determine the sensitivity of the results to the method of analysis, and another test was done to determine the sensitivity to missing data.

Robustness of posttreatment, change, and percent change analysis

Three other methods were used as comparators with the ANCOVA analysis to determine the sensitivity of the results to the choice of baseline adjustment method. The other three baseline adjustment methods were: comparing the posttreatment scores only, with no baseline adjustment; comparing the change score by subtracting the baseline from the posttreatment score; and comparing the percent change score obtained from normalizing the change score by dividing the change score by the pretreatment score (Figure 1). For the purposes of this robustness test, data were imputed by MI. The robustness of each of the three methods was determined based on the following factors: direction and magnitude of effect, and the precision of the estimate. To further illustrate the robustness of the results obtained from ANCOVA and the potential difference between ANCOVA and the other three methods, a forest plot of the 95% CI of each of the four analyses was used to provide a visual comparison.

Figure 1

The schematic depiction of the four baseline adjustment methods.

Notes: Post score refers to posttreatment score, the outcome of the study. Bo refers to the baseline covariate used to adjust the score. Δ is the change score, calculated by subtracting the baseline score from the posttreatment score. The four methods depicted in Figure 1 are referred to, in this paper, as posttreatment, change, percent change, and analysis of covariance (ANCOVA).

Robustness of complete-case analysis

To decide whether the results were affected qualitatively by the implementation of MI, the results of the CCA for each of the baseline adjustment methods was used as the comparator. The robustness test was done by comparing the two types of data handling methods, based on direction and magnitude of effect, and the precision of estimate. To further illustrate the difference between the two methods of handling missing data, a forest plot of the 95% CI of each of the eight analyses was used to provide a visual comparison.

Results

Highlights of the literature on use of baseline adjustment methods

The use of these four different methods has been documented in the literature numerous times (see Table 1), through both simulation studies and studies using empirically derived data. For instance, Tu et al used empirical results from periodontal research to demonstrate that different statistical methods have a substantial impact on study power.15 In this study, it was demonstrated that with substantial variability in the correlation between the baseline and posttreatment score, ANCOVA should be used in preference to change score or percentage change score, as the appropriate method that is able to adequately reduce the type II error rates. Other examples of studies are summarized in Table 1. In short, most empirical studies reported that ANCOVA is often the most appropriate statistical method to adjust for baseline covariates when analyzing randomized studies of continuous outcome.7,8,14 Similarly, theoretical and simulation studies have shown that ANCOVA had the highest statistical power and was the method of choice.13,23,24 However, in nonrandomized studies, ANCOVA may yield biased results and the change score method should be used as the method of analysis.

Table 1

Summary of the highlights of published studies of descriptive, empirical, and theoretical studies that look at various baseline adjustment methods in studies with a baseline/posttreatment design

Design	Studies	Methods compared	Results/findings
Descriptive	Assmann et al8	Current baseline covariate adjustment methods in clinical trial reports	In general, an unadjusted method of analysis is used. However, for trials with baseline factors that are known to have strong relation to the outcome, ANCOVA is the recommended primary analysis since strong correlation between the baseline variable and the outcomes variable is expected
Descriptive	Pocock et al7	Covariate-adjusted analysis from the survey of 50 trial reports in four major journals	In the survey of trials in this study, only a few used covariate-adjusted analysis as the primary analysis. Moreover, substantial variation existed with regards to the number of covariates used in the analysis, ranging from zero to ten or more. In trials with strong correlation between the baseline and outcome variables, ANCOVA is the most appropriate choice analysis
Empirical	Tariot et al25	ANCOVAANOVA for change score	The ANCOVA and ANOVA for changes from baseline measures analyses produced similar conclusions, and therefore the results based on the ANOVA model are reported here
Empirical	Tu et al15	Posttreatment scoreChange scorePercentage scoreANCOVA	Due to the variability of the correlation between pre- and posttreatment, ANCOVA should be used in preference to the change score or percent change score as this was the method that reduced type II error rates
Empirical	Vickers27	Unadjusted (Posttreatment score)ANCOVA	For analysis of trials in the pain literature, typically there is no interaction between baseline score and treatment. Therefore, ANCOVA was concluded to be the more appropriate method of analysis, with higher statistical power compared with the unadjusted analyses
Simulation	Van Breukelen18	ANCOVAANOVA for change score	For randomized trials and studies where treatment assignment is based on a baseline variable, ANCOVA is the more appropriate method. On the other hand, for nonrandomized studies where there are more than one control group and multiple baseline measurements, ANOVA of change scores seems less biased than ANCOVA
Simulation	Cribbie and Jamieson28	ANCOVAChange score with ANOVA	For studies conducted to detect predictors of change in a two-wave design, the posttest variability has a major effect on the choice of the appropriate statistical method. ANCOVA is superior to change score with ANOVA when the variability decreases
Simulation	Liu et al23	Constrained longitudinal data analysis with ANCOVA	The study looks at two methods to determine the treatment difference with respect to mean change from baseline. In this paper, we considered the parameter of interest to be the mean change from baseline effect at a given time point, such as the last visit time point. In general, under similar modeling conditions, the cLDA model is more efficient than the longitudinal ANCOVA model. The efficiency loss of the ANCOVA model is partially the result of treating the baseline values as fixed
Simulation	Oakes and Feldman13	ANCOVAChange score	In randomized studies, the ANCOVA method gives unbiased treatment estimates and typically has superior power than analysis with change score. On the other hand, in nonrandomized studies, where baseline differences between treatment groups exist, the change score model yields less-biased estimates
Simulation	Wright24	ANCOVAStudent’s t-test	Results from ANCOVA and Student’s t-test will not differ when appropriate measures have been taken to ensure random allocation. In situations where allocation is based on a baseline score, ANCOVA would yield an unbiased result and should be the method of choice

Abbreviations: ANOVA, analysis of variance; ANCOVA, analysis of covariance; cLDA, constrained longitudinal data analysis.

Lastly, descriptive studies that summarized analyses from a large number of individual studies have shown that the selection of the method of baseline adjustment caused confusion for researchers. Specifically, there was no single method that was consistently used and often times, no justification was provided for the choice of the method used.7,8

Analysis of treatment effect

In the MOBILE study, the mean group difference, with the gabapentin treatment as the treatment group was −5.5. This indicated that the knee flexion range of motion of the patients in the active treatment group was 5.5 less, on average, than that of patients in the control group. The lower and upper 95% CIs were −11 and 0.25, P-value was 0.068, and the difference between the two treatment arms was not statistically significant.

Sensitivity to method of analysis/baseline adjustment

The primary analysis for the range-of-motion data was conducted using ANCOVA with MI for handling missing data (Figure 2 and Tables 2 and 3). The first set of sensitivity analyses compared ANCOVA with the other three methods of adjusting for baseline data and conducting statistical comparison. The three methods all had similar direction of effect, where the group mean of flexion range of motion in the control group was higher than that of the active treatment group. Moreover, the magnitude of the result of each of the three methods was similar to that obtained from the ANCOVA method, ranging from 3.9 to 4.3 (compared with 5.5 obtained using ANCOVA). The precision of the results was lower with the change score and percent change score methods, each of which had a much larger CI and P-value.

Figure 2

The results from the first part of the study.

Notes: The difference between the treatment groups was not statistically significant for the knee flexion score. Furthermore, the results were robust across statistical methods and across methods of handling missing data. More specifically, the magnitude, direction, and precision of effect were qualitatively similar; although, two of these methods (ANCOVA and posttreatment [P=0.15 and 0.12, respectively]) demonstrated a trend toward lower scores in the treatment group (ie, the control group had better outcomes).

Abbreviation: CI, confidence interval; ANCOVA, analysis of covariance.

Table 2

The results of the sensitivity analyses between the different baseline adjustment methods

Statistical method	Mean group difference	95% CI	P-value
ANCOVA with baseline as covariate	−3.9	−9.5, 1.6	0.15
Posttreatment	−4.3	−9.8, 1.2	0.12
Change score	−3.0	−9.9, 3.8	0.38
Percent change score	−0.019	−0.087, 0.050	0.58

Note: Multiple imputation, with five iterations, was used for all the analyses (m=5).

Abbreviations: ANCOVA, analysis of covariance; CI, confidence interval.

Table 3

The sensitivity analysis of the method for handling missing data

Statistical method	Mean group difference	95% CI	P-value
ANCOVA with baseline as covariate	−2.5	−7.0, 2.3	0.27
Posttreatment	−2.0	−6.6, 2.4	0.39
Change score	−1.7	−8.2, 3.3	0.60
Percent change score	−0.0052	−0.071, 0.034	0.88

Note: Using complete case analysis, each of the four baseline adjustment methods were employed to provide treatment effect estimates.

Abbreviations: ANCOVA, analysis of covariance; CI, confidence interval.

The group effect obtained using the posttreatment scores method without a baseline adjustment had the most similar results compared with ANCOVA. Along with having the same direction and almost identical magnitude of effect, the 95% CI was narrower and had a correspondingly smaller P-value. Overall, the results of the posttreatment scores remained robust, and the findings were consistent. The results obtained from the change score and percent change score methods had larger deviations compared with the primary analysis. Although they had the same direction of effect, the magnitude of effect was less, and a wider 95% CI was obtained. Of the three comparator methods, posttreatment offered the most robust method of analysis compared with ANCOVA, and the change score and percent change score methods offered the least favorable method in terms of precision and magnitude of effect (Figure 2).

Sensitivity to missing data

The second set of sensitivity analyses were done for different methods of handling missing data for flexion range of motion (Figure 2 and Tables 2 and 3). For the knee range-of-motion score, 4% and 25% of the data were missing at baseline and at the posttreatment follow-up, respectively. The primary analysis for the range of motion used ANCOVA, with MI for handling missing data. When CCA was used, the mean group difference was −2.5 (95% CI: −7.0, 2.3; P=0.27). Without any method of handling the missing data, the analysis of ANCOVA remained robust. The results maintained the direction of effect, where both estimates suggested a slight favoring of the control group. Moreover, the magnitude of the effect was also similar, where the point estimate was different by only 1.4. The level of precision was similar between MI and CCA. The P-value of the CCA was larger, due to the decrease in the precision of the analysis caused by having a low number of cases available for analysis.

In comparing results between the two methods of handling missing data among the other three methods of outcome analysis (posttreatment, change score, and percent change), the same trends were observed (data not shown). All results had the same direction of effect, with a slightly smaller magnitude of effect, smaller confidence interval, and larger P-values. The details of these results are summarized in Tables 2 and 3.

Discussion

Key findings

The present study used empirical data from total knee arthroplasty patients from the MOBILE trial and reanalyzed it to determine the impact on treatment effect (postoperative flexion range-of-motion score) of using different statistical methods of dealing with adjustment of baseline differences. With the method of ANCOVA while using MI to handle missing data, the results suggest the difference in knee flexion between the gabapentin and control group was not statistically significant. Our empirical findings support the use of ANCOVA as an optimal method in both the design and analysis of trials with a continuous primary outcome.

Through sensitivity analysis of both the method of analysis and the method of handling missing data, it is reported that all methods remained robust, and the overall findings were consistent. It should be noted, however, that while the results are similar, there are distinguishable features. For instance, it is reported that using the posttreatment score alone as the variable for statistical comparison yielded the most similar results to those from the ANCOVA method. In a simulation study published by Vickers and Altman,17 the statistical power of these four baseline adjustment methods was compared at different baseline to outcome score correlations. The results of the empirical study reported here corroborate the simulation study, where at low correlation levels, the ANCOVA and posttreatment score maintained statistical power at around 70%. Moreover, for the change score and percent change score, the statistical power decreased dramatically with the decrease of the baseline to outcome score correlation, where at a correlation of 0.2, the statistical power fell to around 50%. In this study there was no significant correlation between the baseline and postoperative range of motion; thus it would be interpreted as a near-zero correlation. Although the lowest correlation used in the simulation study was 0.2, it could be confidently extrapolated that for the analysis of data with no correlation, the ANCOVA and posttreatment methods will have the highest statistical power. Furthermore, change score and percent change score will have even lower statistical power than at the 0.2 correlation level. However, these conclusions were made at a qualitative level, and no power calculation was done to determine the exact power of the various methods.

There are a number of methods commonly used for handling missing data. For a long time, the preferred method of handling missing data was single imputation, by either imputing with the grand mean, or with last observation carried forward. There is increasing evidence and support for MI to be used as the primary method of handling missing data.21 In the present study, the sensitivity analysis for the methods of handling missing data suggests that the conclusion drawn was unaffected by the use of either CCA or MI. Moreover, in the MOBILE trial, and in this study, we sought to follow an intention-to-treat principle, where all patients randomized were analyzed. The methods utilized for statistical comparison were quite robust even when missing data was ignored.

Key limitations

The brief literature review presented in Table 1 was not conducted as a systematic literature search. The summary provided attempted to highlight recent literature on the topic of covariate baseline adjustment methods used in simulation or empirical studies. It provided information that highlights the advantages and disadvantages of these various methodologies. The results and conclusions drawn from these studies were not used to make inferences on the superiority of one method over the others. Nonetheless, the information gathered from this study helps to distill and assimilate large amounts of information in order to provide a quick overview of some of the research conducted in this topic area.

One of the main limitations of the empirical analysis portion of the study is the nature of the variable used in this study, which was the flexion range of motion. In the MOBILE trial, the sample size estimation was based on the primary outcome, which was the cumulative morphine consumption at 72 hours postsurgery. Therefore, with a sample size of 101, there may have been a lack of power to detect a difference between the two groups even if a true difference exists. As such, the results should be interpreted with caution due to the potential lack of sufficient power.

In this study, missing data were handled by using MI with five iterations. Although MI has been recognized as the most appropriate method for imputing missing data, it assumes that the “missingness” is either missing completely at random (MCAR) or at least missing at random (MAR).21 Currently, no methods are available for analysis of data that are “missing not at random.” However, testing for the type of missing data mechanism is difficult, especially when there is a lack of auxiliary information, such as the demographic and social characteristics of the participants. For the purposes of this study, the missingness was assumed to be MAR since only a small portion of the data are missing. Moreover, the robustness of the CCA further suggests that there was not a substantial amount of missing data.

The comparison of this study, using empirical data, with previous simulation studies suggests similarity in the findings. However, interpretation of the results should be understood as obtained from an empirical study, where the characteristics of the data used may influence the results generated. This is to say that although change score and percent change have been suggested as less statistically efficient methods of adjusting for baseline, when the baseline data is highly correlated with the posttreatment score, change and percent change scores may be a valid and easily interpreted methods to be used. Regardless, since ANCOVA has been shown, in a variety of studies,7,9,13,15,18,24,25,27,28 as the most statistically efficient method to analyze continuous outcomes with a baseline variable, it is suggested that the adoption of other methods of handling baseline data be used with caution.

Conclusion

In this study, we compared the most commonly used methods for adjusting the baseline data of a continuous outcome in an RCT, using an existing empirically derived dataset. The study results suggest that ANCOVA is a statistically efficient method of analyzing data of this nature and also, that the use of change and percent change scores should be employed with caution since the statistical power of these methods is highly dependent on the correlation between the baseline and the outcome. Although the findings of this study can be limited to only trials with no correlation between the adjustment variables, it should be noted that the study does contribute to the growing body of evidence on this subject, where ANCOVA has been shown as the method with the most advantages. A number of future studies should be conducted to strengthen the interpretation of this study. Simulation studies with a correlation of baseline and outcome lower than 0.2 can contribute to the evaluation of the conclusion of this study. Moreover, empirical data that were intended as the primary outcome of the study should be used in order to ensure the validity of this analysis.

Future studies may look at logistic regression and how the method of covariate adjustment affects the results.26 For instance, it is known that when the covariate included in the trial is that of a binary or survival nature, the adjustment methodology and implications are completely different. The omission of a balanced covariate has dramatic effects on the estimate of treatment effect, and this effect is magnified when a highly prognostic covariate is included in the analysis. Investigating some of these scenarios and developing a complete empirical study based on the various baseline adjustment methods set out in this study would be of great interest.9