Modeling antitumor activity by using a non-linear mixed-effects model.

The response of solid tumors to antitumor treatment generally declines markedly with treatment time. Sometimes, a tumor regrows (rebounds) before the end of the treatment period. Studies of the patterns of tumor response to treatment are important, because they may provide useful information for clinical decision-making. We have investigated patterns of tumor response in mouse xenograft tumors by using data from a study conducted at St. Jude Children's Research Hospital. We applied a biexponential non-linear mixed-effects model to an analysis of changes in tumor volume over a given period of treatment. The model gives a good fit to the data, even for small sample sizes. We addressed the relation between the baseline tumor volumes and the decay rates of the first and second stages of the tumor's response to treatment, and we applied sensitive analysis to determine the effect of using different imputed values for missing data. We also proposed a novel approach to a comparison of the antitumor effects of three different treatments, and we used the data from a St. Jude study to demonstrate the potential of this comparison approach in cancer clinical decision-making.