Implications for clinical pharmacodynamic studies of the statistical characterization of an in vitro antiproliferation assay.

Modeling of nonlinear pharmacodynamic (PD) relationships necessitates the utilization of a weighting function in order to compensate for the heteroscedasticity. The structure of the variance was studied for concentration-effect data generated in an in vitro 96-well plate cell growth inhibition assay, where data are numerous (480 data points per experiment) and replication is easy. From the five candidate models that were considered, the power function S2Y = phi 2Y phi 3, where Y is the sample mean and S2Y is the sample variance, was shown to be the most appropriate to describe the nonuniformity of the variance along the range of measured effect for 253 sets of (Y; S2Y) data. The Hill model was fit to the concentration-effect data with weighted nonlinear regression, where the weights were equal to the reciprocal of the predicted variance. The examination of the distribution of the 253 sets of parameters of the PD model showed that IC50 was lognormally distributed whereas the distribution of gamma was normal. The characterization of the appropriate variance function and concentration-effect function in a simple in vitro experimental setting with a large number of experiments, with each experiment including a large number of data points, will be useful for guiding similar in vitro concentration-effect studies where data are plentiful and for guiding PD modeling in complex clinical settings in which extensive data for model characterization is impossible to obtain.