A new threshold dose-response model including random effects for data from developmental toxicity studies.

Usually, in teratological dose finding studies, there are not only threshold effects but also extra variations that cannot be accounted for by the beta-binomial model alone. The beta-binomial model assumes correlation between fetuses in the same litter. The general random effect threshold (RE) model allows the additional variability that arises due to correlation and between litter variability to be modeled, in combination with threshold in the model. The goal of this research was to investigate a threshold dose-response model with random effects (RE) to model the variability that exists between litters of animals in studies of toxic agents. Data from a developmental toxicity study of a toxic agent were analysed, using the proposed RE threshold dose-response model, which is an extension of logit in form. Also, an approximate likelihood function was used to derive parameter estimates from this model, and tests were performed to determine the significance of the model parameters, in particular, the RE parameter. A simulation study was conducted to assess the performance of the RE threshold model in estimating the model parameters. 2005 John Wiley & Sons, Ltd.