Small and ugly? Phylogenetic analyses of the "selfing syndrome" reveal complex evolutionary fates of monomorphic primrose flowers.

One of the most common trends in plant evolution, loss of self-incompatibility and ensuing increases in selfing, is generally assumed to be associated with a suite of phenotypic changes, notably a reduction of floral size, termed the selfing syndrome. We investigate whether floral morphological traits indeed decrease in a deterministic fashion after losses of self-incompatibility, as traditionally expected, using a phylogeny of 124 primrose species containing nine independent transitions from heterostyly (heteromorphic incompatibility) to homostyly (monomorphic self-compatibility), a classic system for evolution of selfing. We find similar overall variability of homostylous and heterostylous species, except for diminished herkogamy in homostyles. Bayesian mixed models demonstrate differences between homostylous and heterostylous species in all traits, but net effects across species are small (except herkogamy) and directionality differs among traits. Strongly drift-like evolutionary trajectories of corolla tube length and corolla diameter inferred by Ornstein-Uhlenbeck models contrast with expected deterministic trajectories toward small floral size. Lineage-specific population genetic effects associated with evolution of selfing may explain that reductions of floral size represent one of several possible outcomes of floral evolution after loss of heterostyly in primroses. Contrary to the traditional paradigm, selfing syndromes may, but do not necessarily evolve in response to increased selfing.