Serotonin immunocytochemistry in the adult and developing rat brain: methodological and pharmacological considerations.

An antiserum has been raised in rabbits against serotonin (5-HT) conjugated to the invertebrate protein hemocyanin (HC). This antiserum was characterized with respect to its cross-reactivity with related compounds and its immunocytochemical staining properties in brains of adult and developing rats and in animals pretreated with various pharmacological regimens. When compared to an antiserum raised against 5-HT/bovine serum albumin (BSA) conjugates [59], the 5-HT/HC conjugate elicited a more profound immune response which resulted in the production of a specific, high titer antiserum that could be used directly for immunocytochemistry without removal of antibodies to the invertebrate carrier molecule, HC. Immunoabsorption experiments to assess the specificity of this antiserum demonstrated a small degree of cross-reactivity with dopamine (which was greater than that with norepinephrine or epinephrine). However, no staining of catecholaminergic neurons was found in untreated adult or developing animals, nor in animals pretreated with L-DOPA or L-DOPA + the MAO inhibitor nialamide, indicating that this cross-reactivity is not manifested under normal staining conditions. No cross-reactivity of the 5-HT/HC antiserum was observed for any 5-HT precursors or metabolites tested, although both this antiserum and the 5-HT/BSA antiserum did exhibit a high degree of cross-reactivity to the related indoleamines 5-methoxytryptamine (5-MT) and tryptamine. However, based on the immunocytochemical staining patterns observed, and the fact that both 5-MT and tryptamine are found in very low quantities in the normal rat brain, it appears that 5-HT is the predominant indoleamine stained by both of these antisera in the untreated rat brain. In animals pretreated with L-tryptophan + nialamide, some light staining was found in the dopaminergic A9 and A10 cell groups using either antiserum. However, since this staining was not observed in L-DOPA + nialamide treated animals it is not thought to be due to cross-reactivity with dopamine. Rather, since the staining could be inhibited by pretreatment with the catecholaminergic uptake blocker desmethylimipramine, it is postulated that this effect may be due to either (1) the non-specific uptake of 5-HT or 5-hydroxytryptophan (5-HTP) into the dopaminergic cells of A9 and A10 due to elevated levels of these substances in the dense serotonergic axonal plexus passing through this region or (2) to an increased uptake of circulating L-tryptophan by these A9 and A10 cells followed by conversion of this amino acid to tryptamine by aromatic amine decarboxylase, an enzyme common to both 5-HT and dopaminergic neurons. This latter possibility suggests that caution should be exercised when interpreting immunocytochemical staining patterns obtained in animals pretreated with L-tryptophan + nialamide using 5-HT antisera, since other cross-reactive indoleamines could be elevated by this pharmacological manipulation.