In many mammalian species, the accessory olfactory system plays a central role in guiding behavioral and physiological responses to social and reproductive interactions. Because of its relatively compact structure and its direct access to amygdalar and hypothalamic nuclei, the accessory olfactory pathway provides an ideal system to study sensory control of complex mammalian behavior. During the last several years, many studies employing molecular, behavioral, and physiological approaches have significantly expanded and enhanced our understanding of this system. The purpose of the current review is to integrate older and newer studies to present an updated and comprehensive picture of vomeronasal signaling and coding with an emphasis on early accessory olfactory system processing stages. These include vomeronasal sensory neurons in the vomeronasal organ, and the circuitry of the accessory olfactory bulb. Because the overwhelming majority of studies on accessory olfactory system function employ rodents, this review is largely focused on this phylogenetic order, and on mice in particular. Taken together, the emerging view from both older literature and more recent studies is that the molecular, cellular, and circuit properties of chemosensory signaling along the accessory olfactory pathway are in many ways unique. Yet, it has also become evident that, like the main olfactory system, the accessory olfactory system also has the capacity for adaptive learning, experience, and state-dependent plasticity. In addition to describing what is currently known about accessory olfactory system function and physiology, we highlight what we believe are important gaps in our knowledge, which thus define exciting directions for future investigation.

The ability of animals to sense and differentiate among thousands of odorants relies on a large set of olfactory receptors (OR) and a multitude of accessory proteins within the olfactory epithelium (OE). ORs and related signaling mechanisms have been the subject of intensive studies over the past years, but our knowledge regarding olfactory processing remains limited. The recent development of next generation sequencing (NGS) techniques encouraged us to assess the transcriptome of the murine OE. We analyzed RNA from OEs of female and male adult mice and from fluorescence-activated cell sorting (FACS)-sorted olfactory receptor neurons (ORNs) obtained from transgenic OMP-GFP mice. The Illumina RNA-Seq protocol was utilized to generate up to 86 million reads per transcriptome. In OE samples, nearly all OR and trace amine-associated receptor (TAAR) genes involved in the perception of volatile amines were detectably expressed. Other genes known to participate in olfactory signaling pathways were among the 200 genes with the highest expression levels in the OE. To identify OE-specific genes, we compared olfactory neuron expression profiles with RNA-Seq transcriptome data from different murine tissues. By analyzing different transcript classes, we detected the expression of non-olfactory GPCRs in ORNs and established an expression ranking for GPCRs detected in the OE. We also identified other previously undescribed membrane proteins as potential new players in olfaction. The quantitative and comprehensive transcriptome data provide a virtually complete catalogue of genes expressed in the OE and present a useful tool to uncover candidate genes involved in, for example, olfactory signaling, OR trafficking and recycling, and proliferation.

Sensory adaptation is a source of experience-dependent feedback that impacts responses to environmental cues. In the mammalian main olfactory system (MOS), adaptation influences sensory coding at its earliest processing stages. Sensory adaptation in the accessory olfactory system (AOS) remains incompletely explored, leaving many aspects of the phenomenon unclear. We investigated sensory adaptation in vomeronasal sensory neurons (VSNs) using a combination of in situ Ca2+ imaging and electrophysiology. Parallel studies revealed prominent short-term sensory adaptation in VSNs upon repeated stimulation with mouse urine and monomolecular bile acid ligands at interstimulus intervals (ISIs) less than 30 s. In such conditions, Ca2+ signals and spike rates were often reduced by more than 50%, leading to dramatically reduced chemosensory sensitivity. Short-term adaptation was reversible over the course of minutes. Population Ca2+ imaging experiments revealed the presence of a slower form of VSN adaptation that accumulated over dozens of stimulus presentations delivered over tens of minutes. Most VSNs showed strong adaptation, but in a substantial VSN subpopulation adaptation was diminished or absent. Investigation of same- and opposite-sex urine responses in male and female VSNs revealed that adaptation to same-sex cues occurred at ISIs up to 180 s, conditions that did not induce adaptation to opposite-sex cues. This result suggests that VSN sensory adaptation can be modulated by sensory experience. These studies comprehensively establish the presence of VSN sensory adaptation and provide a foundation for future inquiries into the molecular and cellular mechanisms of this phenomenon and its impact on mammalian behavior.

Background For many animals, chemosensory cues are vital for social and defensive interactions and are primarily detected and processed by the vomeronasal system (VNS). These cues are often inherently associated with ethological meaning, leading to stereotyped behaviors. Thus, one would expect consistent representation of these stimuli across different individuals. However, individuals may express different arrays of vomeronasal sensory receptors and may vary in the pattern of connections between those receptors and projection neurons in the accessory olfactory bulb (AOB). In the first part of this study, we address the ability of individuals to form consistent representations despite these potential sources of variability. The second part of our study is motivated by the fact that the majority of research on VNS physiology involves the use of stimuli derived from inbred animals. Yet, it is unclear whether neuronal representations of inbred-derived stimuli are similar to those of more ethologically relevant wild-derived stimuli. Results First, we compared sensory representations to inbred, wild-derived, and wild urine stimuli in the AOBs of males from two distinct inbred strains, using them as proxies for individuals. We found a remarkable similarity in stimulus representations across the two strains. Next, we compared AOB neuronal responses to inbred, wild-derived, and wild stimuli, again using male inbred mice as subjects. Employing various measures of neuronal activity, we show that wild-derived and wild stimuli elicit responses that are broadly similar to those from inbred stimuli: they are not considerably stronger or weaker, they show similar levels of sexual dimorphism, and when examining population-level activity, cluster with inbred mouse stimuli. Conclusions Despite strain-specific differences and apparently random connectivity, the AOB can maintain stereotypic sensory representations for broad stimulus categories, providing a substrate for common stereotypical behaviors. In addition, despite many generations of inbreeding, AOB representations capture the key ethological features (i.e., species and sex) of wild-derived and wild counterparts. Beyond these broad similarities, representations of stimuli from wild mice are nevertheless distinct from those elicited by inbred mouse stimuli, suggesting that laboratory inbreeding has indeed resulted in marked modifications of urinary secretions.