An introduction to multimodal communication

Although sensory perception and neurobiology are traditionally investigated one modality at a time, real world behaviour and perception are driven by the integration of information from multiple sensory sources. Mounting evidence suggests that the neural underpinnings of multisensory integration extend into early sensory processing. This article examines the notion that neocortical operations are essentially multisensory. We first review what is known about multisensory processing in higher-order association cortices and then discuss recent anatomical and physiological findings in presumptive unimodal sensory areas. The pervasiveness of multisensory influences on all levels of cortical processing compels us to reconsider thinking about neural processing in unisensory terms. Indeed, the multisensory nature of most, possibly all, of the neocortex forces us to abandon the notion that the senses ever operate independently during real-world cognition.

Sexual selection may facilitate speciation because it can cause rapid evolutionary diversification of male mating signals and female preferences. Divergence in these traits can then contribute to reproductive isolation. The sensory drive hypothesis predicts that three mechanisms underlie divergence in sexually selected traits: (1) habitat-specific transmission of male signals; (2) adaptation of female perceptual sensitivity to local ecological conditions; and (3) matching of male signals to female perceptual sensitivity. I test these mechanisms in threespine sticklebacks (Gasterosteus spp.) that live in different light environments. Here I show that female perceptual sensitivity to red light varies with the extent of redshift in the light environment, and contributes to divergent preferences. Male nuptial colour varies with environment and is tuned to female perceptual sensitivity. The extent of divergence among populations in both male signal colour and female preference for red is correlated with the extent of reproductive isolation in these recently diverged species. These results demonstrate that divergent sexual selection generated by sensory drive contributes to speciation.