Olfactory learning skews mushroom body output pathways to steer behavioral choice in Drosophila

Highlights

• •

  Dopamine neurons coding opposite value are segregated in the fly brain.

• •

  Dopamine neurons representing reward type innervate discrete mushroom body areas.

• •

  Mushroom body output neurons are specific to dopaminergic reinforcement zones.

• •

  Olfactory learning skews different collections of mushroom body output junctions.

• •

  Mushroom bodies are fan-out fan-in circuits like the cerebellum and hippocampus.

Abstract

Learning permits animals to attach meaning and context to sensory stimuli. How this information is coded in neural networks in the brain, and appropriately retrieved and utilized to guide behavior, is poorly understood. In the fruit fly olfactory memories of particular value are represented within sparse populations of odor-activated Kenyon cells (KCs) in the mushroom body ensemble. During learning reinforcing dopaminergic neurons skew the mushroom body network by driving zonally restricted plasticity at synaptic junctions between the KCs and subsets of the overall small collection of mushroom body output neurons. Reactivation of this skewed KC-output neuron network retrieves memory of odor valence and guides appropriate approach or avoidance behavior.

Main article text

Current Opinion in Neurobiology 2015, 35:178–184

This review comes from a themed issue on Circuit plasticity and memory

Edited by Thomas Mrsic-Flogel and Alessandro Treves

For a complete overview see the Issue and the Editorial

http://dx.doi.org/10.1016/j.conb.2015.10.002

0959-4388/© 2015 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Introduction

Progress in understanding the neural mechanisms of learning and memory has come from studies in several organisms. Some of the animal models were initially chosen because of a unique experimental strength, such as large accessible cells that facilitate cellular and physiological analyses; or complex circuits that more obviously resemble those present in humans. Olfactory learning and memory has been studied in the fruit fly Drosophila for >40 years [1, 2]. Flies can be taught to associate odors with punishing shock, heat or bitter-taste, or rewarding sugars or water [1, 2, 3, 4, 5, 6••]. After training they either avoid an odor predicting unpleasantness or approach an odor expecting reward. The Drosophila brain has approximately 100,000 neurons and recent progress suggests that the fly mushroom body (MB), an ensemble of around 2200 intrinsic neurons, might be part of a circuit upon which the traditional cellular, systems and behavioral neuroscience boundaries can be bridged. Furthermore, it is now appreciated that the fan-out fan-in neural architecture of the MB shares structural features and perhaps a coding logic with that of the cephalopod vertical lobe and the mammalian olfactory, cerebellar and hippocampal structures [7, 8, 9•]. Studying the reduced complexity of the MB should therefore be generally informative.

Odors are sparsely represented in MB Kenyon cells

Flies detect odors in the environment using peripheral olfactory sensory neurons on their antennae and maxillary palps. These neurons send this information to glomeruli in the fly antennal lobes where it is processed and transferred to a subpopulation of 150 projection neurons (PNs). PNs project from the antennal lobes to the calyx of the MB and the lateral horn (LH). Classically the MBs have been considered to be the pathway for learning, while the LH guides innate odor-responses [10, 11, 12], although this is now recognized to be an oversimplification [13••, 14, 15•]. Each of the 2200 MB KCs receives input from ∼6 randomly chosen PNs [16, 17, 18•] providing a large fan-out expansion in the coding space for odors. Recordings from KC somata suggest that the αβ, α′β′ and γ subclasses fire relatively few times per odor exposure [17, 19, 20] and strong input to at least half of the KC's dendritic claws correlates with the cell reaching threshold to fire [21^••]. In addition to the PN-KC connectivity, KCs drive local GABAergic inhibition in the calyx which isolates the strongly odor-activated KCs from the rest of the population [22, 23]. As a result only 5–20% of the overall KC ensemble responds to a given odor [19]. Interestingly, activity in ∼5% of the total KC population of randomly chosen αβ and γ KCs was optimal to substitute for an odor stimulus during aversive learning and retrieval [24^•]. Therefore randomly distributed sparse combinations of cells in the KC population provide an association matrix in which to store odor-specific memory. This is important because it illustrates that a vast number of stimuli can be encoded in the KC ensemble, if they reach a significant combinatorial representation.

Learning assigns values to specific zones on odor-activated KCs

Different fly dopaminergic neurons (DANs) provide positive and negative value signals [25]. Most of the DANs that innervate the MB reside in two discrete clusters called PPL1 and PAM (Figure 1). Each PPL1 neuron that innervates the MB projects presynaptic terminals to a unique zone on the vertical α or α′ lobes, or heel and surface of the peduncle. Several of them can convey negative reinforcement value during learning (Figure 1a) [26, 27, 28].

Aversive stimuli such as electric shock, high temperature and bitter substances/insect repellent appear to bottleneck onto the same negatively reinforcing DANs (MP1 [PPL1-γ1pedc] and MV1 [PPL1-γ2α′1]) suggesting that reinforcing DANs coding aversion may lack information of the quality of the stimulus and simply represent stimulus magnitude [3, 4]. A different DAN (aSP13 [PAM-γ5]) innervating the tip of the MB γ lobe has been implicated in courtship conditioning [29].

Positive reinforcement signals are provided by subsets of the approximately 100 neurons in the PAM cluster [30, 31] and they predominantly innervate adjacent zones on the horizontal β, β′ and γ lobes (Figure 1b). Perhaps surprisingly, discrete PAM DANs convey the reinforcing effects of the sweet taste and nutrient value of sugar [32••, 33••] and of water reward [6^••]. In addition, identified sugar and water responsive DANs project to unique zones on the MB lobes suggesting that reward identity, and therefore the respective learning-related plasticity, is represented in different places along the axon of an individual KC (Figure 1b).

It appears that reinforcement is not uniform across all the KCs in a DAN-marked zone. Some aversively reinforcing DANs do not innervate the αβ_c neurons [34], which suggests that certain KC representations of odors may already be skewed for valence. Interestingly, the αβ core neurons are crucial for the retrieval of approach memories [34] and for time-consuming odor choices [35].

DAN zones have corresponding MB output neurons

Outputs from the 2200 KCs fan-in onto 34 MBONs of 21 types [36, 37••]. Strikingly the dendrites of each of these MBONs are largely confined to a single, or a few, DAN zones. For instance, the axons from sugar rewarding dopaminergic neurons overlap with the dendrites of the M4/6 (or MBON-β2β′2a, MBON-β′2mp and MBON-γ5β′2a) MBONs on the tips of the MB horizontal lobes [13^••]. Similarly, another MBON is dendritic in a zone of the γ lobe that receives water-reinforcing DAN input [6••, 37••]. Since each type of DAN contacts a defined stretch of an individual KCs axonal arbor (Figure 1b), they are likely to only modify en passant KC output synapses onto MBONs in their respective zone. Such an organization predicts that water memory implements unique KC-MBON connections to those used for sugar memories. Since other sugar and water-independent DANs provide positive reinforcement when they are artificially activated [32••, 34], we speculate that other KC-MBON zones might represent different rewarding events, such as additional components of food, sex and sleep.

Learning skews the odor-drive to collections of KC-MBON junctions

Evidence suggests that dopamine drives learning via the presynaptically expressed dDA1 receptor in KCs [38, 39] and several studies have demonstrated dopamine-driven plasticity of KC responses [40•, 41]. If learning modifies the output of odor-activated KCs, this should be evident in the activity of the MBONs. Indeed, aversive learning has been reported to depress the odor-drive to the MB vertical lobe outputs MB-V2α [MBON-α2sc] and MB-V2α′ [MBON-α′3] [42] whereas reward learning potentiates drive to MB-V3 [MBON-α3] [43], although others reported potentiation of MB-V3 [MBON-α3] responses after aversive training [44]. In addition, the relative odor-drive to dendrites of β′2 outputs on the horizontal lobe tips was shown to be bi-directionally altered by learning [13^••]. Aversive training potentiated responses [13••, 45••] whereas appetitive training depressed them [13^••]. Taken together these studies demonstrate that learning changes the relative odor drive to identified MBONs that are required for memory expression. However, how does a change of drive to a particular MBON translate to a change in odor-driven behavior? A clear answer to this question was provided by experiments that manipulated the activity of the M4 [MBON-β2β′2a, MBON-β′2mp] and M6 [MBON-γ5β′2a] outputs [13^••]. Blocking these neurons to mimic the reward learning induced depression of the KC-M4/6 connection, converted odor avoidance into odor approach in naïve flies. Furthermore, optogenetic activation of the M4 [MBON-β2β′2a, MBON-β′2mp] and M6 [MBON-γ5β′2a] neurons drove avoidance behavior. A parallel extensive study activated individual pairs of almost all of the MBONs [46^••]. Many of the glutamatergic MBONs on the horizontal lobe, including M4/6 neurons, triggered avoidance whereas some cholinergic MBONs on the vertical lobes and the GABA-ergic MVP2 [MBON-γ1pedc > α/β] output on the heel and peduncle directed approach [46^••]. Co-activating opposing MBON pathways neutralized behavior [46^••].

The observed learning-related changes of odor-drive to MBONs, and intrinsic valence of particular MBONs support a model wherein learning skews collections of KC-MBON pathways that are ordinarily balanced in naïve flies (Figure 2a). Appetitive learning promotes odor approach by depressing odor-drive to avoidance MBON pathways and perhaps strengthening approach pathways (Figure 2b). In contrast aversive learning promotes odor avoidance by depressing odor-drive to MBON pathways that direct approach while strengthening those for avoidance (Figure 2c). During memory testing, reactivation of these skewed KC-MBON networks by the trained odor retrieves the memory valence and either leads to odor-approach or avoidance behavior.

The requirement for MBON output has been shown to shift with phases of aversive memory [45^••], reminiscent of the previously established temporally evolving requirement for output from the different, α′β′ and αβ classes of KCs for memory processing and the expression of particular memory phases [47, 48, 49]. It will be important to understand how appropriate behavioral instruction is maintained as the anatomical substrate changes.

Although we have focused on olfactory memory, recent studies have shown that the Drosophila MB also plays a crucial role in visual [50] and taste memories [51, 52]. If parallel sets of KCs represent olfactory, gustatory and visual stimuli, the same reinforcing DAN systems could intersect all these information streams and thereby simultaneously assign value through learning to odors, visual features and tastes. These memories would then be stored using a similar mechanism to that illustrated for odors (Figure 2), where the MBON drive from KCs that are activated by a specific taste or visual feature would be skewed either towards approach or avoidance. It will be important to determine the extent to which these modalities and memories are integrated within the MB network.

State-dependence — an additional level of dopaminergic control

Sugar memory is most robustly expressed in hungry flies [53] whereas thirst promotes the expression of water memory [6^••]. It seems possible that forming these memories in different zones on the MB provides a simple organizational scaffold onto which additional control can be differentially exerted. The MB-MP1 [PPL1-γ1pedc] DANs provide the inhibitory constraint of satiety on the expression of sugar memory [53]. The MB-MP1 [PPL1-γ1pedc] neurons can also convey short term aversive memory reinforcement [28] suggesting that negative reinforcement and motivational processes are tightly interlinked in the MB. MP1 [PPL1-γ1pedc] neurons have also been implicated in the transition between different memory phases [54, 55] and forgetting [56]. It is interesting to note that the MB-MP1 [PPL1-γ1pedc] neurons occupy the same zones in the heel and peduncle as the GABA-ergic MVP2 [MBON-γ1pedc > α/β], whose activation drives approach behavior [46^••]. The anatomy of MVP2 [MBON-γ1pedc > α/β] suggests that they are feed-forward local MB inhibitory interneurons (Figure 3). It therefore seems plausible that the internal state of hunger also skews the balance of MBON pathways so that those favoring approach are preferentially activated by relevant trained odors. In addition, such a function would indicate that the first layer of MBON integration is within the MB itself. It will be important to determine the role of other neurons that connect MBON zones [32••, 36, 37••] and whether the thirst-dependence of water memory expression [6^••] involves a similar DAN control mechanism to that of sugar memory. DANs that innervate the tip of the β′ lobe control the thirst dependence of water vapor seeking in naïve flies [6^••]. In addition, DANs and MBONs have been implicated in hunger-dependent modulation of naïve responses to carbon dioxide [15^•], temperature preference [57, 58], and the regulation of sleep [46]. Therefore, DAN-driven modulation of the MB does not exclusively gate learned behaviors and might more broadly control the expression of state-dependent goal-directed behaviors.

Where do the MBONs go?

Some cholinergic MBONs project presynaptic terminals into the LH [42, 46••] suggesting that part of the MB-routed learned odor information is reunited and integrated with the more direct PN-driven activity in the LH. Other cholinergic and glutamatergic MBONs project to a region of neuropil called the superior medial protocerebrum, or SMP, and additional surrounding zones [46^••]. Interestingly, these zones also contain the dendritic arbors of many classes of DANs [13••, 37••]. Detailed anatomical studies suggest that the dendrites of the DANs innervating a particular MB zone closely overlap with the presynaptic boutons of their corresponding MBONs [37^••]. This arrangement suggests that recurrent connections exist between KCs, MBONs and DANs [13••, 15•, 37••]. These microcircuit motifs could serve stimulus re-evaluation functions integrating MB output and reinforcing stimulus-specific information; for example, the reliability of shock punishment, sugar or water reward, or relative shock value [34]. A full understanding of how avoidance and approach behaviors are generated will require knowledge of multimodal processes in the MB, the complex MBON interconnections in the LH and SMP, and ultimately how the downstream circuits controlling locomotion are instructed.

Conflict of interest statement

We confirm that there are no known conflicts of interest associated with this manuscript and there has been no significant financial support for this work that could have influenced its outcome. Both authors have read and approve of this manuscript.

References and recommended reading

Papers of particular interest, published within the period of review, have been highlighted as:

• • of special interest

• •• of outstanding interest

References

1. Quinn W.G., Harris W.A., Benzer S.. Conditioned behavior in Drosophila melanogaster. Proc Natl Acad Sci U S A. Vol. 71:1974. 708–712. [PubMed]

2. Tempel B.L., Bonini N., Dawson D.R., Quinn W.G.. Reward learning in normal and mutant Drosophila. Proc Natl Acad Sci U S A. Vol. 80:1983. 1482–1486. [PubMed]

3. Galili D.S., Dylla K.V., Ludke A., Friedrich A.B., Yamagata N., Wong J.Y., Ho C.H., Szyszka P., Tanimoto H.. Converging circuits mediate temperature and shock aversive olfactory conditioning in Drosophila. Curr Biol. Vol. 24:2014. 1712–1722. [PubMed]

4. Das G., Klappenbach M., Vrontou E., Perisse E., Clark C.M., Burke C.J., Waddell S.. Drosophila learn opposing components of a compound food stimulus. Curr Biol. Vol. 24:2014. 1723–1730. [PubMed]

5. Burke C.J., Waddell S.. Remembering nutrient quality of sugar in Drosophila. Curr Biol. Vol. 21:2011. 746–750. [PubMed]

6. Lin S., Owald D., Chandra V., Talbot C., Huetteroth W., Waddell S.. Neural correlates of water reward in thirsty Drosophila. Nat Neurosci. Vol. 17:2014. 1536–1542. [PubMed]

   Identifies DAN subpopulations that are required for water reinforcement and naïve water-seeking. Together with [27, 30, 31] establishes that the orthogonal DAN-specific zones are functionally distinct.

7. Shomrat T., Graindorge N., Bellanger C., Fiorito G., Loewenstein Y., Hochner B.. Alternative sites of synaptic plasticity in two homologous “fan-out fan-in” learning and memory networks. Curr Biol. Vol. 21:2011. 1773–1782. [PubMed]

8. Farris S.M.. Are mushroom bodies cerebellum-like structures? Arthropod Struct Dev. Vol. 40:2011. 368–379. [PubMed]

9. Stevens C.F.. What the fly's nose tells the fly's brain. Proc Natl Acad Sci U S A. Vol. 112:2015. 9460–9465. [PubMed]

   Discusses how Marr's computational principles for the operation of three layer neural circuits fit the fly olfactory system and compares the architecture to mammalian olfactory, cerebellar and hippocampal circuitry.

10. Heimbeck G., Bugnon V., Gendre N., Keller A., Stocker R.F.. A central neural circuit for experience-independent olfactory and courtship behavior in Drosophila melanogaster. Proc Natl Acad Sci U S A. Vol. 98:2001. 15336–15341. [PubMed]

11. Heisenberg M.. Mushroom body memoir: from maps to models. Nat Rev Neurosci. Vol. 4:2003. 266–275. [PubMed]

12. Fisek M., Wilson R.I.. Stereotyped connectivity and computations in higher-order olfactory neurons. Nat Neurosci. Vol. 17:2014. 280–288. [PubMed]

13. Owald D., Felsenberg J., Talbot C.B., Das G., Perisse E., Huetteroth W., Waddell S.. Activity of defined mushroom body output neurons underlies learned olfactory behavior in Drosophila. Neuron. Vol. 86:2015. 417–427. [PubMed]

    Identifies the MB horizontal lobe tip M4/6 MBONs to be required for both appetitive and aversive memory retrieval. Odor-drive is bi-directionally altered following reward and aversive learning. Learned behavior can be mimicked by directly inhibiting or activating the MBONs.

14. Bracker L.B., Siju K.P., Varela N., Aso Y., Zhang M., Hein I., Vasconcelos M.L., Grunwald Kadow I.C.. Essential role of the mushroom body in context-dependent CO(2) avoidance in Drosophila. Curr Biol. Vol. 23:2013. 1228–1234. [PubMed]

15. Lewis L.P., Siju K.P., Aso Y., Friedrich A.B., Bulteel A.J., Rubin G.M., Grunwald Kadow I.C.. A higher brain circuit for immediate integration of conflicting sensory information in Drosophila. Curr Biol. Vol. 25:2015. 2203–2214. [PubMed]

    Identifies the MB horizontal lobe tip M4/6 MBONs to be required for innate context-dependent CO₂ avoidance.

16. Murthy M., Fiete I., Laurent G.. Testing odor response stereotypy in the Drosophila mushroom body. Neuron. Vol. 59:2008. 1009–1023. [PubMed]

17. Turner G.C., Bazhenov M., Laurent G.. Olfactory representations by Drosophila mushroom body neurons. J Neurophysiol. Vol. 99:2008. 734–746. [PubMed]

18. Caron S.J., Ruta V., Abbott L.F., Axel R.. Random convergence of olfactory inputs in the Drosophila mushroom body. Nature. Vol. 497:2013. 113–117. [PubMed]

    Anatomical tracing and modeling establishes that PN to KC connectivity follows no obvious rules and is therefore considered to be random. Together with [16, 17, 21••] provides support for the idea of the MB being a fan-out association matrix.

19. Honegger K.S., Campbell R.A., Turner G.C.. Cellular-resolution population imaging reveals robust sparse coding in the Drosophila mushroom body. J Neurosci. Vol. 31:2011. 11772–11785. [PubMed]

20. Campbell R.A., Honegger K.S., Qin H., Li W., Demir E., Turner G.C.. Imaging a population code for odor identity in the Drosophila mushroom body. J Neurosci. Vol. 33:2013. 10568–10581. [PubMed]

21. Gruntman E., Turner G.C.. Integration of the olfactory code across dendritic claws of single mushroom body neurons. Nat Neurosci. Vol. 16:2013. 1821–1829. [PubMed]

    Combines single dendritic claw functional imaging and optogenetically controlled input paired with KC recordings to determine that multiple PN inputs are required to drive KCs to spike.

22. Papadopoulou M., Cassenaer S., Nowotny T., Laurent G.. Normalization for sparse encoding of odors by a wide-field interneuron. Science. Vol. 332:2011. 721–725. [PubMed]

23. Lin A.C., Bygrave A.M., de Calignon A., Lee T., Miesenbock G.. Sparse, decorrelated odor coding in the mushroom body enhances learned odor discrimination. Nat Neurosci. Vol. 17:2014. 559–568. [PubMed]

24. Vasmer D., Pooryasin A., Riemensperger T., Fiala A.. Induction of aversive learning through thermogenetic activation of Kenyon cell ensembles in Drosophila. Front Behav Neurosci. Vol. 8:2014. 174[PubMed]

    Uses genetic mosaicism to randomly activate the same subpopulation of KCs, rather than present odor, during training and testing. Establishes that memories can be expressed by reactivating the same set of KCs.

25. Waddell S.. Reinforcement signalling in Drosophila; dopamine does it all after all. Curr Opin Neurobiol. Vol. 23:2013. 324–329. [PubMed]

26. Riemensperger T., Voller T., Stock P., Buchner E., Fiala A.. Punishment prediction by dopaminergic neurons in Drosophila. Curr Biol. Vol. 15:2005. 1953–1960. [PubMed]

27. Claridge-Chang A., Roorda R.D., Vrontou E., Sjulson L., Li H., Hirsh J., Miesenbock G.. Writing memories with light-addressable reinforcement circuitry. Cell. Vol. 139:2009. 405–415. [PubMed]

28. Aso Y., Herb A., Ogueta M., Siwanowicz I., Templier T., Friedrich A.B., Ito K., Scholz H., Tanimoto H.. Three dopamine pathways induce aversive odor memories with different stability. PLoS Genet. Vol. 8:2012. e1002768[PubMed]

29. Keleman K., Vrontou E., Kruttner S., Yu J.Y., Kurtovic-Kozaric A., Dickson B.J.. Dopamine neurons modulate pheromone responses in Drosophila courtship learning. Nature. Vol. 489:2012. 145–149. [PubMed]

30. Burke C.J., Huetteroth W., Owald D., Perisse E., Krashes M.J., Das G., Gohl D., Silies M., Certel S., Waddell S.. Layered reward signalling through octopamine and dopamine in Drosophila. Nature. Vol. 492:2012. 433–437. [PubMed]

31. Liu C., Placais P.Y., Yamagata N., Pfeiffer B.D., Aso Y., Friedrich A.B., Siwanowicz I., Rubin G.M., Preat T., Tanimoto H.. A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature. Vol. 488:2012. 512–516. [PubMed]

32. Huetteroth W., Perisse E., Lin S., Klappenbach M., Burke C., Waddell S.. Sweet taste and nutrient value subdivide rewarding dopaminergic neurons in Drosophila. Curr Biol. Vol. 25:2015. 751–758. [PubMed]

    Subdivides DANs on the horizontal lobe that are required to convey the reinforcing properties of sweet taste and nutrient value of sugar. Also see [33^••].

33. Yamagata N., Ichinose T., Aso Y., Placais P.Y., Friedrich A.B., Sima R.J., Preat T., Rubin G.M., Tanimoto H.. Distinct dopamine neurons mediate reward signals for short- and long-term memories. Proc Natl Acad Sci U S A. Vol. 112:2015. 578–583. [PubMed]

    Subdivides DANs on the horizontal lobe that are required for short and long-term memory formation with sugar reinforcement. Also see [32^••].

34. Perisse E., Yin Y., Lin A.C., Lin S., Huetteroth W., Waddell S.. Different kenyon cell populations drive learned approach and avoidance in Drosophila. Neuron. Vol. 79:2013. 945–956. [PubMed]

35. DasGupta S., Ferreira C.H., Miesenbock G.. FoxP influences the speed and accuracy of a perceptual decision in Drosophila. Science. Vol. 344:2014. 901–904. [PubMed]

36. Tanaka N.K., Tanimoto H., Ito K.. Neuronal assemblies of the Drosophila mushroom body. J Comp Neurol. Vol. 508:2008. 711–755. [PubMed]

37. Aso Y., Hattori D., Yu Y., Johnston R.M., Iyer N.A., Ngo T.T., Dionne H., Abbott L.F., Axel R., Tanimoto H., Rubin G.M.. The neuronal architecture of the mushroom body provides a logic for associative learning. Elife. Vol. 3:2014. e04577[PubMed]

    Comprehensive anatomical analysis of MB intrinsic and extrinsic neurons using highly specific Split-GAL4 lines. Provides a detailed framework for functional subdivision and zonal architecture. See also [46^••].

38. Kim Y.C., Lee H.G., Han K.A.. D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. J Neurosci. Vol. 27:2007. 7640–7647. [PubMed]

39. Qin H., Cressy M., Li W., Coravos J.S., Izzi S.A., Dubnau J.. Gamma neurons mediate dopaminergic input during aversive olfactory memory formation in Drosophila. Curr Biol. Vol. 22:2012. 608–614. [PubMed]

40. Zhang S., Roman G.. Presynaptic inhibition of gamma lobe neurons is required for olfactory learning in Drosophila. Curr Biol. Vol. 23:2013. 2519–2527. [PubMed]

    Demonstrates that aversive conditioning causes presynaptic inhibition and decreases vesicle release from γ lobe KCs activated by the unpaired odor.

41. Boto T., Louis T., Jindachomthong K., Jalink K., Tomchik S.M.. Dopaminergic modulation of cAMP drives nonlinear plasticity across the Drosophila mushroom body lobes. Curr Biol. Vol. 24:2014. 822–831. [PubMed]

42. Sejourne J., Placais P.Y., Aso Y., Siwanowicz I., Trannoy S., Thoma V., Tedjakumala S.R., Rubin G.M., Tchenio P., Ito K.. Mushroom body efferent neurons responsible for aversive olfactory memory retrieval in Drosophila. Nat Neurosci. Vol. 14:2011. 903–910. [PubMed]

43. Placais P.Y., Trannoy S., Friedrich A.B., Tanimoto H., Preat T.. Two pairs of mushroom body efferent neurons are required for appetitive long-term memory retrieval in Drosophila. Cell Rep. Vol. 5:2013. 769–780. [PubMed]

44. Pai T.P., Chen C.C., Lin H.H., Chin A.L., Lai J.S., Lee P.T., Tully T., Chiang A.S.. Drosophila ORB protein in two mushroom body output neurons is necessary for long-term memory formation. Proc Natl Acad Sci U S A. Vol. 110:2013. 7898–7903. [PubMed]

45. Bouzaiane E., Trannoy S., Scheunemann L., Placais P.Y., Preat T.. Two independent mushroom body output circuits retrieve the six discrete components of Drosophila aversive memory. Cell Rep. Vol. 11:2015. 1280–1292. [PubMed]

    Consistent with [13^••] identifies γ lobe tip M6 MBON to be involved in aversive memory and aversive learning potentiates odor-drive to this neuron. M6 and V2 neurons play time-dependent roles in aversive memory retrieval.

46. Aso Y., Sitaraman D., Ichinose T., Kaun K.R., Vogt K., Belliart-Guerin G., Placais P.Y., Robie A.A., Yamagata N., Schnaitmann C.. Mushroom body output neurons encode valence and guide memory-based action selection in Drosophila. Elife. Vol. 3:2014. e04580[PubMed]

    Companion paper to [37^••] using Split-GAL4 lines to screen the requirements of the close-to-complete set of MBONs for different behaviors. Optogenetic stimulation of individual MBONs distinguishes those that drive avoidance from those that drive approach.

47. Krashes M.J., Keene A.C., Leung B., Armstrong J.D., Waddell S.. Sequential use of mushroom body neuron subsets during drosophila odor memory processing. Neuron. Vol. 53:2007. 103–115. [PubMed]

48. Trannoy S., Redt-Clouet C., Dura J.M., Preat T.. Parallel processing of appetitive short- and long-term memories in Drosophila. Curr Biol. Vol. 21:2011. 1647–1653. [PubMed]

49. Cervantes-Sandoval I., Martin-Pena A., Berry J.A., Davis R.L.. System-like consolidation of olfactory memories in Drosophila. J Neurosci. Vol. 33:2013. 9846–9854. [PubMed]

50. Vogt K., Schnaitmann C., Dylla K.V., Knapek S., Aso Y., Rubin G.M., Tanimoto H.. Shared mushroom body circuits underlie visual and olfactory memories in Drosophila. Elife. Vol. 3:2014. e02395[PubMed]

51. Masek P., Worden K., Aso Y., Rubin G.M., Keene A.C.. A dopamine-modulated neural circuit regulating aversive taste memory in Drosophila. Curr Biol. Vol. 25:2015. 1535–1541. [PubMed]

52. Kirkhart C., Scott K.. Gustatory learning and processing in the Drosophila mushroom bodies. J Neurosci. Vol. 35:2015. 5950–5958. [PubMed]

53. Krashes M.J., DasGupta S., Vreede A., White B., Armstrong J.D., Waddell S.. A neural circuit mechanism integrating motivational state with memory expression in Drosophila. Cell. Vol. 139:2009. 416–427. [PubMed]

54. Placais P.Y., Trannoy S., Isabel G., Aso Y., Siwanowicz I., Belliart-Guerin G., Vernier P., Birman S., Tanimoto H., Preat T.. Slow oscillations in two pairs of dopaminergic neurons gate long-term memory formation in Drosophila. Nat Neurosci. Vol. 15:2012. 592–599. [PubMed]

55. Musso P.Y., Tchenio P., Preat T.. Delayed dopamine signaling of energy level builds appetitive long-term memory in Drosophila. Cell Rep. Vol. 10:2015. 1023–1031. [PubMed]

56. Berry J.A., Cervantes-Sandoval I., Nicholas E.P., Davis R.L.. Dopamine is required for learning and forgetting in Drosophila. Neuron. Vol. 74:2012. 530–542. [PubMed]

57. Bang S., Hyun S., Hong S.T., Kang J., Jeong K., Park J.J., Choe J., Chung J.. Dopamine signalling in mushroom bodies regulates temperature-preference behaviour in Drosophila. PLoS Genet. Vol. 7:2011. e1001346[PubMed]

58. Shih H.W., Wu C.L., Chang S.W., Liu T.H., Lai J.S., Fu T.F., Fu C.C., Chiang A.S.. Parallel circuits control temperature preference in Drosophila during ageing. Nat Commun. Vol. 6:2015. 7775[PubMed]

Acknowledgements

We thank Suewei Lin for comments on the manuscript. DO was supported by an EMBO Long-Term Fellowship and a Sir Henry Wellcome Postdoctoral Fellowship. SW is funded by a Wellcome Trust Senior Research Fellowship in the Basic Biomedical Sciences and by funds from the Gatsby Charitable Foundation, the Oxford Martin School and the Bettencourt-Schueller Foundation.

Floating objects

Figure 1

Schematics of reinforcing dopaminergic neurons that innervate the MB. (a) The MB-MP1 [PPL1-γ1pedc] and MB-MV1 [PPL1-γ2α′1] DANs in the protocerebral posterior lateral (PPL) 1 cluster provide negative reinforcement signals. The MB-MV1 neuron projects to the lower stalk and junction region and the MB-MP1 neuron innervates the heel and distal peduncle. In addition, the aversive MB-M3 (PAM-β2β′2a) neuron from the protocerebral anterior medial (PAM) cluster ramifies on the tip of the β lobe. All neurons shown have an identical paired neuron that primarily innervates the contralateral MB lobes. (b) DANs in the PAM cluster mostly provide positive reinforcement signals. PAM DANs representing sugar sweetness (green with yellow outline), nutritious value of sugar (darker green) and water (blue) project to discrete zones of the horizontal β, β′ and γ MB lobes (marked with dotted outlines for γ); sweet taste to β′2am and γ4, sugar nutrient to γ5b (tip) and α1 (and possibly β1 β2, not illustrated), and water to a subregion of γ4 that appears distinct from the sweet-taste DANs. In addition, naïve evaluation of water vapor in thirsty flies requires a DAN that innervates β′2p. Reward type is therefore differentially represented in the DAN population and along the MB lobes. Several of the PAM DANs also have a projection to the contralateral MB. A single γ KC is shown with inset illustrating a model where adjoining segments of the KC arbor contain KC presynaptic terminals that are reinforced by DANs for water, sweet taste, or sugar nutrient value. These presynapses are assumed to wire to MBONs with a very similar zonally restricted anatomy to that of the DANs. Cell body position is not stereotyped and diagrams are not intended to be anatomically accurate. These illustrations are edited from [25].

Figure 2

A piano-playing model for learned valence in the KC-MBON network. (a) The canonical view on higher order processing in the fly brain places the LH (not shown) as instrumental for the expression of innate odor-driven behaviors. Experiments blocking all synaptic output from KCs either by ablation or acute silencing suggested the MBs were dispensable for innate odor-driven behavior, but essential for learned responses. However recent findings demonstrate that blocking the MBONs from the tips of the horizontal MB lobes radically alters naïve and learned odor-driven behaviors [13••, 15•]. In addition, the activity of particular MBONs is now known to favor either avoidance (red arrows) or approach (green arrows) [13••, 46••]. It therefore seems logical that the contribution of these MBONs is integrated and balanced in the naïve fly, leading to an apparent lack of contribution from the MB and neutrality in naïve odor-driven tasks. For simplicity we illustrated the balance as equal numbers of outputs (4 plus and 4 minus = zero, neutrality), but it need only be balanced by the relative weights. (b) Reward learning with sugar depresses the odor-specific KC connections to avoidance MBONs (black arrows). In addition it modulates/enhances approach connections (thicker green arrow). This skewed balance (4 plus and 1 minus) now favors odor-driven approach. (c) Aversive conditioning depresses the odor-specific KC connections to approach MBONs (black arrows). In addition it enhances avoidance connections (thicker red arrow). This skewed balance (1 plus and 4 minus) now favors odor-driven avoidance. Avoidance neurons are glutamatergic whereas approach neurons are cholinergic or GABAergic [13••, 46••].

Figure 3

Model how local feed-forward inhibitory interneurons in the MB could mediate the motivational control of sugar memory retrieval. (a) The MB-MP1 [PPL1-γ1pedc] DANs that innervate the heel and peduncle of the MB provide the inhibitory constraint of satiety on the expression of sugar reward memory [53]. The MB-MP1 presynaptic terminals overlap with the dendrites of the GABAergic MVP2 [MBON-γ1pedc > α/β] (dark blue) [46^••] suggesting that MB-MP1 DANs drive plasticity between KC synapses in these regions and the MVP2 MBONs. In the satiated fly the MB-MP1 DANs are tonically active/on and therefore inhibit odor-drive to MVP2, reducing feed-forward inhibition to MBON junctions, such as M4 [MBON-β2 β′2a, MBON-β′2mp] and M6 [MBON-γ5β′2a] outputs on the horizontal lobe tips that drive avoidance. This situation inhibits the expression of reward memories. (b) In hungry flies the MB-MP1 neurons are inhibited/turned off by the action of Neuropeptide F [53]. This results in increased odor-drive to MVP2 and therefore more feed-forward inhibition (MVP2 neuron now light blue) to MBON avoidance pathways (dashed red arrows). This situation favors expression of conditioned odor approach behavior. Interestingly, only nutrient-dependent sugar memory expression requires the flies to be hungry [32^••] and MVP2 innervates the relevant α1 zone of the MB. Furthermore, water-reinforced memory expression is promoted by thirst and not hunger and the MVP2 neuron does not seem to have an arbor in the γ4 water-reinforcement zone. A similar mechanism could provide state-dependence to visual and tastant memories.