Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function

References

• Agarwal, M., Giannoni Guzman, M., Morales-Matos, C., Del Valle Diaz, R.A., Abramson, C.I., & Giray, T. (2011). Dopamine and octopamine influence avoidance learning of honey bees in a place preference assay. PLoS One, 6, e25371.
   PubMed Web of Science ®Google Scholar
• Albin, S.D., Kaun, K.R., Knapp, J.M., Chung, P., Heberlein, U., & Simpson, J.H. (2015). A subset of serotonergic neurons evokes hunger in adult Drosophila. Current Biology, 25, 2435–2440.
   PubMed Web of Science ®Google Scholar
• Aosaki, T., Tsubokawa, H., Ishida, A., Watanabe, K., Graybiel, A.M., & Kimura, M. (1994). Responses of tonically active neurons in the primate’s striatum undergo systematic changes during behavioral sensorimotor conditioning. Journal of Neuroscience, 14, 3969–3984.
   PubMed Web of Science ®Google Scholar
• Aransay, A., Rodriguez-Lopez, C., Garcia-Amado, M., Clasca, F., & Prensa, L. (2015). Long-range projection neurons of the mouse ventral tegmental area: a single-cell axon tracing analysis. Frontiers in Neuroanatomy, 9, 59.
   PubMed Web of Science ®Google Scholar
• Ashby, F.G., & Crossley, M.J. (2011). A computational model of how cholinergic interneurons protect striatal-dependent learning. Journal of Cognitive Neuroscience, 23, 1549–1566.
   PubMed Web of Science ®Google Scholar
• Aso, Y., Siwanowicz, I., Bracker, L., Ito, K., Kitamoto, T., & Tanimoto, H. (2010). Specific dopaminergic neurons for the formation of labile aversive memory. Current Biology, 20, 1445–1451.
   PubMed Web of Science ®Google Scholar
• Aso, Y., Herb, A., Ogueta, M., Siwanowicz, I., Templier, T., Friedrich, A.B., … Tanimoto, H. (2012). Three dopamine pathways induce aversive odor memories with different stability. PLoS Genetics, 8, e1002768.
   PubMed Web of Science ®Google Scholar
• Aso, Y., Hattori, D., Yu, Y., Johnston, R.M., Iyer, N.A., Ngo, T.T., … Rubin, G.M. (2014a). The neuronal architecture of the mushroom body provides a logic for associative learning. Elife, 3, e04577.
   PubMed Web of Science ®Google Scholar
• Aso, Y., Sitaraman, D., Ichinose, T., Kaun, K.R., Vogt, K., Belliart-Guerin, G., … Rubin, G.M. (2014b). Mushroom body output neurons encode valence and guide memory-based action selection in Drosophila. Elife, 3, e04580.
   PubMed Web of Science ®Google Scholar
• Ault, D.T., Radeff, J.M., & Werling, L.L. (1998). Modulation of [3H]Dopamine release from rat nucleus accumbens by neuropeptide Y may involve a sigma1-like receptor. Journal of Pharmacology and Experimental Therapeutics, 284, 553–560.
   PubMed Web of Science ®Google Scholar
• Avery, L., & Horvitz, H.R. (1990). Effects of starvation and neuroactive drugs on feeding in Caenorhabditis elegans. Journal of Experimental Zoology, 253, 263–270.
   PubMedGoogle Scholar
• Barreiro-Iglesias, A., Cornide-Petronio, M.E., Anadon, R., & Rodicio, M.C. (2009). Serotonin and GABA are colocalized in restricted groups of neurons in the larval sea lamprey brain: insights into the early evolution of neurotransmitter colocalization in vertebrates. Journal of Anatomy, 215, 435–443.
   PubMed Web of Science ®Google Scholar
• Berger, B.D., Wise, C.D., & Stein, L. (1971). Norepinephrine: reversal of anorexia in rats with lateral hypothalamic damage. Science, 172, 281–284.
   PubMed Web of Science ®Google Scholar
• Berry, J.A., Cervantes-Sandoval, I., Chakraborty, M., & Davis, R.L. (2015). Sleep facilitates memory by blocking dopamine neuron-mediated forgetting. Cell, 161, 1656–1667.
   PubMed Web of Science ®Google Scholar
• Boto, T., Louis, T., Jindachomthong, K., Jalink, K., & Tomchik, S.M. (2014). Dopaminergic modulation of cAMP drives nonlinear plasticity across the Drosophila mushroom body lobes. Current Biology, 24, 822–831.
   PubMed Web of Science ®Google Scholar
• Brand, A.H., & Perrimon, N. (1993). Targeted gene expression as a means of altering cell fates and generating dominant phenotypes. Development, 118, 401–415.
   PubMed Web of Science ®Google Scholar
• Brischoux, F., Chakraborty, S., Brierley, D.I., & Ungless, M.A. (2009). Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proceedings of National Academic Sciences of United States of America, 106, 4894–4899.
   PubMed Web of Science ®Google Scholar
• Brody, T., & Cravchik, A. (2000). Drosophila melanogaster G protein-coupled receptors. Journal of Cell Biology, 150, F83–F88.
   PubMed Web of Science ®Google Scholar
• Brown, R.E., & McKenna, J.T. (2015). Turning a negative into a positive: ascending GABAergic control of cortical activation and arousal. Frontiers in Neurology, 6, 135.
   PubMed Web of Science ®Google Scholar
• Bubar, M.J., Stutz, S.J., & Cunningham, K.A. (2011). 5-HT(2C) receptors localize to dopamine and GABA neurons in the rat mesoaccumbens pathway. PLoS One, 6, e20508.
   PubMed Web of Science ®Google Scholar
• Burke, C.J., Huetteroth, W., Owald, D., Perisse, E., Krashes, M.J., Das, G., … Waddell, S. (2012). Layered reward signalling through octopamine and dopamine in Drosophila. Nature, 492, 433–437.
   PubMed Web of Science ®Google Scholar
• Campbell, A.D., Kohl, R.R., & McBride, W.J. (1996). Serotonin-3 receptor and ethanol-stimulated somatodendritic dopamine release. Alcohol, 13, 569–574.
   PubMed Web of Science ®Google Scholar
• Cannell, E., Dornan, A.J., Halberg, K.A., Terhzaz, S., Dow, J.A., & Davies, S.A. (2016). The corticotropin-releasing factory-like diuretic hormone 44 (DH44) and kinin neuropeptides modulate desiccation and starvation tolerance in Drosophila melanogaster. Peptides. doi: 10.1016/j.peptides.2016.02.004.
   PubMed Web of Science ®Google Scholar
• Caputi, A., Melzer, S., Michael, M., & Monyer, H. (2013). The long and short of GABAergic neurons. Current Opinion in Neurobiology, 23, 179–186.
   PubMed Web of Science ®Google Scholar
• Cheong, M.C., Artyukhin, A.B., You, Y.-J., & Avery, L. (2015). An opioid-like system regulating feeding behavior in C. elegans. eLife, 4:e06683. doi: 10.7554/eLife.06683.
   PubMed Web of Science ®Google Scholar
• Chiang, A.S., Lin, C.Y., Chuang, C.C., Chang, H.M., Hsieh, C.H., Yeh, C.W., … Hwang, J.K. (2011). Three-dimensional reconstruction of brain-wide wiring networks in Drosophila at single-cell resolution. Current Biology, 21, 1–11.
   PubMed Web of Science ®Google Scholar
• Claridge-Chang, A., Roorda, R.D., Vrontou, E., Sjulson, L., Li, H., Hirsh, J., & Miesenbock, G. (2009). Writing memories with light-addressable reinforcement circuitry. Cell, 139, 405–415.
   PubMed Web of Science ®Google Scholar
• Cohen, J.Y., Amoroso, M.W., & Uchida, N. (2015). Serotonergic neurons signal reward and punishment on multiple timescales. eLife, 4:e06346.
   PubMed Web of Science ®Google Scholar
• Cohn, R., Morantte, I., & Ruta, V. (2015). Coordinated and compartmentalized neuromodulation shapes sensory processing in Drosophila. Cell, 163, 1–15.
   Web of Science ®Google Scholar
• Cone, J.J., McCutcheon, J.E., & Roitman, M.F. (2014). Ghrelin acts as an interface between physiological state and phasic dopamine signaling. Journal of Neuroscience, 34, 4905–4913.
   PubMed Web of Science ®Google Scholar
• Cornwall, J., Cooper, J.D., & Phillipson, O.T. (1990). Afferent and efferent connections of the laterodorsal tegmental nucleus in the rat. Brain Research Bulletin, 25, 271–284.
   PubMed Web of Science ®Google Scholar
• Cox, S.M., Frank, M.J., Larcher, K., Fellows, L.K., Clark, C.A., Leyton, M., & Dagher, A. (2015). Striatal D1 and D2 signaling differentially predict learning from positive and negative outcomes. Neuroimage, 109, 95–101.
   PubMed Web of Science ®Google Scholar
• Croll, N.A. (1975). Indolealkylamines in the coordination of nematode behavioral activities. Canadian Journal of Zoology, 53, 894–903.
   PubMed Web of Science ®Google Scholar
• Crow, T.J. (1972). A map of the rat mesencephalon for electrical self-stimulation. Brain reserach, 36, 265–273.
   PubMed Web of Science ®Google Scholar
• de Bono, M., Tobin, D.M., Davis, M.W., Avery, L., & Bargmann, C.I. (2002). Social feeding in Caenorhabditis elegans is induced by neurons that detect aversive stimuli. Nature, 419, 899–903.
   PubMed Web of Science ®Google Scholar
• del Valle Rodriguez, A., Didiano, D., & Desplan, C. (2012). Power tools for gene expression and clonal analysis in Drosophila. Nature methods, 9, 47–55.
   Web of Science ®Google Scholar
• Dobbs, L.K., & Cunningham, C.L. (2014). The role of the laterodorsal tegmental nucleus in methamphetamine conditioned place preference and locomotor activity. Behavior Brain Research, 265, 198–202.
   PubMed Web of Science ®Google Scholar
• Farooqui, T., Robinson, K., Vaessin, H., & Smith, B.H. (2003). Modulation of early olfactory processing by an octopaminergic reinforcement pathway in the honeybee. Journal of Neuroscience, 23, 5370–5380.
   PubMed Web of Science ®Google Scholar
• Farris, S.M. (2011). Are mushroom bodies cerebellum-like structures? Arthropod Structure & Development, 40, 368–379.
   PubMed Web of Science ®Google Scholar
• Fenno, L., Yizhar, O., & Deisseroth, K. (2011). The development and application of optogenetics. Annual Review of Neuroscience, 34, 389–412.
   PubMed Web of Science ®Google Scholar
• Franklin, N.T., & Frank, M.J. (2015). A cholinergic feedback circuit to regulate striatal population uncertainty and optimize reinforcement learning. Elife, 4:e12029 1–29. doi:10.7554/eLife.12029.
   Web of Science ®Google Scholar
• Fu, W., Le Maitre, E., Fabre, V., Bernard, J.F., David Xu, Z.Q., & Hokfelt, T. (2010). Chemical neuroanatomy of the dorsal raphe nucleus and adjacent structures of the mouse brain. Journal of Comparative Neurology, 518, 3464–3494.
   PubMed Web of Science ®Google Scholar
• Gagnon, D., & Parent, M. (2014). Distribution of VGLUT3 in highly collateralized axons from the rat dorsal raphe nucleus as revealed by single-neuron reconstructions. PLoS One, 9, e87709.
   PubMed Web of Science ®Google Scholar
• Gilpin, N.W. (2012). Neuropeptide Y (NPY) in the extended amygdala is recruited during the transition to alcohol dependence. Neuropeptides, 46, 253–259.
   PubMed Web of Science ®Google Scholar
• Gronier, B., & Rasmussen, K. (1998). Activation of midbrain presumed dopaminergic neurones by muscarinic cholinergic receptors: an in vivo electrophysiological study in the rat. British Journal of Pharmacology, 124, 455–464.
   PubMed Web of Science ®Google Scholar
• Gu, H., Zou, Y.R., & Rajewsky, K. (1993). Independent control of immunoglobulin switch recombination at individual switch regions evidenced through Cre-loxP-mediated gene targeting. Cell, 73, 1155–1164.
   PubMed Web of Science ®Google Scholar
• Hamada, F.N., Rosenzweig, M., Kang, K., Pulver, S.R., Ghezzi, A., Jegla, T.J., & Garrity, P.A. (2008). An internal thermal sensor controlling temperature preference in Drosophila. Nature, 454, 217–220.
   PubMed Web of Science ®Google Scholar
• Hammer, M., & Menzel, R. (1998). Multiple sites of associative odor learning as revealed by local brain microinjections of octopamine in honeybees. Learn Memory, 5, 146–156.
   PubMed Web of Science ®Google Scholar
• Han, K.A., Millar, N.S., Grotewiel, M.S., & Davis, R.L. (1996). DAMB, a novel dopamine receptor expressed specifically in Drosophila mushroom bodies. Neuron, 16, 1127–1135.
   PubMed Web of Science ®Google Scholar
• Haynes, P.R., Christmann, B.L., & Griffith, L.C. (2015). A single pair of neurons links sleep to memory consolidation in Drosophila Melanogaster. Elife, 4:e03868 1–24. doi:10.7554/eLife.03868.
   Web of Science ®Google Scholar
• Hen, R. (1992). Of mice and flies: commonalities among 5-HT receptors. Trends in Pharmacology Science, 13, 160–165.
   PubMed Web of Science ®Google Scholar
• Herve, D., Pickel, V.M., Joh, T.H., & Beaudet, A. (1987). Serotonin axon terminals in the ventral tegmental area of the rat: fine structure and synaptic input to dopaminergic neurons. Brain Research, 435, 71–83.
   PubMed Web of Science ®Google Scholar
• Hige, T., Aso, Y., Rubin, G.M., & Turner, G.C. (2015). Plasticity-driven individualization of olfactory coding in mushroom body output neurons. Nature, 526, 258–262.
   PubMed Web of Science ®Google Scholar
• Hikida, T., Kimura, K., Wada, N., Funabiki, K., & Nakanishi, S. (2010). Distinct roles of synaptic transmission in direct and indirect striatal pathways to reward and aversive behavior. Neuron, 66, 896–907.
   PubMed Web of Science ®Google Scholar
• Huang, Z.J., & Zeng, H. (2013). Genetic approaches to neural circuits in the mouse. Annual Review of Neuroscience, 36, 183–215.
   PubMed Web of Science ®Google Scholar
• Huetteroth, W., Perisse, E., Lin, S., Klappenbach, M., Burke, C., & Waddell, S. (2015). Sweet taste and nutrient value subdivide rewarding dopaminergic neurons in Drosophila. Current Biology, 25, 751–758.
   PubMed Web of Science ®Google Scholar
• Ichinose, T., Aso, Y., Yamagata, N., Abe, A., Rubin, G.M., & Tanimoto, H. (2015). Reward signal in a recurrent circuit drives appetitive long-term memory formation. Elife, 4:e10719 1–28.
   Web of Science ®Google Scholar
• Inada, K., Kohsaka, H., Takasu, E., Matsunaga, T., & Nose, A. (2011). Optical dissection of neural circuits responsible for Drosophila larval locomotion with halorhodopsin. PLoS One, 6, e29019.
   PubMed Web of Science ®Google Scholar
• Inglis, F.M., Day, J.C., & Fibiger, H.C. (1994). Enhanced acetylcholine release in hippocampus and cortex during the anticipation and consumption of a palatable meal. Neuroscience, 62, 1049–1056.
   PubMed Web of Science ®Google Scholar
• Inglis, W.L., Olmstead, M.C., & Robbins, T.W. (2001). Selective deficits in attentional performance on the 5-choice serial reaction time task following pedunculopontine tegmental nucleus lesions. Behavior in Brain Research, 123, 117–131.
   PubMed Web of Science ®Google Scholar
• Jennings, J.H., Sparta, D.R., Stamatakis, A.M., Ung, R.L., Pleil, K.E., Kash, T.L., & Stuber, G.D. (2013). Distinct extended amygdala circuits for divergent motivational states. Nature, 496, 224–228.
   PubMed Web of Science ®Google Scholar
• Johnson, O., Becnel, J., & Nichols, C.D. (2011). Serotonin receptor activity is necessary for olfactory learning and memory in Drosophila melanogaster. Neuroscience, 192, 372–381.
   PubMed Web of Science ®Google Scholar
• Joshua, M., Adler, A., Mitelman, R., Vaadia, E., & Bergman, H. (2008). Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. Journal of Neuroscience, 28, 11673–11684.
   PubMed Web of Science ®Google Scholar
• Kaczer, L., Klappenbach, M., & Maldonado, H. (2011). Dissecting mechanisms of reconsolidation: octopamine reveals differences between appetitive and aversive memories in the crab Chasmagnathus. European Journal of Neuroscience, 34, 1170–1178.
   PubMed Web of Science ®Google Scholar
• Kaczer, L., & Maldonado, H. (2009). Contrasting role of octopamine in appetitive and aversive learning in the crab Chasmagnathus. PLoS One, 4, e6223.
   PubMed Web of Science ®Google Scholar
• Kim, Y.C., Lee, H.G., & Han, K.A. (2007). D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. Journal of Neuroscience, 27, 7640–7647.
   PubMed Web of Science ®Google Scholar
• Kim, Y.C., Lee, H.G., Seong, C.S., & Han, K.A. (2003). Expression of a D1 dopamine receptor dDA1/DmDOP1 in the central nervous system of Drosophila melanogaster. Gene Expression Patterns, 3, 237–245.
   PubMed Web of Science ®Google Scholar
• Kitai, S.T., Shepard, P.D., Callaway, J.C., & Scroggs, R. (1999). Afferent modulation of dopamine neuron firing patterns. Current Opinion in Neurobiology, 9, 690–697.
   PubMed Web of Science ®Google Scholar
• Kitamoto, T. (2002). Targeted expression of temperature-sensitive dynamin to study neural mechanisms of complex behavior in Drosophila. Journal of Neurogenetics, 16, 205–228.
   PubMed Web of Science ®Google Scholar
• Klapoetke, N.C., Murata, Y., Kim, S.S., Pulver, S.R., Birdsey-Benson, A., Cho, Y.K., … Boyden, E.S. (2014). Independent optical excitation of distinct neural populations. Nature Methods, 11, 338–346.
   PubMed Web of Science ®Google Scholar
• Klappenbach, M., Maldonado, H., Locatelli, F., & Kaczer, L. (2012). Opposite actions of dopamine on aversive and appetitive memories in the crab. Learn Memory, 19, 73–83.
   PubMed Web of Science ®Google Scholar
• Korotkova, T.M., Brown, R.E., Sergeeva, O.A., Ponomarenko, A.A., & Haas, H.L. (2006). Effects of arousal- and feeding-related neuropeptides on dopaminergic and GABAergic neurons in the ventral tegmental area of the rat. European Journal of Neuroscience, 23, 2677–2685.
   PubMed Web of Science ®Google Scholar
• Krashes, M.J., DasGupta, S., Vreede, A., White, B., Armstrong, J.D., & Waddell, S. (2009). A neural circuit mechanism integrating motivational state with memory expression in Drosophila. Cell, 139, 416–427.
   PubMed Web of Science ®Google Scholar
• Kravitz, A.V., Tye, L.D., & Kreitzer, A.C. (2012). Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nature Neuroscience, 15, 816–818.
   PubMed Web of Science ®Google Scholar
• Labouebe, G., Liu, S., Dias, C., Zou, H., Wong, J.C., Karunakaran, S., … Borgland, S.L. (2013). Insulin induces long-term depression of ventral tegmental area dopamine neurons via endocannabinoids. Nature Neuroscience, 16, 300–308.
   PubMed Web of Science ®Google Scholar
• Lammel, S., Ion, D.I., Roeper, J., & Malenka, R.C. (2011). Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron, 70, 855–862.
   PubMed Web of Science ®Google Scholar
• Lammel, S., Lim, B.K., Ran, C., Huang, K.W., Betley, M.J., Tye, K.M., … Malenka, R.C. (2012). Input-specific control of reward and aversion in the ventral tegmental area. Nature, 491, 212–217.
   PubMed Web of Science ®Google Scholar
• Lee, P.T., Lin, H.W., Chang, Y.H., Fu, T.F., Dubnau, J., Hirsh, J., … Chiang, A.S. (2011). Serotonin-mushroom body circuit modulating the formation of anesthesia-resistant memory in Drosophila. Proceedings of National academic Sciences of United States of America, 108, 13794–13799.
   PubMed Web of Science ®Google Scholar
• Lewis, L.P., Siju, K.P., Aso, Y., Friedrich, A.B., Bulteel, A.J., Rubin, G.M., & Grunwald Kadow, I.C. (2015). A higher brain circuit for immediate integration of conflicting sensory information in Drosophila. Current biology, 25, 2203–2214.
   PubMed Web of Science ®Google Scholar
• Liu, C., Placais, P.Y., Yamagata, N., Pfeiffer, B.D., Aso, Y., Friedrich, A.B., … Tanimoto, H. (2012). A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature, 488, 512–516.
   PubMed Web of Science ®Google Scholar
• Liu, W., Thielen, R.J., Rodd, Z.A., & McBride, W.J. (2006). Activation of serotonin-3 receptors increases dopamine release within the ventral tegmental area of Wistar and alcohol-preferring (P) rats. Alcohol, 40, 167–176.
   PubMed Web of Science ®Google Scholar
• Liu, X., & Davis, R.L. (2009). The GABAergic anterior paired lateral neuron suppresses and is suppressed by olfactory learning. Nature neuroscience, 12, 53–59.
   PubMed Web of Science ®Google Scholar
• Lobo, M.K., & Nestler, E.J. (2011). The striatal balancing act in drug addiction: distinct roles of direct and indirect pathway medium spiny neurons. Frontiers in Neuroanatomy, 5, 41.
   PubMed Web of Science ®Google Scholar
• Loewi, O. (1921). Über humorale übertragbarkeit der Herznervenwirkung. Pflüger’s Archiv Für Die Gesamte Physiologie Des Menschen Und Der Tiere, 189, 239–242.
   Google Scholar
• Luan, H., Peabody, N.C., Vinson, C.R., & White, B.H. (2006). Refined spatial manipulation of neuronal function by combinatorial restriction of transgene expression. Neuron, 52, 425–436.
   PubMed Web of Science ®Google Scholar
• Luan, H., & White, B.H. (2007). Combinatorial methods for refined neuronal gene targeting. Current Opinion in Neurobiology, 17, 572–580.
   PubMed Web of Science ®Google Scholar
• Ma, P.M. (1994). Catecholaminergic systems in the zebrafish. II. Projection pathways and pattern of termination of the locus coeruleus. Journal of Comparative Neurology, 344, 256–269.
   PubMed Web of Science ®Google Scholar
• Ma, P.M. (2003). Catecholaminergic systems in the zebrafish. IV. Organization and projection pattern of dopaminergic neurons in the diencephalon. Journal of Comparative Neurology, 460, 13–37.
   PubMed Web of Science ®Google Scholar
• Margolis, E.B., Toy, B., Himmels, P., Morales, M., & Fields, H.L. (2012). Identification of rat ventral tegmental area GABAergic neurons. PLoS One, 7, e42365.
   PubMed Web of Science ®Google Scholar
• Margules, D.L. (1969). Noradrenergic rather than serotonergic basis of reward in the dorsal tegmentum. Journal of Comparative and Physiological Psychology, 67, 32–35.
   PubMed Web of Science ®Google Scholar
• Maskos, U. (2008). The cholinergic mesopontine tegmentum is a relatively neglected nicotinic master modulator of the dopaminergic system: relevance to drugs of abuse and pathology. British Journal of Pharmacology, 153, S438–S445.
   PubMed Web of Science ®Google Scholar
• Matsuda, W., Furuta, T., Nakamura, K.C., Hioki, H., Fujiyama, F., Arai, R., & Kaneko, T. (2009). Single nigrostriatal dopaminergic neurons form widely spread and highly dense axonal arborizations in the neostriatum. Journal of Neuroscience, 29, 444–453.
   PubMed Web of Science ®Google Scholar
• McDevitt, R.A., Tiran-Cappello, A., Shen, H., Balderas, I., Britt, J.P., Marino, R.A., … Bonci, A. (2014). Serotonergic versus nonserotonergic dorsal raphe projection neurons: differential participation in reward circuitry. Cell reports, 8, 1857–1869.
   PubMed Web of Science ®Google Scholar
• Mendlin, A., Martin, F.J., & Jacobs, B.L. (1999). Dopaminergic input is required for increases in serotonin output produced by behavioral activation: an in vivo microdialysis study in rat forebrain. Neuroscience, 93, 897–905.
   PubMed Web of Science ®Google Scholar
• Mizunami, M., Hamanaka, Y., & Nishino, H. (2015). Toward elucidating diversity of neural mechanisms underlying insect learning. Zoological Letters, 1, 8.
   PubMed Web of Science ®Google Scholar
• Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H. (2004). Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron, 43, 133–143.
   PubMed Web of Science ®Google Scholar
• Nair-Roberts, R.G., Chatelain-Badie, S.D., Benson, E., White-Cooper, H., Bolam, J.P., & Ungless, M.A. (2008). Stereological estimates of dopaminergic, GABAergic and glutamatergic neurons in the ventral tegmental area, substantia nigra and retrorubral field in the rat. Neuroscience, 152, 1024–1031.
   PubMed Web of Science ®Google Scholar
• Nakanishi, S., Hikida, T., & Yawata, S. (2014). Distinct dopaminergic control of the direct and indirect pathways in reward-based and avoidance learning behaviors. Neuroscience, 282C, 49–59.
   PubMed Web of Science ®Google Scholar
• Nocjar, C., Roth, B.L., & Pehek, E.A. (2002). Localization of 5-HT(2A) receptors on dopamine cells in subnuclei of the midbrain A10 cell group. Neuroscience, 111, 163–176.
   PubMed Web of Science ®Google Scholar
• Oakman, S.A., Faris, P.L., Kerr, P.E., Cozzari, C., & Hartman, B.K. (1995). Distribution of pontomesencephalic cholinergic neurons projecting to substantia nigra differs significantly from those projecting to ventral tegmental area. Journal of Neuroscience, 15, 5859–5869.
   PubMed Web of Science ®Google Scholar
• Okada, K., & Kobayashi, Y. (2013). Reward prediction-related increases and decreases in tonic neuronal activity of the pedunculopontine tegmental nucleus. Frontiers in Integrated Neuroscience, 7, 36.
   PubMedGoogle Scholar
• Okada, K., Toyama, K., Inoue, Y., Isa, T., & Kobayashi, Y. (2009). Different pedunculopontine tegmental neurons signal predicted and actual task rewards. Journal of Neuroscience, 29, 4858–4870.
   PubMed Web of Science ®Google Scholar
• Opland, D.M., Leinninger, G.M., & Myers, M.G., Jr. (2010). Modulation of the mesolimbic dopamine system by leptin. Brain Research, 1350, 65–70.
   PubMed Web of Science ®Google Scholar
• Owald, D., Felsenberg, J., Talbot, C.B., Das, G., Perisse, E., Huetteroth, W., & Waddell, S. (2015). Activity of defined mushroom body output neurons underlies learned olfactory behavior in Drosophila. Neuron, 86, 417–427.
   PubMed Web of Science ®Google Scholar
• Peroutka, S.J., & Howell, T.A. (1994). The molecular evolution of G protein-coupled receptors: focus on 5-hydroxytryptamine receptors. Neuropharmacology, 33, 319–324.
   PubMed Web of Science ®Google Scholar
• Perry, C.J., & Barron, A.B. (2013). Neural mechanisms of reward in insects. Annual Reviews of Entomology, 58, 543–562.
   PubMed Web of Science ®Google Scholar
• Perry, M.L., Leinninger, G.M., Chen, R., Luderman, K.D., Yang, H., Gnegy, M.E., … Kennedy, R.T. (2010). Leptin promotes dopamine transporter and tyrosine hydroxylase activity in the nucleus accumbens of Sprague-Dawley rats. Journal of Neurochemistry, 114, 666–674.
   PubMed Web of Science ®Google Scholar
• Peyron, C., Luppi, P.H., Kitahama, K., Fort, P., Hermann, D.M., & Jouvet, M. (1995). Origin of the dopaminergic innervation of the rat dorsal raphe nucleus. Neuroreport, 6, 2527–2531.
   PubMed Web of Science ®Google Scholar
• Placais, P.Y., Trannoy, S., Friedrich, A.B., Tanimoto, H., & Preat, T. (2013). Two pairs of mushroom body efferent neurons are required for appetitive long-term memory retrieval in Drosophila. Cell Reports, 5, 769–780.
   PubMed Web of Science ®Google Scholar
• Pupe, S., & Wallen-Mackenzie, A. (2015). Cre-driven optogenetics in the heterogeneous genetic panorama of the VTA. Trends in Neuroscience, 38, 375–386.
   PubMed Web of Science ®Google Scholar
• Qi, C., & Lee, D. (2014). Pre- and postsynaptic role of dopamine D2 receptor DD2R in Drosophila olfactory associative learning. Biology (Basel), 3, 831–845.
   PubMedGoogle Scholar
• Quarta, D., Leslie, C.P., Carletti, R., Valerio, E., & Caberlotto, L. (2011). Central administration of NPY or an NPY-Y5 selective agonist increase in vivo extracellular monoamine levels in mesocorticolimbic projecting areas. Neuropharmacology, 60, 328–335.
   PubMed Web of Science ®Google Scholar
• Quarta, D., & Smolders, I. (2014). Rewarding, reinforcing and incentive salient events involve orexigenic hypothalamic neuropeptides regulating mesolimbic dopaminergic neurotransmission. European Journal of Pharmaceutical Science, 57, 2–10.
   PubMed Web of Science ®Google Scholar
• Riemensperger, T., Voller, T., Stock, P., Buchner, E., & Fiala, A. (2005). Punishment prediction by dopaminergic neurons in Drosophila. Current Biology, 15, 1953–1960.
   PubMed Web of Science ®Google Scholar
• Rink, E., & Guo, S. (2004). The too few mutant selectively affects subgroups of monoaminergic neurons in the zebrafish forebrain. Neuroscience, 127, 147–154.
   PubMed Web of Science ®Google Scholar
• Rink, E., & Wullimann, M.F. (2001). The teleostean (zebrafish) dopaminergic system ascending to the subpallium (striatum) is located in the basal diencephalon (posterior tuberculum). Brain Research, 889, 316–330.
   PubMed Web of Science ®Google Scholar
• Rink, E., & Wullimann, M.F. (2002). Connections of the ventral telencephalon and tyrosine hydroxylase distribution in the zebrafish brain (Danio rerio) lead to identification of an ascending dopaminergic system in a teleost. Brain Research Bulletin, 57, 385–387.
   PubMed Web of Science ®Google Scholar
• Rink, E., & Wullimann, M.F. (2004). Connections of the ventral telencephalon (subpallium) in the zebrafish (Danio rerio). Brain research, 1011, 206–220.
   PubMed Web of Science ®Google Scholar
• Ritter, S., & Stein, L. (1974). Self-stimulation in the mesencephalic trajectory of the ventral noradrenergic bundle. Brain Research, 81, 145–157.
   PubMed Web of Science ®Google Scholar
• Roeder, T. (1999). Octopamine in invertebrates. Progress in Neurobiology, 59, 533–561.
   PubMed Web of Science ®Google Scholar
• Roeder, T. (2005). Tyramine and octopamine: ruling behavior and metabolism. Annual Review of Entomology, 50, 447–477.
   PubMed Web of Science ®Google Scholar
• Roeper, J. (2013). Dissecting the diversity of midbrain dopamine neurons. Trends in Neuroscience, 36, 336–342.
   PubMed Web of Science ®Google Scholar
• Rohwedder, A., Selcho, M., Chassot, B., & Thum, A.S. (2015). Neuropeptide F neurons modulate sugar reward during associative olfactory learning of Drosophila larvae. Journal of Comparative Neurology, 523, 2637–2664.
   PubMed Web of Science ®Google Scholar
• Rolls, M.M, & Jegla, T.J. (2015). Neuronal polarity: an evolutionary perspective. Journal of Experimental Biology, 218, 572–580.
   PubMed Web of Science ®Google Scholar
• Root, D.H., Hoffman, A.F., Good, C.H., Zhang, S., Gigante, E., Lupica, C.R., & Morales, M. (2015). Norepinephrine activates dopamine D4 receptors in the rat lateral habenula. Journal of Neuroscience, 35, 3460–3469.
   PubMed Web of Science ®Google Scholar
• Root, D.H., Mejias-Aponte, C.A., Qi, J., & Morales, M. (2014). Role of glutamatergic projections from ventral tegmental area to lateral habenula in aversive conditioning. Journal of Neuroscience, 34, 13906–13910.
   PubMed Web of Science ®Google Scholar
• Schroll, C., Riemensperger, T., Bucher, D., Ehmer, J., Voller, T., Erbguth, K., … Fiala, A. (2006). Light-induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae. Current Biology, 16, 1741–1747.
   PubMed Web of Science ®Google Scholar
• Schwaerzel, M., Monastirioti, M., Scholz, H., Friggi-Grelin, F., Birman, S., & Heisenberg, M. (2003). Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in Drosophila. Journal of Neuroscience, 23, 10495–10502.
   PubMed Web of Science ®Google Scholar
• Schwarz, L.A., Miyamichi, K., Gao, X.J., Beier, K.T., Weissbourd, B., DeLoach, K.E., … Luo, L. (2015). Viral-genetic tracing of the input-output organization of a central noradrenaline circuit. Nature, 524, 88–92.
   PubMed Web of Science ®Google Scholar
• Sejourne, J., Placais, P.Y., Aso, Y., Siwanowicz, I., Trannoy, S., Thoma, V., … Preat, T. (2011). Mushroom body efferent neurons responsible for aversive olfactory memory retrieval in Drosophila. Nature Neuroscience, 14, 903–910.
   PubMed Web of Science ®Google Scholar
• Shinohara, F., Kihara, Y., Ide, S., Minami, M., & Kaneda, K. (2014). Critical role of cholinergic transmission from the laterodorsal tegmental nucleus to the ventral tegmental area in cocaine-induced place preference. Neuropharmacology, 79, 573–579.
   PubMed Web of Science ®Google Scholar
• Shohat-Ophir, G., Kaun, K.R., Azanchi, R., Mohammed, H., & Heberlein, U. (2012). Sexual deprivation increases ethanol intake in Drosophila. Science, 335, 1351–1355.
   PubMed Web of Science ®Google Scholar
• Shuai, Y., Hu, Y., Qin, H., Campbell, R.A., & Zhong, Y. (2011). Distinct molecular underpinnings of Drosophila olfactory trace conditioning. Proceedings of National Academic Sciences of United States of America, 108, 20201–20206.
   PubMed Web of Science ®Google Scholar
• Sitaraman, D., LaFerriere, H., Birman, S., & Zars, T. (2012). Serotonin is critical for rewarded olfactory short-term memory in Drosophila. Journal of Neurogenetics, 26, 238–244.
   PubMed Web of Science ®Google Scholar
• Solecki, W., Wickham, R.J., Behrens, S., Wang, J., Zwerling, B., Mason, G.F., & Addy, N.A. (2013). Differential role of ventral tegmental area acetylcholine and N-methyl-D-aspartate receptors in cocaine-seeking. Neuropharmacology, 75, 9–18.
   PubMed Web of Science ®Google Scholar
• Song, B.M., Faumont, S., Lockery, S., & Avery, L. (2013). Recognition of familiar food activates feeding via an endocrine serotonin signal in Caenorhabditis elegans. Elife, 2, e00329.
   PubMed Web of Science ®Google Scholar
• Sorensen, A.T., Nikitidou, L., Ledri, M., Lin, E.J., During, M.J., Kanter-Schlifke, I., & Kokaia, M. (2009). Hippocampal NPY gene transfer attenuates seizures without affecting epilepsy-induced impairment of LTP. Experimental Neurology, 215, 328–333.
   PubMed Web of Science ®Google Scholar
• Spitzer, N.C. (2015). Neurotransmitter Switching? No Surprise. Neuron, 86, 1131–1144. doi:10.1016/j.neuron.2015.05.028
   PubMed Web of Science ®Google Scholar
• Stephenson-Jones, M., Floros, O., Robertson, B., & Grillner, S. (2012). Evolutionary conservation of the habenular nuclei and their circuitry controlling the dopamine and 5-hydroxytryptophan (5-HT) systems. Proceedings of National Academic Sciences of United States of America, 109, E164–E173.
   PubMed Web of Science ®Google Scholar
• Strausfeld, N.J. (2009). Brain organization and the origin of insects: an assessment. Proceedings of the Biological Sciences, 276, 1929–1937.
   PubMed Web of Science ®Google Scholar
• Strausfeld, N.J., & Hirth, F. (2013). Deep homology of arthropod central complex and vertebrate basal ganglia. Science, 340, 157–161.
   PubMed Web of Science ®Google Scholar
• Suo, S., Culotti, J.G., & Van Tol, H.H. (2009). Dopamine counteracts octopamine signalling in a neural circuit mediating food response in C. elegans. EMBO Journal, 28, 2437–2448.
   PubMed Web of Science ®Google Scholar
• Sze, J.Y., Victor, M., Loer, C., Shi, Y., & Ruvkun, G. (2000). Food and metabolic signalling defects in a Caenorhabditis elegans serotonin-synthesis mutant. Nature, 403, 560–564.
   PubMed Web of Science ®Google Scholar
• Tan, K.R., Yvon, C., Turiault, M., Mirzabekov, J.J., Doehner, J., Labouèbe, G., … Lüscher, C. (2012). GABA neurons of the VTA drive conditioned place aversion. Neuron, 73, 1173–1183.
   PubMed Web of Science ®Google Scholar
• Tan, C.O., & Bullock, D. (2008). A dopamine-acetylcholine cascade: simulating learned and lesion-induced behavior of striatal cholinergic interneurons. Journal of Neurophysiology, 100, 2409–2421.
   PubMed Web of Science ®Google Scholar
• Tay, T.L., Ronneberger, O., Ryu, S., Nitschke, R., & Driever, W. (2011). Comprehensive catecholaminergic projectome analysis reveals single-neuron integration of zebrafish ascending and descending dopaminergic systems. Nature Communications, 2, 171.
   PubMed Web of Science ®Google Scholar
• Tomchik, S.M., & Davis, R.L. (2009). Dynamics of learning-related cAMP signaling and stimulus integration in the Drosophila olfactory pathway. Neuron, 64, 510–521.
   PubMed Web of Science ®Google Scholar
• Ungless, M.A., Magill, P.J., & Bolam, J.P. (2004). Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli Science, 303, 2040–2042.
   PubMed Web of Science ®Google Scholar
• Unoki, S., Matsumoto, Y., & Mizunami, M. (2005). Participation of octopaminergic reward system and dopaminergic punishment system in insect olfactory learning revealed by pharmacological study. European journal of Neuroscience, 22, 1409–1416.
   PubMed Web of Science ®Google Scholar
• Vahatalo, L.H., Ruohonen, S.T., Ailanen, L., & Savontaus, E. (2015). Neuropeptide Y in noradrenergic neurons induces obesity in transgenic mouse models. Neuropeptides, 55:31–37. doi:10.1016/j.npep.2015.11.088.
   PubMed Web of Science ®Google Scholar
• van Zessen, R., PHillips, J.L., Budygin, E.A., & Stuber, G.D. (2012). Activation of VTA GABA neurons disrupts reward consumption. Neuron, 73, 1184–1194.
   PubMed Web of Science ®Google Scholar
• Velasquez-Martinez, M.C., Vazquez-Torres, R., & Jimenez-Rivera, C.A. (2012). Activation of alpha1-adrenoceptors enhances glutamate release onto ventral tegmental area dopamine cells. Neuroscience, 216, 18–30.
   PubMed Web of Science ®Google Scholar
• Venken, K.J., Simpson, J.H., & Bellen, H.J. (2011). Genetic manipulation of genes and cells in the nervous system of the fruit fly. Neuron, 72, 202–230.
   PubMed Web of Science ®Google Scholar
• Vergoz, V., Roussel, E., Sandoz, J.C., & Giurfa, M. (2007). Aversive learning in honeybees revealed by the olfactory conditioning of the sting extension reflex. PLoS One, 2, e288.
   PubMed Web of Science ®Google Scholar
• Voigt, J.P., & Fink, H. (2015). Serotonin controlling feeding and satiety. Behavior Brain Research, 277, 14–31.
   PubMed Web of Science ®Google Scholar
• Waddell, S. (2013). Reinforcement signalling in Drosophila; dopamine does it all after all. Current Opinion in Neurobiology, 23, 324–329.
   PubMed Web of Science ®Google Scholar
• Wang, Y., Pu, Y., & Shen, P. (2013). Neuropeptide-gated perception of appetitive olfactory inputs in Drosophila larvae. Cell Reports, 3, 820–830.
   PubMed Web of Science ®Google Scholar
• Witten, I.B., Lin, S.C., Brodsky, M., Prakash, R., Diester, I., Anikeeva, P., … Deisseroth, K. (2010). Cholinergic interneurons control local circuit activity and cocaine conditioning. Science, 330, 1677–1681.
   PubMed Web of Science ®Google Scholar
• Wolff, G. H., & Strausfeld, N.J. (2015). Genealogical correspondence of mushroom bodies across invertebrate phyla. Current Biology, 25, 38–44.
   PubMed Web of Science ®Google Scholar
• Wood, J., Verma, D., Lach, G., Bonaventure, P., Herzog, H., Sperk, G., & Tasan, R.O. (2015). Structure and function of the amygdaloid NPY system: NPY Y2 receptors regulate excitatory and inhibitory synaptic transmission in the centromedial amygdala. Brain Structure and Function. 1–19 doi:10.1007/s00429-015-1107-7.
   PubMed Web of Science ®Google Scholar
• Wu, C.L., Shih, M.F., Lee, P.T., & Chiang, A.S. (2013). An octopamine-mushroom body circuit modulates the formation of anesthesia-resistant memory in Drosophila. Current Biology, 23, 2346–2354.
   PubMed Web of Science ®Google Scholar
• Wu, Q., Wen, T., Lee, G., Park, J.H., Cai, H.N., & Shen, P. (2003). Developmental control of foraging and social behavior by the Drosophila neuropeptide Y-like system. Neuron, 39 (1), 147–161.
   PubMed Web of Science ®Google Scholar
• Xia, S., & Chiang, A.S. (2009). NMDA receptors in Drosophila. In: A.M. Van Dongen, ed. Biology of the NMDA Receptor. Boca Raton, FL: CRC Press.
   Google Scholar
• Yawata, S., Yamaguchi, T., Danjo, T., Hikida, T., & Nakanishi, S. (2012). Pathway-specific control of reward learning and its flexibility via selective dopamine receptors in the nucleus accumbens. Proceedings of National Academic Sciences of United States of America, 109, 12764–12769.
   PubMed Web of Science ®Google Scholar
• Yokobori, E., Azuma, M., Nishiguchi, R., Kang, K.S., Kamijo, M., Uchiyama, M., & Matsuda, K. (2012). Neuropeptide Y stimulates food intake in the Zebrafish, Danio rerio. Journal of Neuroendocrinology, 24, 766–773.
   PubMed Web of Science ®Google Scholar
• Zhang, T., Branch, A., & Shen, P. (2013). Octopamine-mediated circuit mechanism underlying controlled appetite for palatable food in Drosophila. Proceedings of National Academic Sciences of United States of America, 110, 15431–15436.
   PubMed Web of Science ®Google Scholar