The present review assesses the potential neural impact of impoverished, captive environments on large-brained mammals, with a focus on elephants and cetaceans. These species share several characteristics, including being large, wide-ranging, long-lived, cognitively sophisticated, highly social, and large-brained mammals. Although the impact of the captive environment on physical and behavioral health has been well-documented, relatively little attention has been paid to the brain itself. Here, we explore the potential neural consequences of living in captive environments, with a focus on three levels: (1) The effects of environmental impoverishment/enrichment on the brain, emphasizing the negative neural consequences of the captive/impoverished environment; (2) the neural consequences of stress on the brain, with an emphasis on corticolimbic structures; and (3) the neural underpinnings of stereotypies, often observed in captive animals, underscoring dysregulation of the basal ganglia and associated circuitry. To this end, we provide a substantive hypothesis about the negative impact of captivity on the brains of large mammals (e.g., cetaceans and elephants) and how these neural consequences are related to documented evidence for compromised physical and psychological well-being.