The term “immune privilege” was originally coined to describe the suppression of inflammatory responses within organs protected by anatomic barriers, ie, the eyes, brain, placenta, and testes. However, cellular and metabolic processes, which orchestrate immune responses, also control inflammation within these sites. Our current understanding of tolerogenic mechanisms has extended the definition of immune privilege to include hair follicles, the colon, and cancer. By catabolizing tryptophan, cells expressing the enzyme indoleamine-2,3-dioxygenase produce kynurenine metabolites, which orchestrate local and systemic responses to control inflammation, thus maintaining immune privilege. This review highlights the double-edged role played by the kynurenine pathway (KP), which establishes and maintains immune-privileged sites while contributing to cancer immune escape. The identification of the underlying molecular drivers of the KP in immune-privileged sites and in cancer is essential for the development of novel therapies to treat autoimmunity and cancer and to improve transplantation outcomes.