Isocitrate dehydrogenase 3 (IDH3) is a key enzyme in the mitochondrial tricarboxylic acid (TCA) cycle, which catalyzes the decarboxylation of isocitrate into α-ketoglutarate and concurrently converts NAD + into NADH. Dysfunction of IDH3B, the β subunit of IDH3, has been previously correlated with retinal degeneration and male infertility in humans, but tissue-specific effects of IDH3 dysfunction are unclear. Here, we generated Idh3b-KO mice and found that IDH3B is essential for IDH3 activity in multiple tissues. We determined that loss of Idh3b in mice causes substantial accumulation of isocitrate and its precursors in the TCA cycle, particularly in the testes, whereas the levels of the downstream metabolites remain unchanged or slightly increased. However, the Idh3b-KO mice did not fully recapitulate the defects observed in humans. Global deletion of Idh3b only causes male infertility but not retinal degeneration in mice. Our investigation showed that loss of Idh3b causes an energetic deficit and disrupts the biogenesis of acrosome and flagellum, resulting in spermiogenesis arrestment in sperm cells. Together, we demonstrate that IDH3B controls its substrate levels in the TCA cycle, and it is required for sperm mitochondrial metabolism and spermiogenesis, highlighting the importance of the tissue-specific function of the ubiquitous TCA cycle.