Studies of probiotics, fructan-type prebiotics, and synbiotics in patients with ulcerative colitis (UC) show significant heterogeneity in methodology and results. Here, we study the efficacy of such interventions and the reasons for the heterogeneity of their results. Eligible random controlled trials were collected from the PUBMED and SCOPUS databases. A total of 18 placebo-controlled and active treatment-controlled (i.e., mesalazine) studies were selected with a Jadad score ≥ 3, including 1491 patients with UC. Data for prebiotics and synbiotics were sparse and consequently these studies were excluded from the meta-analysis. The UC remission efficacy of probiotics was measured in terms of relative risk (RR) and odds ratio (OR). Significant effects were observed in patients with active UC whenever probiotics containing bifidobacteria were used, or when adopting the US Food and Drug Administration (FDA)-recommended scales (UC Disease Activity Index and Disease Activity Index). By the FDA recommended scales, the RR was 1.55 (CI95%: 1.13–2.15, p-value = 0.007, I 2 = 29%); for bifidobacteria-containing probiotics, the RR was 1.73 (CI95%: 1.23–2.43, p-value = 0.002, I 2 = 35%). No significant effects were observed on the maintenance of remission for placebo-controlled or mesalazine-controlled studies. We conclude that a validated scale is necessary to determine the state of patients with UC. However, probiotics containing bifidobacteria are promising for the treatment of active UC.