Milk fermentation by lactic acid bacteria both enhances its nutritional value and provides probiotic strains to correct the intestinal microflora. Here, we show the comparative analysis of milk fermented with the new strain, Lactiplantibacillus plantarum AG10, isolated from silage and the industrial strain Lactobacillus delbrukii subs. bulgaricus. While the milk acidification during fermentation with L. plantarum AG10 was lower compared with L. bulgaricus, milk fermented with L. plantarum AG10 after a 14-day storage period retained a high level of viable cells and was characterized by an increased content of exopolysaccharides and higher viscosity. The increased EPS production led to clot formation with higher density on microphotographs and increased firmness and cohesiveness of the product compared with L. bulgaricus-fermented milk. Furthermore, the L. plantarum AG10-fermented milk exhibited increased radical-scavenging activity assuming lower fat oxidation during storage. Taken together, these data suggest that L. plantarum AG10 seems to be a promising starter culture for dairy products with lowered levels of lactic acid, which is important for people with increased gastric acid formation.