Ferula sinkiangesis is a valuable medicinal plant that has become endangered. Improving the soil habitat of Ferula sinkiangesis can alleviate plant damage. Fungi play an important role in the soil, but current information on the fungal community structure in the habitat of Ferula sinkiangesis and the relationship between soil fungi and abiotic factors remains unclear. In this study, we analyzed the relative abundance of fungal species in the rhizosphere of Ferula sinkiangesis. Spearman correlation analysis showed that the abiotic factor total potassium (TK) significantly explained the alpha diversity of the fungal community. At altitude, available phosphorus (AP), nitrate nitrogen (NN) and TK were significantly associated with the fungal species. In addition, a two-way ANOVA showed that soil depth had no significant effects on the alpha diversity of rhizosphere and non-rhizosphere fungi. Interestingly, linear discriminant effect size (LEfSe) analysis indicated that different biomarkers were present at varying soil depths. These findings may be related to the growth and medicinal properties of Ferula Sinkiangensis.