Most supercooled non-polymeric glass-forming melts exhibit a shear thinning phenomenon, i.e., viscosity decreases with increasing the strain rate. On compressing borosilicate glasses at high temperature, however, we discovered an interesting oscillatory viscous flow and identified it as a typical relaxation oscillation caused by the peculiar structure of borosilicate glass. Specifically, the micro-structure of borosilicate glass can be divided into borate network and silicate network. Under loading, deformation is mainly localized in the borate network via a transformation from the three coordinated planar boron to trigonal boron that could serve as a precursor for the subsequent formation of a BO 4 tetrahedron, while the surrounding silicate network is acting as a stabilization/relaxation agent. The formation of stress oscillation was further described and explained by a new physics-based constitutive model.