Galactic spinning compact objects (COs) with non-zero ellipticity are expected to be sources of continuous gravitational waves (CGWs). Certain classes of hypothetical COs, such as neutron stars with quark cores (hybrid stars), and quark stars, are thought to be capable of sustaining large ellipticities from theoretical considerations. Such exotic COs (eCOs) with large ellipticities should produce CGWs detectable by the current LIGO-Virgo-Kagra GW detector network. Since no detections for CGWs, from searches in LIGO-Virgo data, have so far been reported, we place constraints on the abundance of highly elliptical eCOs in our Galaxy. We formulate a Bayesian framework to place upper limits on the number count \(N_{tot}\) of highly deformed Galactic eCOs. We divide our constraints into two classes: an "agnostic" set of upper limits on \(N_{tot}\) evaluated on a CGW frequency and ellipticity grid that depend only on the choice of spatial distribution of COs; and a model-dependent set that additionally assumes prior information on the distribution of frequencies. We find that COs with ellipticities \(\epsilon \gtrsim 10^{-5}\) have abundance upper limits at \(90\%\) confidence, of \(N_{tot}^{90\%} \lesssim 100\), and those with \(\epsilon \gtrsim 10^{-6}\) have \(N_{tot}^{90\%} \lesssim 10^4\). We additionally place upper-limits on the ellipticity of Galactic COs informed by our choices of spatial distributions, given different abundances \(N_{tot}\).