The COVID-19 pandemic has led to numerous changes in work environments. Thousands of workers quickly found themselves having to telework without being prepared, which had consequences on their work experience and health. Authors proposed telework practices that promote the healthy work experience of workers in a pandemic context, but less attention has been paid to consider the realities and needs of individuals with physical disabilities. Purpose This study aimed to explore the influence of telework during the pandemic on the work experience of people with physical disabilities. Methods Following an interpretive descriptive research design, interviews were conducted with 16 workers with physical disabilities (i.e., motor, or sensory). The data were analyzed using a thematic analysis strategy. Results The results revealed 15 factors that influence the work experience of teleworkers with physical disabilities. These factors are related to interactions between three spheres of the worker's life: the individual, the organization, and the environment. Ten recommendations are proposed to consider the reality and needs of individuals with physical disabilities in the telework practices. Conclusion Given that telework has expanded since the onset of the COVID-19 pandemic and will likely continue to remain a widespread modality of work delivery, it becomes even more important to expand knowledge about it, to benefit the work experience of teleworkers with physical disabilities.