In interviews with physics students and early career physicists, we ask about their experiences with having impairments in the physics setting and physics culture. In this paper, we highlight how experiences shared by participants as disabled people in physics represent clusters of models of disability. Specifically, we apply a theoretical framing of a three-dimensional disability model space, with axes defined as medical versus social (i.e., cause); tragedy versus affirmative (i.e., effect); and minority group versus universal (i.e., ability/disability dichotomy). For example, in this framework, providing accommodations is described by a cluster of the social and minority models of disability. By analyzing participants' experiences in physics through this disability framework, we aim to identify the models that underpin supportive experiences and support the development of policies and professional development for the physics community towards benefiting disabled people. Through analysis and comparison of these models and participants' narratives, we offer a discussion and possible guidelines for instructors interacting with students with disabilities, opportunities for those with disabilities to deconstruct their own prior experiences and analyze potential misinterpretations that may arise from the models. .