This study examines the relationships between loneliness, gender, and age for people without and with disabilities (moderate versus severe) in Germany. Using data taken from the German Socio-Economic Panel (SOEP) for the years 2013 and 2017 and using the UCLA (University of California, Los Angeles) Loneliness Scale, in general we found that males report lower loneliness scores as compared to those for females. Furthermore, we found a strong association between loneliness and the individual’s age, but with differences according to gender and disability status. For example, for males with severe disabilities levels of loneliness decrease with age, whereas for females with severe disabilities the opposite result is found. In addition, we found that participation in leisure activities and having a higher frequency of contacts with family, friends, and social online networks (measured by the relational time index) contribute to reducing loneliness for all individuals. From a public policy perspective, it is necessary to undertake the design, promotion, and implementation of instrumental, emotional, and social support measures for people with disabilities (in particular for females that are severely limited in their daily activities), which can contribute to reducing their loneliness scores and increasing their levels of life satisfaction.