Background: Job satisfaction is a highly useful factor in maintaining a successful work life for the disabled. Objective: This study aimed to evaluate how job satisfaction among workers with physical disabilities evolves over time, and to identify predictive factors that influence the trajectory of job satisfaction. Methods: A longitudinal data analysis using the three-year databases of the 2016–2018 Employment Panel Survey for the Disabled (n = 693). A latent growth curve model analysis was conducted to determine the trajectory of the job satisfaction among workers with physical disabilities, as well as the predictive factors affecting it. Results: Job satisfaction among workers with physical disabilities increased over time, and there were substantial individual differences in the trajectory of the job satisfaction. The significant predictors for the job satisfaction over the three years were degree of disability, computer usage ability, employment support services, and experience of discrimination. Gender, educational background, interpersonal relationship/organizational adaptability, convenience facilities for the disabled, job suitability, disability acceptability, and self-esteem had a considerable impact on the intercept of the job satisfaction, but not on the slope. Conclusion: The findings would inform healthcare providers to establish mid-to-long-term vocational rehabilitation intervention plans that could increase the job satisfaction among workers with physical disabilities.