In traditional scheduling problems, job processing times are considered constant and known in advance. This assumption is, however, a simplification when it comes to hand-intensive real-life production contexts because workers usually induce variability in the job processing times due to several factors such as learning, monotony, fatigue, psychological factors, etc. These effects can decrease or increase the actual processing time when workers execute a job. The academic literature has reported several modeling and resolution approaches to deal with the phenomenon in a variety of configurations. However, there is no comprehensive review of these research outputs to the best of our knowledge. In this paper, we follow a systematic approach to review relevant contributions addressing the scheduling problem with learning and deterioration effects. Modeling approaches for learning and deterioration effects, objective functions, and solution methods employed in the literature are the main topics for the taxonomy proposed in this review. A total of 455 papers from 1999 to 2021 are included and analyzed. Different areas of interest are presented, and some opportunities for future research are identified.