We assessed empathy in medical residents, including factors modifying empathy and the relationship between empathy and burnout. Participants (n = 317 residents, response rate = 42%) from 4 university hospitals completed a socio-demographic questionnaire, the Jefferson Scale of Empathy (Health Professional version, Korean edition), and the Maslach Burnout Inventory (MBI). Participants were classified by medical specialty: “people-oriented specialty” (POS group) or “technology-oriented specialty” (TOS group), with more women in the POS than in the TOS group, χ2 = 14.12, P < 0.001. Being female, married, and having children were factors related to higher empathy (gender, t = -2.129, P = 0.034; marriage, t = -2.078, P = 0.038; children, t = 2.86, P = 0.005). Within specialty group, POS residents showed higher empathy scores in the fourth as compared to the first year, F = 3.166, P = 0.026. Comparing POS and TOS groups by year, fourth year POS residents had significantly higher scores than did fourth year TOS residents, t = 3.349, P = 0.002. There were negative correlations between empathy scores and 2 MBI subscales, emotional exhaustion (EE) and depersonalization (DP). Additionally, first year POS residents had higher DP scores than did first year TOS residents, t = 2.183, P = 0.031. We suggest that factors important for empathy are type of medical specialty, marriage, siblings, and children. Burnout state may be related to decreasing empathy.