Emphysematous pyelonephritis (EPN) is a severe, necrotizing infection of the renal parenchyma. It is commonly found as a complication of uncontrolled diabetes mellitus (DM). EPN has a terrible prognosis unless promptly identified and treated. In this case study, a 38-year-old man with type 2 diabetes mellitus (T2DM) was admitted due to complaints of excruciating abdominal pain, vomiting, and non-adherent to his insulin medication. The patient was subsequently diagnosed with EPN. For most patients, the current course of treatment includes nephrectomy along with antimicrobial medications. In this case report, however, the patient improved with conservative treatment such as IV fluids, antibiotics, and blood glucose control.