Lumbar artery pseudoaneurysms have previously been described as rare iatrogenic complications following percutaneous interventional procedures involving the flanks. We describe a case of a 71-year-old man who became unstable and dropped 3 grams of hemoglobin within 24 hours following renal biopsy. A post-biopsy hemorrhage was suspected, and a pseudoaneurysm of his second right lumbar (L2) artery was found on computed tomography angiogram (CTA). Successful coil embolization was performed in the right L2 artery. This case discusses the diagnostic and therapeutic challenges of this unusual complication as well as the anatomical and technical factors involved in the embolization of the lumbar arteries.