Endoscopic retrograde cholangiopancreatography (ERCP) remains the main therapeutic modality towards the management of common bile duct (CBD) stones and dilatation of strictures. It also has varied diagnostic roles including brush biopsy. The procedure still is associated with side effects and increased morbidity and mortality. One side effect is bleeding. This may be associated with procedural trauma or bleeding following post-traumatic pseudoaneurysm delayed-onset bleeding. Although it may be argued that inflammation surrounding the biliary duct area and in particular the pancreas could also contribute to the delayed bleeding along the ampullary region, we present a case of delayed pseudoaneurysm bleeding that was successfully managed post-ERCP via interventional radiology-guided embolization.