This paper analyzes the Agile metrics embedded in the widely adopted issue tracking tools and used by agile teams to deliver software products. Organizations face challenges when they are required to measure the performance of all the teams operating within the company to provide a holistic view of the software delivery performance at a higher level. A new set of key performance indicators (KPIs) is introduced that can help software companies standardize their delivery across the organization and provide an overview of the software delivery performance that can serve as an insight for the top management teams. The new metrics are applied to a project as part of a case study. The conclusions highlight that the metrics provided by the issue tracking systems do not provide insights into the non-functional requirements of the software products, the methodology applied during the delivery, and the quality of each increment produced. The proposed set of KPIs addresses these shortcomings.