Energy Efficiency Boost in the AI-Infused POWER10 Processor

Thompto, Brian W.; Nguyen, D. Q.; Moreira, José E.; Bertran, Ramon; Jacobson, Hans; Eickemeyer, Richard J.; Rao, Rahul; Goulet, Michael; Byers, Marcy; González, Christopher; Swaminathan, Karthik; Dhanwada, Nagu; Müller, Silvia M.; Wagner, Andreas; Sadasivam, Satish Kumar; Montoye, Robert K.; Starke, William J.; Zoellin, Christian G.; Floyd, Michael S.; Stuecheli, Jeffrey; Chandramoorthy, Nandhini; Wellman, John-David; Buyuktosunoglu, Alper; Pflanz, Matthias; Sinharoy, Balaram; Bose, Pradip

doi:10.1109/isca52012.2021.00012

Cited by 7 publications

(1 citation statement)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We accurately characterize the power consumption behavior of the different functions implemented in the AI accelerator using an IBM internal power methodology tightly linked to RTL [29,53,54,89]. By using MicroProbe, a tool which has been used across multiple generations of IBM POWER and Z chips [12-14, 16, 27, 34, 89, 94, 98, 99], specific test cases are generated automatically with the required parameters to perform the VHDL runs in a practical amount of time.…”

Section: Acceleratormentioning

confidence: 99%

AI accelerator on IBM Telum processor

Lichtenau

Buyuktosunoglu²,

Bertran³

et al. 2022

Proceedings of the 49th Annual International Symposium on Computer Architecture

Self Cite

View full text Add to dashboard Cite

IBM Telum is the next generation processor chip for IBM Z and LinuxONE systems. The Telum design is focused on enterprise class workloads and it achieves over 40% per socket performance growth compared to IBM z15. The IBM Telum is the first server-class chip with a dedicated on-chip AI accelerator that enables clients to gain real time insights from their data as it is getting processed.Seamlessly infusing AI in all enterprise workloads is highly desirable to get real business insight on every transaction as well as to improve IT operation, security, and data privacy. While it would undeniably provide significant additional value, its application in practice is often accompanied by hurdles from low throughput if run on-platform to security concerns and inconsistent latency if run off-platform. The IBM Telum chip introduces an on-chip AI accelerator that provides consistent low latency and high throughput (over 200 TFLOPS in 32 chip system) inference capacity usable by all threads. The accelerator is memory coherent and directly connected to the fabric like any other general-purpose core to support low latency inference while meeting the system's transaction rate. A scalable architecture providing transparent access to AI accelerator functions via a non-privileged general-purpose core * This paper is part of the Industry Track of ISCA 2022's program.

show abstract

Section: Acceleratormentioning

confidence: 99%