Loading…
Back To Schedule
Tuesday, September 15 • 11:10am - 11:40am
AI Acceleration Capabilities Using MMA(Matrix Multiply Assist) on POWER Architecture - Satish Kumar Sadasivam & Puneeth Bhat AH, IBM

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.

Power ISA v3.01 has introduced a new set of architecture capabilities to accelerate matrix math operations called MMA (Matrix Multiply Assist). This will improve the performance of key compute kernels such as Matrix Multiplication, Convolution, Fourier Transform etc. which are fundamental building blocks for ML/DL workloads. This talk will introduce the audience to the POWER ISA MMA capabilities and detail the following: MMA’s architectural features, new instructions and lower/mixed precision data type support. The talk will cover programming a simple matrix multiplication function using MMA code and differentiate it from the traditional VSX (Vector Scalar Extension) based code sequence. The talk will delve into details of exploiting the full capability of MMA with assembly-level optimal code sequences for different data types. This talk will also cover compiler built-ins from GCC-10 and discuss exploitation of MMA capability in ML/DL frameworks using MMA-enabled OpenBLAS library.

Continue the conversation in Slack

Speakers
avatar for Satish Kumar Sadasivam

Satish Kumar Sadasivam

Senior Performance Architect, Master Inventor, IBM
Satish Kumar Sadasivam is a Senior Performance Architect who leads the workload characterization and future architecture design space exploration team in IBM. He currently focuses on studying the low-level workload characteristics and exploring architectural and microarchitectural... Read More →
PB

Puneeth Bhat A H

Senior Performance Analyst, IBM
Puneeth Bhat A H is a Senior Performance Analyst working on the Power Systems Performance at IBM. Presently he is driving the cognitive workload and interpreter performance innovations for Power Processors. Puneeth, with 10 years of IBM experience, has expertise in the areas of processor... Read More →



Tuesday September 15, 2020 11:10am - 11:40am CDT
Track 1
  ISA
  • See Session Slides yes