Throughput Calculation for GEMM | Dataford Interview Questions

How would you calculate throughput for a GEMM kernel given its properties?

Implement the roofline model for C = A × B, counting two floating-point operations per multiply-add and one read of each input matrix plus one write of the output matrix. Return arithmetic intensity, compute and memory throughput limits, predicted throughput after efficiency, and the bottleneck.

The function accepts a dictionary and returns a dictionary with numeric values rounded to six decimal places.

Constraints

1 <= m, n, k <= 10^6
0 < peak_tflops <= 10^4
0 < bandwidth_gbps <= 10^7
1 <= element_bytes <= 16
0 <= efficiency <= 1
All matrix dimensions and hardware values are numeric

Function Signature

def gemm_throughput(properties):

Your question is Throughput Calculation for GEMM. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

Problem

How would you calculate throughput for a GEMM kernel given its properties?

The function accepts a dictionary and returns a dictionary with numeric values rounded to six decimal places.

Constraints

1 <= m, n, k <= 10^6
0 < peak_tflops <= 10^4
0 < bandwidth_gbps <= 10^7
1 <= element_bytes <= 16
0 <= efficiency <= 1
All matrix dimensions and hardware values are numeric

Function Signature

def gemm_throughput(properties):

Your question is Throughput Calculation for GEMM. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.