Roofline model

https://en.wikipedia.org/wiki/Roofline_model

For determining memory bound vs compute bound tasks

Arithmetic Intensity

The arithmetic intensity  also referred to as operational intensity is the ratio of the work  (usuallly in or Floating Point Operations) to the memory traffic  ()

It denotes the number of operations per byte of memory traffic.

ceilings_in_roofline_model

Rereferences

  1. “Computer Architecture: A Quantitative Approach” Book, chapter 4 : SIMD and GPU programming