
The Accelerator Landscape
NVIDIA GPUs, Google TPUs, Cerebras, Groq, and IBM Spyre all run neural networks, but each makes different choices about how work is scheduled and where data is kept. The course compares those choices with one framework built on Amdahl's law, arithmetic intensity, and the roofline model.
Lab: Profile LLM inference on a CPU and a GPU, place the measurements on a roofline, and start an Accelerator Landscape Map that you extend in every later course.
- Explain why AI workloads benefit from domain-specific accelerators using Amdahl's law and arithmetic intensity.
- Compare execution and memory models across GPU, TPU, Cerebras, Groq, and IBM Spyre.
- Use a roofline model to tell compute-bound from memory-bound workloads.





