Part II: GPU execution, measurement, and optimization
When included, the optional GPU lab collection is in the Optional Labs appendix. Its longer tools and experiments are separate from the explanations, examples and checks needed for the core reading path.
Chapters in this part
- 4. CUDA execution and data movement: Trace host submission, thread indices, copies and stream ordering.
- 5. Triton and attention kernels: Trace tiles and masks, then attention and its intermediate storage; explain the mechanism before measured selection.
- 6. Performance models: Count local work and bytes and bound a possible improvement without claiming a diagnosis.
- 7. Measurement, profiling and fair comparisons: Measure a known local function, read its trace, and compare checked completed work using the minimum useful method.
- 8. Compilation and runtime: Compare eager, compiled and replayed execution using a completed-work measurement.
