Part III: Training and single-worker inference
When included, the optional training lab collection is in the Optional Labs appendix. The core training update is complete on its own; the lab adds a longer profiling experiment.
Chapters in this part
- 9. Training state and precision: Run and check a full local update before testing precision or training-state changes.
- 10. Inference phases and memory budgets: Follow one request and calculate weight/KV memory and client timing.
- 11. Model compression for inference: Relate saving, calibration, quality and an actually supported execution path.
- 12. Decode and KV-cache layout: Trace cached versus uncached steps before byte equations, APIs and allocation choices.
