From AI Model to AI Product
Evaluation-driven development of LLM-based products

Inherently, a trained large language model (LLM) is data, mainly its learned weights, that can be stored in one or more files. Software libraries such as PyTorch load and run the model. The surrounding application sends requests, receives answers, connects to external tools and systems, interacts with other agents, and supports diagnostics.
This book explains how to build and evaluate the software that interacts with an LLM. It covers evaluation-driven development (EDD), which uses test results to guide improvements, alongside prompt design, retrieval-augmented generation (RAG), workflows, and agents.
Other books in the series cover the mathematics behind models, distributed training and inference systems, model post-training, hardware and software optimization, and security relevant to AI.