Model Deployment
A ModelDeployment describes the model, engine and roles of a serving workload. Each role can have
its own replicas and resources.
Contents
Deployment configuration
Model Deployment Configuration starts with a minimal manifest and explains the role contract. Prefill and Decode covers split roles. Engine Versions records tested version floors.
Service operations
Status , Metrics and Routing explain what the running service reports and how requests are directed.