Applied AI·Security and safety
you validate and allowlist what the model returned before your code acts on it, because that output is untrusted input to everything downstream.
Output validation as a security boundary
Draft summary, pending review
Treating model output as untrusted input to downstream systems: validate schemas, allowlist commands and URLs, parameterise queries, escape rendering. The model is inside your trust boundary's blast radius, not inside your trust boundary.