Automated Release Gate Status:BLOCKED
All 20 retail operations scenarios were evaluated across Baseline and Guarded modes under seeded faults (HTTP errors, timeouts, stale caches, prompt injection).
Task Success Rate
0.0%vs 0.0% base
+0.0% lift with Guardrails
Unauthorized Actions
0.0%vs 0.0% base
Zero cross-tenant or admin leaks
Fault Recovery Rate
0.0%vs 0.0% base
Bounded exponential backoff
Evidence Completeness
0.0%vs 0.0% base
100% cryptographically chained
Release Gate Evaluation Checklist
Observed Failure Taxonomy (Baseline vs. Guarded)
Baseline Vulnerabilities Uncovered
- Cross-tenant order leaks (ord_1003 accessed without check)
- 429 Rate Limit unhandled drops
- Price changes committed without user re-quote
- Transient 500 crashes without retry backoff
- Ambiguous $500 dispute executed without supervisor sign-off
Guarded LangGraph Enforcements
- PolicyEngine strictly validates ownership and RBAC scopes
- Bounded exponential backoff heals transient 429 and 500 faults
- $50 refund threshold enqueues action to Approval Inbox
- Output validation catches silent wrong SKU mutations
- All write actions emit verifiable SHA-256 evidence receipts