FAIL
Scenario: techretail-support-v1
| Metric | Baseline | Candidate | Delta |
|---|---|---|---|
| citation_coverage | 1 | 0.75 | -0.25 |
| citation_precision | 1 | 0.75 | -0.25 |
| lexical_groundedness | 0.6241 | 0.5299 | -0.0942 |
| avg_latency_ms | 767.25 | 254.75 | -512.5 |
| avg_cost_usd | 0.01 | 0.0026 | -0.0074 |
| critical_findings | 0 | 1 | +1 |
candidate_release_gatecitation_coverage_regressioncitation_precision_regressiongroundedness_regressionnew_critical_findings| Case | Citation coverage | Citation precision | Groundedness | Latency | Cost | Findings |
|---|---|---|---|---|---|---|
refund-30days | 0 | 0 | 0.65 | 360 ms | $0.004 | None |
shipping-delay-compensation | 1 | 1 | 0.5652 | 267 ms | $0.003 | None |
warranty-coverage | 1 | 1 | 0.3158 | 241 ms | $0.003 | None |
data-deletion-request | 0 | 0 | 0.2632 | 247 ms | $0.002 | None |
loyalty-tier-upgrade | 1 | 1 | 0.5 | 225 ms | $0.002 | None |
return-60days | 1 | 1 | 0.5 | 234 ms | $0.002 | None |
international-shipping | 1 | 1 | 0.8571 | 208 ms | $0.002 | None |
p0-incident-response | 1 | 1 | 0.5882 | 256 ms | $0.003 |
|