railway
The same facts as the comparison below, in sentences. Nothing here depends on reading the table.
The approved route beside the route this release actually took, step by step, in canonical order.
| Step | Service | Approved | This release | Change | Side effect | Tool |
|---|---|---|---|---|---|---|
| refund.request | flightrules-demo-agent | 1 | 1 | IN BOTH | none | — |
| refund.calculate | flightrules-demo-agent | 1 | 1 | IN BOTH | none | calculate_refund |
| customer.notify | flightrules-demo-agent | 1 | 1 | IN BOTH | external | notify_customer |
| customer.notify.handler | flightrules-notification-service | 1 | 1 | IN BOTH | external | — |
| fraud.check | flightrules-demo-agent | 1 | 1 | IN BOTH | read | check_fraud |
| fraud.check.handler | flightrules-fraud-service | 1 | 1 | IN BOTH | read | — |
| order.lookup | flightrules-demo-agent | 1 | 1 | IN BOTH | read | lookup_order |
| order.lookup.handler | flightrules-order-service | 1 | 1 | IN BOTH | read | — |
| policy.retrieve | flightrules-demo-agent | 1 | 1 | IN BOTH | read | retrieve_policy |
| policy.retrieve.handler | flightrules-policy-service | 1 | 1 | IN BOTH | read | — |
| payment.refund | flightrules-demo-agent | 1 | 1 | IN BOTH | write | issue_refund |
| payment.refund.handler | flightrules-payment-service | 1 | 1 | IN BOTH | write | — |
approved 43070aa4af4f6c2c912a8d7bcc724f1d199e0425dc8ad7256b528eec195cb037 · observed 43070aa4af4f6c2c912a8d7bcc724f1d199e0425dc8ad7256b528eec195cb037
Produced by the deterministic graph comparison in the FlightRules engine, not by comparing text in the browser.
The engine found no typed change.
This release took a route the contract's baseline already approves.
| Threshold | Permitted | Observed |
|---|---|---|
| Violation rate | 0.5% | 0.00% |
| Unknown route rate | 1% | 0.00% |
| Latency change | 20% | 0.00% |
| Token change | 25% | not measured |
| Duplicate side effects | reported | 0.00% |
| Missing prerequisites | reported | 0.00% |
No finding. Every threshold this contract sets was satisfied.
| Disclosure | Detail |
|---|---|
| RETRY CHANGE NOT MEASURED | No usable baseline value for agent.retry.count, so its change could not be measured. |
| TOKEN REGRESSION NOT MEASURED | No usable baseline value for gen_ai.usage.total_tokens, so its change could not be measured. |
Representative runs this decision was taken over. Each SigNoz link is the URL SigNoz itself returned for that trace when FlightRules retrieved it, not a pattern this page assembled.
| Trace | Outcome | Route | Similarity | In SigNoz |
|---|---|---|---|---|
| 006a7d93a65018d66b7ef59a5219513e | PASSING | approved | 1.000000 | Open trace |
| 0e7dc6ca2e2cce30af1fb91e1cdf3f3b | PASSING | approved | 1.000000 | Open trace |
| 0f40df267f643ce40b2ce2f6f572a502 | PASSING | approved | 1.000000 | Open trace |
| 174e545383b5d94787e1c226564e7ca4 | PASSING | approved | 1.000000 | Open trace |
| 17db51e924e0b423da7705d21e4e1fc1 | PASSING | approved | 1.000000 | Open trace |
Re-running the evaluation creates a new evaluation and a job. The decision above is read from the most recent completed evaluation, so it does not change until the new one finishes — and the evidence behind it is preserved either way.