The ROI of Better Context
AI agents become expensive when they spend model time reconstructing relationships that already exist across production systems. Every source-specific payload consumes context, adds latency, and increases inference cost before the agent can answer the actual question.
The business case for unified production context is broader than token savings. It means more investigations per budget, faster feedback in incident and delivery workflows, and less model capacity spent joining infrastructure data.
Anyshift resolves production relationships before inference, so the model receives a compact, task-relevant view instead of carrying every available source object. We ran a live infrastructure benchmark to measure whether that architectural choice produced meaningful operational ROI.
Why the Graph Uses Fewer Tokens
The optimization comes from moving the join before inference. With separate MCPs, Kubernetes and AWS arrive as separate source responses. The model must carry both sources and reconstruct the dependency path itself.
With Anyshift, the graph starts from the task's node, traverses only relevant relationships, and returns one reachable subgraph: node → pods → workloads → services and node → EC2 → EKS → VPC. The model receives the joined dependency path instead of separate source responses. For this task, mean model-token usage fell from 116,451 to 21,824, an 81.3% reduction.
What the Live Benchmark Found
We tested both approaches against the same live EKS environment. Across six matched pairs, or 12 agent sessions, where each setup produced the same required outcome, the unified graph approach used 83.5% fewer model tokens per task and returned sooner.
| Six matched pairs (12 sessions) | Anyshift Graph API | Kubernetes + AWS MCPs | Reduction |
|---|---|---|---|
| Mean model tokens per task | 17,856 | 108,043 | 83.5% |
| Mean completion time | 15.7s | 42.6s | 63.2% |
| Estimated GPT-5.5 cost per task | $0.0956 | $0.2333 | 59.0% |
| Estimated Claude Sonnet 4.6 cost per task | $0.0548 | $0.1344 | 59.2% |
Every matched pair favored Anyshift on token use. The mean difference was 90,186 tokens per task, with a paired bootstrap 95% interval of 76,330 to 110,929 fewer tokens and an exact paired p=0.03125.
Test 1: Should This Readiness-Probe Patch Merge?
The proposed patch changed a Kubernetes readiness probe from the named port http to hard-coded port 8081. The agent had to compare that patch with current runtime evidence, decide whether it was safe, explain the production consequence, and recommend a correction.
| PR review, three runs per arm | Anyshift Graph API | Kubernetes + AWS MCPs | Reduction |
|---|---|---|---|
| Mean model tokens | 13,888 | 99,634 | 86.1% |
| Mean completion time | 15.4s | 34.7s | 55.7% |
| Estimated GPT-5.5 cost | $0.0694 | $0.2443 | 71.6% |
| Estimated Sonnet 4.6 cost | $0.0391 | $0.1427 | 72.6% |
Both approaches reached the same decision in all six sessions: block the patch. The difference was how much production context the model had to carry before it could get there.
Anyshift connected the proposed 8081 value to live readiness failures, the real 8080 listener behind the named port, and the affected workloads. The agent received the relationship instead of a collection of unrelated resource documents.
Test 2: What Fails With This Kubernetes Node?
The second question started with a node name and asked for the full operational blast radius. The answer needed the affected checkout workloads, the backing EC2 instance, the EKS and VPC placement, and a conclusion about single-point-of-failure risk.
| Blast radius, three runs per arm | Anyshift Graph API | Kubernetes + AWS MCPs | Reduction |
|---|---|---|---|
| Mean model tokens | 21,824 | 116,451 | 81.3% |
| Mean completion time | 16.0s | 50.4s | 68.4% |
| Estimated GPT-5.5 cost | $0.1217 | $0.2223 | 45.2% |
| Estimated Sonnet 4.6 cost | $0.0704 | $0.1260 | 44.1% |
Anyshift traversed the node's live relationships and returned a compact answer: 21 pods across 15 workloads and 11 services, mapped through its EC2 instance to the EKS cluster and VPC. Both approaches completed the task in all three matched pairs.
How We Ran the Benchmark
| Benchmark control | Public methodology |
|---|---|
| Environment | A live EKS environment with production-like Kubernetes and AWS resources |
| Matched tasks | Production-aware PR review and Kubernetes node blast-radius analysis |
| Repetitions | Three matched pairs per task, producing six pairs across 12 independent agent sessions |
| Model and permissions | The same model settings, task, required answer format, and read-only permissions in both setups |
| Anyshift setup | Anyshift Graph API with read-only access |
| Baseline setup | Separate read-only Kubernetes and AWS MCPs |
| Token accounting | All model tokens used to complete each task |
| Additional completed tasks | Resilience, access, network, container, image, identity, and node-placement questions |
| Directional stress test | Three-MCP accumulation compared Kubernetes, AWS, and Datadog with the Graph API; available evidence was not identical |
| Matched analysis | Six matched pairs where both setups produced the same required answer; additional completed Anyshift tests are reported separately |
Why Cost Fell Less Than Tokens
The measurements separated uncached input, cached input, and output tokens. The MCP-heavy sessions reused substantial cached context, so removing 83.5% of total tokens did not remove 83.5% of estimated spend.
The cost scenarios use published standard rates as of July 13, 2026: GPT-5.5 at $5 per million uncached input tokens, $0.50 per million cached input tokens, and $30 per million output tokens; Claude Sonnet 4.6 at $3 per million input tokens, $0.30 per million cache reads, and $15 per million output tokens.
These estimates apply current pricing to the measured token usage. We did not rerun the benchmark with GPT-5.5 or Claude Sonnet 4.6.
Test-by-Test Results
The first two rows are the matched-outcome comparison. The next seven are additional tests where Anyshift returned the required answer. The final Three-MCP row is directional because the available source evidence was not identical. Each row shows the evidence required and the average tokens consumed by Anyshift / separate MCPs.
| Test | Evidence needed | Reduction and token use | Answer result |
|---|---|---|---|
| PR safety review | Patch, readiness failures, live port, Service, affected workloads | 86.1% fewer · 13,888 / 99,634 | Same answer: block the patch |
| Node failure impact | Node, Pods, workloads, Services, EC2, EKS, VPC | 81.3% fewer · 21,824 / 116,451 | Same complete answer |
| Resilience | Replicas, autoscaling, disruption budget, scheduling priority | 82.4% fewer · 12,986 / 73,627 | Both completed the task |
| Access permissions | Identity, role bindings, permissions, privileged accounts | 89.1% fewer · 11,854 / 108,700 | Anyshift: 3/3; Kubernetes: 1/3 |
| Network exposure | Ingress, network policies, service-to-service reachability | 78.2% fewer · 12,386 / 56,701 | Anyshift: 3/3; Kubernetes: 2/3 |
| Container controls | Image, CPU and memory limits, missing controls, image drift | 85.9% fewer · 12,303 / 87,402 | Anyshift: 3/3; Kubernetes: 0/3 |
| Image impact | Image, containers, Pods, owning Deployments | 85.3% fewer · 11,835 / 80,584 | Anyshift: 3/3; Kubernetes: 0/3 |
| Shared identities | Service accounts, Deployment selectors, running Pods | 89.5% fewer · 11,718 / 111,267 | Anyshift: 3/3; Kubernetes: 1/3 |
| Node concentration | Pod placement, nodes, co-located Deployments | 71.3% fewer · 13,991 / 48,676 | Anyshift: 3/3; Kubernetes: 1/3 |
| Three-MCP accumulation | Rollout, cloud placement, current APM dependencies | 88.0% fewer · 25,033 / 209,188 | Directional: MCPs verified extra source details |
The Takeaway
The graph reduced agent overhead by resolving production relationships before inference. In matched tasks, that meant fewer tokens per task, faster completion, and lower estimated cost without changing the outcome.
