Key Takeaways
- YC-Bench is a new benchmark that simulates a full year of startup operations over hundreds of decision turns, testing LLMs on employee management, contract selection, payroll, and adversarial market conditions.
- Claude Opus 4.6 leads the leaderboard with $1.27M average final funds, but costs approximately $86 per run in API fees.
- GLM-5 from Zhipu AI reaches $1.21M average final funds at just $7.62 per run — an 11x cost reduction for 95% of the top model’s performance.
- The benchmark includes adversarial conditions where approximately 35% of simulated clients secretly inflate work requirements after contracts are accepted.
What Happened
A research team published YC-Bench in early April 2026, a benchmark that puts large language models in the role of CEO of a simulated startup and measures their performance over a full year of business operations spanning hundreds of sequential decision turns. The benchmark was shared on Reddit’s r/LocalLLaMA subreddit, where it received 95 upvotes and generated discussion about cost-efficiency in LLM deployment.
Twelve models were tested with 3 random seeds each to account for variance. Claude Opus 4.6, developed by Anthropic, topped the leaderboard with $1.27M in average final funds at an API cost of approximately $86 per run. GLM-5, developed by Zhipu AI, came in second with $1.21M — achieving 95% of the leading model’s financial performance at roughly one-eleventh the cost ($7.62/run).
Why It Matters
YC-Bench represents a fundamentally different category of AI evaluation compared to existing benchmarks. Unlike coding benchmarks (SWE-bench) or academic reasoning tests (GPQA), it measures sustained decision-making under uncertainty over long time horizons with sparse, delayed feedback. These conditions more closely resemble the challenges AI agents will face when deployed in real-world autonomous applications like supply chain management, portfolio optimization, or operations management.
The cost-performance gap between Claude Opus 4.6 and GLM-5 is the headline finding for practitioners. For applications where near-top performance at dramatically lower cost matters — which describes most production deployments operating under budget constraints — GLM-5’s result challenges the common assumption that the most expensive model is always the right choice for complex agentic tasks.
At $86 per run, deploying Claude Opus 4.6 for hundreds or thousands of agentic simulations becomes expensive quickly. GLM-5 achieving 95% of that performance at $7.62 means teams can run 11 times more iterations, simulations, or agent instances for the same budget.
Technical Details
YC-Bench simulates a startup environment where the LLM acting as CEO must manage employees (hiring, assigning work, handling payroll), select contracts from available opportunities, and navigate a market with built-in adversarial conditions. Approximately 35% of simulated clients secretly inflate their work requirements after a contract is accepted, forcing the model to adapt its strategy mid-engagement without prior warning.
The benchmark runs over hundreds of turns representing a full simulated year of operations. Feedback is delayed and sparse, with no hand-holding — the model receives consequences of its decisions with realistic lag rather than immediate scoring after each action. This tests a model’s ability to plan ahead, manage resources under uncertainty, and recover from setbacks over extended time horizons.
Each model was evaluated across 3 random seeds, and results were averaged. The leaderboard results for the top entries:
- Claude Opus 4.6 (Anthropic): $1.27M avg final funds, ~$86/run API cost
- GLM-5 (Zhipu AI): $1.21M avg final funds, ~$7.62/run API cost
The remaining 10 models in the 12-model comparison were not fully detailed in the available information, though the leaderboard includes entries from other major model providers. The $86/run cost for Claude Opus 4.6 reflects cumulative API charges across hundreds of turns of context-heavy decision-making, where each turn requires processing the full game state and history.
Who’s Affected
AI engineers and product teams evaluating models for agentic applications will find YC-Bench useful as a complement to traditional single-turn benchmarks. The benchmark’s emphasis on long-horizon decision-making under uncertainty is more relevant to autonomous agent deployments than isolated question answering or code generation tasks.
The cost analysis is particularly relevant for startups and smaller teams that cannot afford $86 per agentic run in production. GLM-5’s strong showing suggests that Zhipu AI’s model deserves serious consideration for cost-sensitive agent deployments where Claude Opus 4.6 would be the performance ideal but not the budget reality.
What’s Next
YC-Bench adds to a growing set of agentic benchmarks that test sustained reasoning rather than isolated tasks. As AI agents move from demo stage to production deployments, benchmarks that measure cost-adjusted performance over extended interactions will become increasingly important for model selection decisions. The 11x cost gap between the top two performers highlights that model pricing — not just raw capability — will be a decisive factor in which models actually get deployed at scale in agentic workflows.
