📊 Full opportunity report: The Model Is Only 10%: The Real Lesson of the New SDLC on ThorstenMeyerAI.com — validation score, market gap, and execution plan.
Get tech for your team delivered free — and shop member deals
- Fast, free delivery on millions of items
- Access to Prime Big Deal Days deals on October 6–7
- Prime Video, Amazon Music and more included
TL;DR
A recent whitepaper from Google highlights that in AI development, the model itself accounts for only 10% of system behavior. The focus shifts to harnessing, verification, and context engineering, affecting how organizations should invest in AI tools.
A new whitepaper from Google, authored by Addy Osmani, Shubham Saboo, and Sokratis Kartakis, states that the AI model constitutes only about 10% of the factors influencing system behavior. This challenges common assumptions that model improvements alone drive AI performance and underscores the importance of harness design, verification, and context engineering. The insight has broad implications for how organizations allocate resources and develop AI strategies.
The whitepaper, titled The New SDLC With Vibe Coding, emphasizes that the dominant part of AI system performance depends on the harness: prompts, rules, tools, and observability layers surrounding the model. Experiments cited show that tweaking the harness can dramatically improve performance even with the same underlying model, such as moving a coding agent from outside the Top 30 to Top 5 on a benchmark by changing only the harness components.
Furthermore, the paper introduces the concept of agentic engineering, where AI is integrated into formal specifications, automated testing, and continuous integration processes. This approach contrasts with vibe coding, which relies on minimal structure and verification, often leading to higher operational costs over time. The authors argue that cost efficiency and system robustness depend heavily on designing and owning the harness and context, not just selecting the latest model.
The model is only 10%
A Google whitepaper argues software’s biggest shift is from writing code to expressing intent. Its sharpest claim: the model you obsess over is the smallest part of the system — the scaffolding around it does the real work.
The clearest map yet of how serious AI development works — and mostly tool-agnostic. But it’s a Google funnel: the concepts are neutral, the on-ramps point to Gemini, Jules & the ADK. If the harness is 90% and it’s yours, your moat and your costs both live there — so own your scaffolding, route across models, and remember: AI amplifies whatever engineering culture it lands in.
Implications for AI Development and Investment
This shift in understanding impacts how organizations should invest in AI: focusing on harness design, verification, and context management offers more durable advantages than chasing the latest model. It also raises questions about current AI strategies that prioritize model improvements over system architecture. Companies that adapt to this insight could reduce costs, improve reliability, and better control AI behavior in production environments.
As an affiliate, we earn on qualifying purchases.
Background of the AI System Shift
Until now, many in the industry believed that advances in AI models—such as larger neural networks and more training data—were the primary drivers of system performance. However, recent developments, including the widespread adoption of AI coding agents, have shown that the surrounding infrastructure—prompts, rules, tools, and observability—play a far more significant role. The whitepaper builds on this trend, providing experimental evidence that configuration and harness design are more impactful than model size or complexity.
This perspective aligns with earlier industry observations that most AI failures originate from configuration errors or missing tools, not model deficiencies. The paper formalizes this understanding and offers a framework for organizations to rethink their AI development priorities.
“The behavior you experience is dominated by scaffolding you can build, own, and improve—your harness, not the model itself.”
— Addy Osmani
As an affiliate, we earn on qualifying purchases.
Unresolved Questions About Model vs. Harness Impact
While the whitepaper provides strong experimental evidence that harnesses are more influential than models, it remains unclear how universally applicable these findings are across different AI domains and tasks. The precise methods for optimizing harness design at scale, and how these strategies translate to less structured or more complex systems, are still being explored. Additionally, the long-term impact of this shift on AI innovation and model development remains to be seen.
AI observability and monitoring tools
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Future Directions for AI System Design
Organizations are expected to reevaluate their AI development priorities, investing more in harness engineering, verification, and context management. Future research will likely focus on formalizing best practices for harness design, developing tools for scalable context engineering, and establishing standards for system robustness. Industry leaders may also experiment with integrating these principles into their AI workflows to reduce costs and improve reliability.
As an affiliate, we earn on qualifying purchases.
Key Questions
Why does the model only account for 10% of system behavior?
The whitepaper’s experiments show that the surrounding infrastructure—prompts, rules, tools, and observability—has a much larger influence on AI performance than the model itself, often accounting for about 90% of the behavior.
How should companies change their AI strategies based on this insight?
Companies should focus more on designing and owning their harnesses—configuration, verification, and context—rather than solely chasing more advanced models. Investing in system architecture can lead to better performance and lower costs.
What are the risks of focusing too much on harness and configuration?
Over-reliance on configuration without proper verification and testing could lead to system vulnerabilities or unpredictable behaviors. Balancing harness design with rigorous verification is essential for safe, reliable AI deployment.
Will this shift affect the pace of AI innovation?
It may slow the focus on model development but encourages more sustainable, cost-effective innovation through better system engineering and configuration practices.
Source: ThorstenMeyerAI.com
Halloween Picks
halloween
As an affiliate, we earn on qualifying purchases.
