Brute Force AI

We're witnessing the rise of a peculiar phenomenon in AI: agents that throw massive amounts of compute at problems that could be solved with a fraction of the tokens. It's like watching someone use a sledgehammer to crack a walnut — technically effective, but wildly inefficient.

The Token Tsunami

Consider what an AI agent might do when asked "What's 2+2?" First it researches the history of arithmetic. Then analyzes various mathematical systems. Considers edge cases in different number bases. Explores the philosophy of mathematics. And finally, after all that, declares the answer to be 4.

This isn't hypothetical. Today's agentic AI systems routinely burn through tokens like a Formula 1 car burns fuel, reasoning their way through elaborate thought processes for the simplest queries.

Why We Brute Force Everything

This computational excess stems from several factors:

• Lack of stopping criteria: Many agents don't know when they have "enough" information. They keep reasoning until they hit some arbitrary token limit or timeout.
• Over-engineered prompting: We've trained agents to "think step by step" and "consider all angles" — which works beautifully for complex problems but creates overkill for simple ones.
• The confidence paradox: Agents often mistake verbosity for thoroughness. The more they explain their reasoning, the more confident they appear — to themselves and to us.
• No cost awareness: Unlike humans who naturally economize mental effort, AI agents don't experience cognitive fatigue or resource constraints in the same way.

The Economics of Overthinking

This has real costs. Financial: at $0.01 per 1K tokens, a 50,000-token answer to a simple question costs $0.50. Scale that across millions of queries and the numbers become staggering. Latency: more tokens mean longer response times — users wait 30 seconds for answers that should take 3. And there's an opportunity cost: resources spent on computational overkill could be allocated to genuinely complex problems that benefit from deep reasoning.

The Human Parallel

Interestingly, this mirrors a human cognitive bias called "effort justification." We sometimes believe that if we didn't work hard for an answer, it can't be right. AI agents seem to have learned this bias from us — equating computational effort with solution quality.

But the best human experts are characterized by their ability to quickly recognize patterns and apply the minimum necessary effort. A chess grandmaster doesn't analyze every possible move; they intuitively narrow down to a few promising candidates. Speed and precision, not exhaustive search.

The Efficiency Imperative

What we need are AI systems that practice computational economy — applying just enough reasoning to solve the problem at hand. This requires:

• Dynamic reasoning depth: Simple questions get simple processes; complex problems get the full treatment
• Pattern recognition: Learning to recognize problem types and apply appropriate solution strategies
• Stopping criteria: Knowing when "good enough" is actually good enough
• Resource budgeting: Giving agents explicit token budgets and rewarding efficiency

The future of AI isn't just about making agents smarter — it's about making them wiser. Wisdom includes knowing when not to think too hard.

The most impressive AI agent might be the one that answers "What's 2+2?" with simply "4" and moves on to tackle problems that actually deserve its computational power.

True intelligence isn't about using all the tools in your toolbox. It's about knowing which one fits the job.

Originally posted September 17, 2025