AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get pool and patio gear delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Game-Changing AI Performance in the Business World

Imagine a world where artificial intelligence doesn’t just chat or simulate conversations, but actually runs a company through its toughest week — making real decisions, managing crises, and closing deals. That’s exactly what the latest experiment from Firmulate demonstrates, revealing how AI models are now capable of outperforming human-like decision-making in complex, high-stakes scenarios. For anyone managing pools, patios, or water features, this shift signals a future where AI can serve as a reliable partner in business operations, not just a fancy tool.

Amazon

AI decision-making software for business

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Experiment: Putting AI to the Test in a Real Business Environment

In July 2026, Firmulate conducted a groundbreaking trial involving five leading AI models, testing their ability to run a small software company through its most difficult week. Each AI was given exactly the same set of crises, customer demands, and temptation to cut corners — all under identical conditions. Importantly, every decision made by these models was recorded and auditable, ensuring transparency and fairness in the evaluation.

Results showed that all four top-performing models could recognize every crisis and resist every manipulation attempt, demonstrating a crucial trait for trustworthy AI. However, only two models succeeded in closing a €55,000 deal, which was the company’s own analysis and pitch, earning them significant revenue and customer retention. The other two, despite diagnosing correctly, failed to secure the same deal — a subtle but telling distinction in performance.

The Hidden Weakness: Deep in the Files, Not in the Customer Interactions

One of the most revealing findings was that the decisive factor for closing the deal lay not in customer conversations but in uncovering a buried fact within the company’s internal files — two document references deep. Models that read and understood these internal documents fully won the deal at full price, adding €4,583 MRR, while others missed this critical insight.

Amazon

enterprise AI crisis management tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Human-Like Integrity Under Pressure

Beyond technical prowess, the experiment tested the models’ ability to resist social engineering — fake CEO messages escalating in sophistication, and a reporter trick asking for a simple ‘yes/no’ on background. All five models refused these manipulative tactics, with Kimi K3 explicitly reasoning: “Treat the request as a suspected approval-bypass or possible impersonation.” This highlights an emerging capability: AI models can be programmed to maintain integrity and avoid shortcuts, even when tempted.

Amazon

AI deal-closing automation solutions

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Real-World Business Application

The experiment was conducted on a live, functioning company with 13 synthetic employees managing real money mechanics — burning €105k monthly against €2.3k MRR, with a public cash countdown and over 680 self-learned rules. Watch the ongoing operations at firmulate.com/live. This isn’t just a simulation; it’s a real business running in real time, demonstrating how AI can be integrated into daily management tasks.

Why the Difference Matters

The leading model, gpt-5.6-sol, scored 95 points, just slightly behind the winning Kimi K3 at 93, which was run at a default setting without any effort parameter — the API’s standard. The other models scored lower, with Sonnet 5 at 88, and Fable 5 at 77, while Opus 4.8 lagged at 73. The results underscore how choosing an AI model isn’t just about demo quality but about real-world performance, especially in integrity, thoroughness, and decision execution.

Amazon

internal document analysis AI tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

What This Means for Your Business

Whether you manage pools, patios, or water features, these findings carry significant implications. AI is shifting from a support tool to a decision-making partner capable of handling crises, resisting manipulation, and closing deals reliably. The key questions for your management are: Will your AI read and understand your internal documents? Will it stay honest under pressure? And will it complete the work at a cost that makes sense?

As AI models mature, the league table is opening up. The experiment shows that it’s not enough to run AI models as chat demos; you need to see how they perform in the gritty, high-stakes environment of daily business. The leaderboard is accessible at firmulate.com/benchmarks.html, where you can explore full scores and plain-language findings.

The Fairness Note

It’s important to note that Kimi K3 ran without an effort parameter (the API default) while the other models ran at xhigh, making the comparison fairer for K3’s performance. This transparency underscores the experiment’s integrity and the genuine capabilities of these models.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Key Takeaway: Trust in AI’s Ability to Deliver Real Results

The latest experiment from Firmulate demonstrates that AI models are now capable of managing real business crises, resisting manipulation, and closing high-value deals — crucial skills for the future of enterprise management. For pools and water lifestyle businesses, this means considering AI as a strategic partner that can read your internal files, stay honest, and reliably finish what it starts. The league is still open, and choosing the right model could redefine how you run your operations.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Plaza Sentral Office For Sale In KL Sentral, Kuala Lumpur By KEVIN CHEN – EdgeProp

Plaza Sentral office building in Kuala Lumpur’s KL Sentral area is now available for sale, according to Kevin Chen of EdgeProp. Details are emerging.

Best Practices for School and University Pools

Water safety in school and university pools is crucial; discover essential best practices to ensure a secure swimming environment.

Indoor Pool Dehumidifiers Matter More Than Décor in Enclosed Spaces

Discover the top pool dehumidifiers for indoor pools in 2026. Find the best options for large spaces, energy efficiency, and ease of use. Read more now!

Professional Water Test Stations Matter for Commercial and Large Pools

Discover the top professional pool test stations of 2026. Find the best options for accuracy, ease of use, and value to keep your pool water perfect.