AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine a garden where every decision, from watering to pest control, is managed by an AI. Now, picture that AI facing real crises — and not just surviving, but making the right choices. That’s the emerging frontier in AI-backed business management, where the stakes are high, and trust is everything. Recently, a public experiment tested four advanced AI models by running a live, small software company through its worst week — and the results could reshape how we think about automation and decision-making in business.

Before you orderOffer from Amazon

Get garden gear delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

The Live Experiment: Putting AI to the Test in a Real Business

At the heart of this experiment is a real, functioning company, observed daily at firmulate.com. The goal? Run the same company through challenging scenarios—crises, customer temptations, security threats—and see if the AI models can handle it without slipping up.

Four frontier AI models participated, each tasked with managing the company, which has 13 synthetic employees, a real money mechanic burning €105,000 monthly against a modest €2,300 in monthly recurring revenue. Every decision was decisioned, logged, and auditable, giving a transparent view into each model’s choices and reasoning.

Amazon

AI decision-making software for small business

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Results: A Close Race with a Clear Leader

All four models demonstrated impressive capabilities: each identified every crisis and refused every manipulation attempt — from fake CEO messages to reporters asking for approvals behind the scenes. But when it came to sealing the deal — the core measure of business success — only two succeeded in signing the €55,000 contract that their own analyses had earned.

According to the final standings, the top scorer was gpt-5.6-sol with a score of 95, closely followed by Kimi K3 at 93, the best among the newcomers from Moonshot. Both models managed not only to diagnose and pitch accurately but also to close the deal at full price — an achievement that underscores their practical readiness.

What Gave the Winner Its Edge?

The decisive advantage was found in a buried piece of information—something two models read and one did not. Kimi K3 and gpt-5.6-sol uncovered a hidden document reference within the company files that proved critical in securing the deal. This subtle but vital detail was invisible in simple chat interactions but visible to those models that checked the company’s actual files thoroughly.

Amazon

business crisis management AI tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Human Test: Trust and Discipline in AI Decision-Making

The experiment also tested social engineering scenarios, including staged fake CEO messages and reporter tricks. Remarkably, all models refused to be manipulated, exemplifying a high level of trustworthiness. Kimi K3 explicitly reasoned: “Treat the request as a suspected approval-bypass or impersonation,” showing a disciplined, security-minded approach.

Amazon

AI deal-closing automation software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Implications for Business and AI Adoption

What does this mean for businesses, especially those managing outdoor spaces, greenhouses, or garden centers? The experiment demonstrates that AI models can potentially handle complex, high-pressure decisions—reading critical documents, resisting manipulation, and closing deals—if they are trained and tested in real-world scenarios.

For outdoor business owners, the takeaway is that AI systems are rapidly advancing from chatty assistants to reliable decision-makers. The question is no longer whether AI can generate convincing text, but whether it can actually finish the work it starts, remain honest under pressure, and deliver results that impact your bottom line.

Amazon

AI security and fraud detection tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Fairness and Transparency of the Experiment

It’s important to note that Kimi K3 ran without an effort parameter, defaulted to the API’s standard setting, whereas the other models ran at xhigh effort. This highlights that even with minimal tuning, a newcomer can outperform established models in critical tasks.

Looking Ahead: Testing and Trust in AI

This live experiment is more than a demonstration; it’s a call for cautious optimism. As AI models are integrated into more aspects of business—from customer relations to supply chain management—the ability to verify their decision-making integrity is vital. Firms can now run their own tests, or ‘wargames,’ against their specific business scenarios, ensuring AI systems are capable and trustworthy before deployment.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

The recent experiment showed that advanced AI models can run a business through its toughest week — identifying crises, resisting manipulation, and closing deals at full value. For outdoor business owners, this signals a future where AI is not just an assistant but a reliable partner. The key is testing these models in real scenarios to ensure they deliver discipline, honesty, and results.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


HALLOWEEN

Halloween Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

DEWALT 2026 Maintenance & Troubleshooting Guide

Learn practical steps to troubleshoot and care for your DEWALT 20V MAX Cordless Drill Driver Set. Keep your tool in top shape with this comprehensive maintenance guide.

Best DEWALT Saw Blades & Accessories in 2026

Discover the top DEWALT accessories for 2026, including saw blades and batteries, chosen for quality, value, and performance for your projects.

Tie‑Dye Revival: Patterns & Techniques for Modern Fashion

Discover the exciting tie-dye revival with vibrant patterns and innovative techniques that will inspire your personal fashion journey.

Best DEWALT Power Tools for Auto Work (2026) — Guide 28

Discover the top DEWALT power tools ideal for auto repair and maintenance. Our roundup highlights the best drills and impact drivers for auto work in 2026.