https://github.com/daitangio/take-ai-control/tree/demo/nello...
branch demo/nello-openspec
> 14 agents: 11 domain experts, 2 reviewers, and an adaptive composer
wow, that's a lot of domain experts, I'm convinced
Staying well behind the frontier, just in case.
I've tried to benchmark them the most common public skills including those for ADLC (ie SuperPowers) couple of times here https://orcabot.com/benchmarks/agent-skills. Annoyingly I haven't been able to release one in a while because its been next to impossible to stop the new frontier models from cheating one way or another.
I check every benchmark site weekly, compare harnesses and models, and its still pretty much just vibes
Evals showed that speed and token use improved when it was removed.....
The models have improved and internalized some of these principles.
They still have value, IMO, because they help improve consistency (at the expense of speed and cost).
My assessment has been just use the native harness.
Sure, we could go to nine domain expert agents next, like the competition. That seems like the logical thing to do. After all, eight worked out pretty well, and nine is the next number after eight. So let’s play it safe. Let’s make a thicker sandbox, add some IOPS and call it the Bedrock9SuperTurbo. Why innovate when we can follow? Oh, I know why: Because we’re a business, that’s why!
You think it’s crazy? It is crazy. But I don’t give a shit. From now on, we’re the ones who have the edge in the multi-agent game. Is Devin the best a man can get? Fuck, no. Bedrock AI-DLC is the best a man can get.
Here’s the report from Engineering. Someone put it in the bathroom: I want to wipe my ass with it. They don’t tell me what to invent—I tell them. And I’m telling them to stick two more agents in there. I don’t care how. Make the agents so token efficient they’re invisible. Put some on an Alexa. I don’t care if they have to cram the fourteenth agent in perpendicular to the other ones, just do it!