What exactly are they saying here or what is it supposed to mean? What would you use for "tool execution, code sandboxing, and multi-agent coordination" if not a CPU? The GPU?
Edit: Skimming more it's becoming painfully obvious this is AI slop and I fell for it yet again, guess it's just hallucinated Claude (IBM Granite?) drivel.
CPUs were already becoming much more important during training for test-time scaling, but there you were still bottlenecked by GPU compute since the gradient updates back to the policy model are the actual gating factor.
During normal inference though, CPUs are becoming more of a bottleneck for more advanced workloads. Even if you have 20 agents running in parallel, if they're all compiling Rust concurrently your total wall-clock time per task is no longer bound by the decode throughput of the upstream model. You're just waiting for tools to execute. This gets compounded by VM/container overhead as well if you're doing the totally local sandbox approach.