But it doesn't matter because frontier models were extremely good 8 months ago and we were doing real work with them. Now we have more capable open-source agents like pi and OpenCode which work well with these models.

More importantly, offline models is the best choice for privacy, on-device inference and no token/cost anxiety.

Do we have stats on how does the models do on Mac M-series chips?