My objection(s) to the "LLMs are just next-token predictors" take(alejandrotlaie.net) |
My objection(s) to the "LLMs are just next-token predictors" take(alejandrotlaie.net) |
This reveals at best a paucity of imagination. There is no reason to imagine that all complex systems irrespective of fundamental structure and spanning vastly different degrees of complexity are "emerging" anything like the same behaviors.
The explainability of LLM's and so-called "deep learning" will be liberated when it disentangles itself from vague and forced anthropomorphism but the marketing allure is alas to strong.