Do LLMs tempt us into specious reasoning and digital illusion?

“LLMs, since they are designed and trained using behaviourist principles that rely on reinforcement, have an almost invisible instrumental component to their communication. They are aiming at what they have been trained to produce, and they produce it very well: language compiled in a way that is satisfying to the user. The text is completely empty of any attempt to approximate reality, and it certainly is devoid of any motivation to communicate.

All use of text produced by LLMs will necessarily carry with it this instrumental limitation, because the very act of using LLMs recasts language from its uniquely human purpose of discovering the truth about things and instead subordinates it to the purposes underlying LLMs.”