GPT-4 doesn't understand rhyming but can solve rhyme-based puzzles(twofergoofer.com) |
GPT-4 doesn't understand rhyming but can solve rhyme-based puzzles(twofergoofer.com) |
Perhaps comprehension is not something special, but an illusion that emerges after some level of mass storing information, adjusting weights, and running the "circuit" in a feedback loop. While GPT-4 is much simpler (and not just in scale but also in mechanism, being a "mere" statistical model) than a human brain, it can still exhibit an emergent property analogous to comprehension.
At some level even a switch might be said to have a unit of comprehension, encoded in the open or closed state.