There are no lossless transformations of natural-language text(sophiebits.com) |
There are no lossless transformations of natural-language text(sophiebits.com) |
Every time natural-language passes from one human to another whether verbally or in the written word, there is a greater than zero percent chance that the meaning will be received/understood in a way that is "lossy" compared to the communicating party's intent. The so-called "telephone game" is a very good example of this.
It seems true that the lossy problem arises even without any LLMs or any intentional transformations.
Lossless in other domains basically means perfect-fidelity carried across copies. Natural language seems almost incapable of this ideal.
She SAID she did not take his money.
She said SHE did not take his money.
She said she DID not take his money.
She said she did NOT take his money.
She said she did not TAKE his money.
She said she did not take HIS money.
She said she did not take his MONEY.
8 very different messages all containing the same words in the same order. If the emphasis is changed or lost between sender and receiver, the message itself is lost regardless of the faithful reproduction of the actual words.
In the context in which I work, the quality of these docs is sufficient.
Unless your docs are being read by thousands of people, in 2026, in most contexts, handwriting docs adds less value than writing high quality instructions to your agent.
There are exceptions. For example, when kicking off a project, short crisp prose in a product brief aligns a team, removes uncertainty, and clarifies decisions. These are worth hand writing.
An AI agent, 600k tokens into a feature that it just authored, understands the feature as well or better than I do.
On this, we are in complete agreement.Are the instructions not docs?
Of course there are. The article simply defines "transformation" such that it excludes the lossless ones. :-)
bars!!