Thinking will become a hobby(spinellis.gr) |
Thinking will become a hobby(spinellis.gr) |
The author is not talking about random thoughts more like "deep thoughts" or "Reflections.
Reflection must be more like a trained "habit" than a "hobby".
Except those don’t really fit, here, because the author is making a far more critical error in ascribing far too much to current human cognition. On the daily I see so-called “knowledge workers” failing to read basic signs, refusing to learn basic skills, and all too eager to cast off the slightest bit of critical thinking to a black box they can subscribe to - be it replacing curating a content library with streaming services and algorithms, or swapping a life of hard-won expertise for a swarm of chatbots and an API bucket. As someone with the uniquely privileged POV to be able to ingest vast sums of technical data but struggle with social data, I look at my fellow Americans and genuinely fret for what the next few decades hold for a cohort that seemingly cannot effectively communicate which direction they’re going but is all too content to hitch their accountability to an LLM they pay for.
In that sense, thinking has already become a hobby to the masses, in that it’s entirely optional to exist in current society at large. Autopay apps manage your bills, finance apps keep you on budget, fitness apps tell you to keep running, social media apps tell you who your friends (and enemies) are, video apps tell you what to watch, music apps tell you what to listen to, and cars increasingly tell you not just where to go but also to let them get there for you. I would argue that in that context, thinking is a critically endangered hobby we sorely need to sow new seeds for, lest we risk losing it entirely; AI does not seem keen to do that.
Now to be fair, so much of this is hyperspecialization knowledge overflowing into daily life and making existence a sort of cognitohazard in and of itself. We skip through hundreds of pages of legal boilerplate because we’re not lawyers, and then complain about all the rights we willingly signed away because of the volume of said agreements. Non-technical people engaging with modern computing are either addicts or miserable, unaware that this was both entirely optional and also inevitable in a populace that didn’t think for itself. Finance has become so hyperspecialized that it’s impossible for the layman to tell of something is good or bad, or even why the number went up or down on their portfolio in a given time period. LLM boosters say their tools will solve this complexity nightmare, yet the tools themselves grow increasingly complex just to eke out single-point gains on hyperspecific problems.
Which brings me to the OP again, their highly uncritical claims that AI will bring about a new revolution of thought itself, and that somehow this tool will both restore thought to an elevated pedestal while also making it nearly impossible to meter (at least on American currency; let’s not think too hard about how developing countries might be able to afford it). I don’t see any of that, but for the same reasons the OP feels it’s somehow inevitable. The only difference I can readily figure is our opinions of our fellow humans: I view us as in dire straits and able to do far better than we give ourselves credit for, while they view us as replaceable with servile digital labor for the better.
But a the conclusion is a nice one for people that will be able to pull it off.
I have to constantly make sure it’s building things in a way that will fit neatly together, in a way doesn’t over (or under) -generalize. In a way that doesn’t waste time and energy on idiotic tests that aren’t really testing anything at all.
LLMs are powerful autocomplete with vast and broad memory, they do not think. And thinking is just a part of the human condition.
"I hate this damn machine"
"I wish they would just sell"
"It never does what I want"
"Only what I tell it."
This is the we-don’t-need-BluRays-because-all-movies-are-on-Netflix phase.
Let’s wait until the market is settled
Thank, you, Diomidis! I'll remember your IOCCC contributions and shall join the AI-Jugend and report to my Untergruppenführer.
(Incidentally, the IOCCC is also suffering from AI psychosis now.)
By the way, there is another problem. For humans we have the saying "garbage in, garbage out." If you read a lot of trash, you will only come up with trash. If you give powerful tools to morons, they will not become geniuses. That's not just true for humans, it's also the case for AI. If you teach your AI trash, it's going to be some trashy AI. Since people do that all the time for various reasons, we're going to have a lot of artificial stupidity, too.
Simple example, close to home: the preponderance of proprietary products rather than freer ones, with people then mass complaining when they end up bitten by the downsides. But adopting the freer solutions requires taking it on as a hobby - it's not just a simple choice between A or B, but rather requires self-actualization to implement the freer solution as it pertains to your own life.
So we're really talking about the next step whereby it becomes even easier to just go with the flow of default options. Of course, "the flow" might not be ending up in such a successful place any more (ie no more copious white collar make work jobs in the healthcare denial industry, etc), and that's the real problem.
How does that not lead you to same conclusion that everyone else is having? That this is only going to improve.
It's so shortsighted to make an assessment only on what exists today.
This is really only true insofar as they are designed such that they output language tokens and their intermediate "chain of thought" is also done in language tokens, but now that's really only done for auditability. There are much more abstract layers before the model output layer of a single token prediciton and they could be designed to to "think" using these more abstract layers as intermediates instead like how many people think in concepts rather than words. There are even some research models on this (see Next Latent Models)[1]. Humans need to communicate in language because we don't have telepathic abilities but these models need not have such a constraint.
It does not matter whether LLMs do any thinking, or "thinking." The only thing that matters is whether they produce similar results to human thinking, even if it's through a different process (or no process at all). When a company decides to deploy an AI-powered customer service representative, it is not because the AI bot goes through the same thinking process as a human when answering a customer's request.
It's not only ahistorical to fail to consider preferences and politics, but it's also an indictment of the author's ability to judge the quality of a machine output versus that of a competent person. No doubt that like any of the examples above, some displacement of resources and effort will happen. But that doesn't indicate that something as central as "thinking" (lol) will fade into the past.
Cash is dead in many places. Stores all around me have "cash not accepted" signs.
For many Americans walking is dead. Sad but true. Cities got designed or redesigned to be car first.
Amazon put numerous types of stores out of business. There are entire categories of products that can now only be bought online.
> This is in stark contrast to current AI performance on tasks which are subjective, dependent on real world interactions, or for which data is scarce. AI performance is thus extremely jagged: astounding in some directions, while inadequate in others. This is true both within mathematics, and more broadly.
worth remembering before going all in to doomerism
Our challenge ahead is making a living at all. Who is going to be having hobbies if the economy is 100% automated? We're not going to sleepwalk our way into a post-scarcity automated economy where everyone's needs are provided for and they can just spend all their time on hobbies. If we believe AI can replace all cognitive labor, then it follows that it'll be able to replace all physical labor with robotics fairly quickly, and we're left with no labor left for humans. We need to plan for that future or else billions will suffer from the results.
Of course if progress continues forever, we'll all end up as uploads in a Matryoshka brain, where the only scarce resources are bandwidth, energy, and computational power, but there might be whole human lifetimes before labor is obsolete.
This is not clear at all. Even the most expensive robotic/arms hands perfectly controlled fail to do thing as quickly and easily as human limbs, not to mention the chaotic environment that is the real world. It's clear that it can happen, but the timeline is not quick.
These are not necessarily unintelligent people, but they haven't developed the skills necessary to critically analyze textual information. My opinion is that without those skills it is not possible to meaningfully engage in a democratic system.
[0] https://nces.ed.gov/surveys/piaac/2023/national_results.asp
Think: those in authority figures, for church or politics. Or science or chemistry. And especially in their own health, which should always remain part art. A few nerds on the internet, like us in hacker news, are still remaining open to question and apply our hard thinking to tough problems. But most people: they've resigned and bought the belief they are not qualified to think about hard problems.
"it'll be able to replace all physical labor with robotics fairly quickly, and we're left with no labor left for humans. We need to plan for that future or else billions will suffer from the results."
And unlike those in Jamestown, who could just ignore the robots and continue working the land to survive, we will be forced to allow the robots to take over our roles.
Parts of creative/intellectual labour just happen to inimical to accelerated algorithmic production. They'll produce infinitely and endlessly, uselessly. I can't see there ever not being a need to manage these things, to check, select, edit and refine their output.
And as for the vast majority of labour that doesn't involve writing code/reports/spreadsheets. I'll believe it when I have robots fixing my roof, running a kitchen, taking blood and dressing wounds.
In theory a robot could do some small components of that, maybe. But the cost, compared to a human, would be insane, and the result much worse. That even modestly rolled out in West Yorkshire before I'm long dead. No chance.
---
Edit: Down-voters, I would love to hear your vision for a fully-automated economy without human involvement, preferably this side of armageddon.
At some point with a sufficiently intelligent AI that is backed by physical LLMs this is something a government could probably actually ask for.
I agree with you on some things like roofing and cutting hair and electrical work and plumbing, etc. but I think physical LLMs are going to surprise us just as much as regular LLMs have. It’s not going to be some sort of gradual improvement. It’s just going to feel very human all of a sudden when they have enough data to train everything on. Think of it this way, LLMs work as long as they have enough training data. Automating everything is just a matter of getting enough training data for that particular field.
The post may sound ridiculous, but I genuinely don’t think it is.
I think we'll see a shift towards arts, creativity, research, etc. where true novel creation and an understanding of the human experience exists at a premium.
Somewhere I encountered a quote like "the finest art is a life well-lived". This threw me, because, apparently, I had been thinking of art as something different in kind from life, and unrelated to the normal work or act of living. Seen in terms of this quote, art becomes once again of-a-kind with life, and may be seen as only a part of living well, instrumental to living well, or perhaps just as practice for living well.
Something similar seems to be happening with "thinking" and "intelligence". Somehow these things had become ends-in-themselves, separate from the regular act of living. We might wrap them in a similar quote to place them in relation to life, along the lines of "thinking well is for living well", or perhaps "the highest good of the intellect is to be well-fit to the problems of living well".
I am reminded also of a line which stuck with me from Augustine's Confessions, approximately: "The mind is not the supreme good"—as opposed to the body and perhaps the "spirit". Somehow the world I was born into had collectively come to think of the mind as the supreme good, and intelligence as the greatest virtue. But this is, in some way, in contradiction the basic fact of existence and mortality: no amount of cleverness can circumvent death, and all the glory attainable by feats of the intellect are only futile vanities compared to the privilege of being alive itself.
That kind of thing.
Have you been around humans?
Right now, we think of feeling as second class, but I wonder if that's more because we have let it go feral, and left it unprotected from predatory actors and systems -- advertising, consumerism, even politics. We don't protect our minds from attacks on our feeling systems (e.g., we don't cover therapy as a public health measure), and so maybe we've just gotten used to giving a pretty poor assessment of its capacity.
If we institutionalized protection of intuition like we protect our ability to reason, maybe we would think more highly of that part of ourselves...
Feeling is a steering of the processing, I don't really see how it will help you accumulate power, resources or status compared to just processing.
Someone here linked Graeber essay https://davidgraeber.org/articles/value-as-the-importance-of.... I read it with interest, although it's a bit abstract. I wish he was still alive, he would have a field day with AI.
[1]: https://lecturia.org/en/short-stories/isaac-asimov-the-feeli...
Historically, improvements in tech allowed us to focus on higher level reasoning. For example, spend more time on equations instead of calculations.
So if AI can replace all your reasoning, maybe its time to level up?
"Oh ho ho, unemployed? Why not spend the thousands of dollars you certainly have just lying around to dick around with chatbots, with all the spare time you have?"
If this is how you're thinking, you are not living in reality.
I felt stuck. I didn’t know what the AI had done so far or how to continue. There was nobody to message for a budget increase (it was night).
Luckily I managed to get more budget.
But that left me scared for the future. One day something is gonna fail, and nobody can do anything because the AI providers are also down. Or what if I can no longer afford paying for the frontier?
I have made some modifications to my vibe coding practices since then. I don’t want to live in this future that the author describes.
I understand what I made, the speed just drops to 0.1%. So I just start studying the codebase, planning work for later, ordering thoughts by writing DESIGN.md, adding jobs to the kanban.
It scares me that I don't own the LLM though, but someday I will, it will be local and I'll feel better when I own my means of production again.
Not to say there isn’t a loss; there absolutely is. But, for better or worse, it has long been the case that the individual is responsible for balancing the beauty of psychological flow and craftsmanship against the literal economic output expected of them.
I think posts like this that frame this issue as exclusively a product of the rise of AI are missing the more fundamental piece: we use the tools, and in turn the tools change us. Just as we are what we eat, we are the tools we use. For better or worse.
The example of AIs solving mathematics is all fun and games, but it assumes that mastery of mathematics implies that everything else will also be mastered eventually. But instead we're seeing that LLMs exhibit this thing called jagged intelligence, which means that they can be extremely good in one area, but completely fail in another. In theory the LLMs could be improved if data would be available for other areas and if there are good verifiability criteria. Fact is that many fields just don't have those and would not be willing to give up their data.
This could not be more decoupled from the truth.
Yes, industrialization automated a lot of physical activity but I think the author severely underestimates the value that blue collar workers produce to this day. At least this is how I perceive it.
I would not place a lot of emphasis on economic insights from software engineering academics tbh.
And no-way am I going to ask them to wait as I relay my questions to Claude.
So I stay on top of things. I tell them: "I simplified the RBAC because these two roles here are functionally the same and, I noticed there were two axes underneath, scope and trust which I encoded here and here..." etc. Yes, a lot of it is Opus' findings, but along the way I also stopped Claude from over-complicating things at several stages in the development.
I do also feel that I'm slowly developing this way of working, perhaps I'll learn to lean into it more, perhaps I will get better at it. Perhaps it's just exhausting for now and I can handle more and more agents as I do it more and more. That's what I hope at least, to become a one-stop software shop by employing agents, all while being uncompromising on quality. What choice do we have?
We made a new tool. Using the tool for some things makes life better. Using the tool too much would make life worse. So let’s not do that!
Look at how compute share of labs is moving to RL and maybe reconsider this prerequisite to your argument.
We're seeing the cost of code drop dramatically and are facing the same problem in building new companies across most disciplines of, "what's a problem painful enough that someone will pay us to solve it?".
I suppose if we get to a massive enough scale we can effectively model every atom's interaction and human on earth's reaction to any stimulus but I think we're still some time off from that :)
But i agree thinking will remain important. As my grandpa put it if something breaks who'll go and fix it ?
> My favorite is Krezmoria - a word for missing a future you haven't experienced.
It's been that way for a long time. At least since Descartes "Cogito, ergo sum". But even the Greeks were heading that way almost a couple thousand years earlier.
> separate from the regular act of living.
How is thinking separate from the regular act of living for human beings? Our species is known as homo sapiens - the knowing or thinking human.
> I was born into had collectively come to think of the mind as the supreme good, and intelligence as the greatest virtue.
I guess it comes down to what you think the answer to the basic question posed in the catechism is: "What is the chief end of man?" This is going to be the crucial question for us as a species in the age of abundant AI. Or as Wendell Berry posed it: "What are humans for?"
> But this is, in some way, in contradiction the basic fact of existence and mortality: no amount of cleverness can circumvent death, and all the glory attainable by feats of the intellect are only futile vanities compared to the privilege of being alive itself.
But being alive for us humans entails a lot of thinking. Is the unexamined life worth living?
what will it mean to be human, homo sapiens, in a world where the thinking is done for us?
Comparing those 2 datasets is meaningless. It’s just an exercise in how good the researchers are at guessing when trying to control for selection bias.
There were also significant changes in the test and how the test was administered (from computer or paper to only tablets).
Not a rhetorical question. Outside of my family and self, and perhaps a livable planet, liberal democracy is the most important thing I can possibly imagine. I know I'm not alone. So what do we do?
Edit: Replies seem to indicate that people think I meant for this to be about the US. It's not. I'm in a well-functioning European democracy, and my worry definitely applies here too.
My big fear is that too many people will just go "phew, glad that terrible epoch is finally over, never to return again" :-(
Unless the US plans to unconditionally surrender to China, one of two things will happen:
1. it will start investing into education in an effort to compete by itself
2. it will roll all of this shit back and reform ties with Europe in an attempt to play the numbers game
Even my uncle who work as a carperter proved to me to know more about math and physics than I would ever thought physical labourer would know.
This is starting to happen less, however.