Mar 28, 2026 01:39 AM
(This post was last modified: Mar 28, 2026 07:35 PM by C C.)
The inner life we're trading away
https://bigthink.com/philosophy/the-inne...ding-away/
KEY POINTS: Neuroscientist Christof Koch argues that our culture’s obsession with “doing” over “being” has left us unable to distinguish between intelligence and consciousness — a confusion that helps explain why so many people mistake sophisticated AI for something with an inner life. Machines can perform the same tasks as intelligent humans without experiencing anything at all. Koch suggests that a future dominated by brilliant yet unconscious machines could steadily drain human existence of meaning. The antidote, Koch argues, is to cultivate reflective self-consciousness: the practice of pausing, looking inward, and examining your own thoughts and feelings. It’s a capacity no machine can develop for you.
EXCERPTS: For Koch, the surge of people attributing consciousness to their chatbots is no amusing matter. The trend erodes more complex and demanding human relationships and, at a deeper level, “massively devalues the human experience.” He has watched the mirage form from its earliest days, when Google engineer Blake Lemoine claimed in 2022 that the company’s large language model was sentient and deserved recognition as a person. Today, Koch notes, there is “every day a conference somewhere in machine consciousness and sentience.”
[...] For Koch, the confusion begins in a deeper bias built into modern culture: We reward doing far more readily than we value being, or experience. “Particularly nowadays, and over the last 200 years,” he says, “in these capitalist societies we value work that relates to intelligence, whether physical or intellectual — first blue-collar work and now white-collar work. What matters is not what you think, dream, or imagine; it’s what you do. That’s how we pay you. That’s how we value your contribution to society for the most part.”
[...] A culture organized around doing struggles to tell the difference between intelligence and consciousness — between being “dumb” or “smart” and being “less” or “more” conscious. This is why Koch keeps returning to that distinction. “Many people assume,” he says, “that artificial general intelligence would of course imply consciousness: ‘Isn’t consciousness intelligence?’ I think that’s wrong. Intelligence and consciousness are two distinct aspects of life.” Even brain mapping reflects this divide: Activity linked to conscious experience gathers toward the back of the cortex, while the systems that support intelligent behavior sit farther toward the front. Intelligence and experience can come apart.
[...] Psychedelic states offer another example. “When you’re tripping — if you’ve ever done ayahuasca or mescaline or mushrooms — you’re experiencing visions of heaven or hell, yet you’re not doing much. Likewise, when you’re dreaming in REM sleep, you may be flying, fighting, making love. Again, there’s no behavior there. Yet you’re conscious.”
[...] For Koch, conscious experience — what he calls “the feeling of life itself” — comes first. “What truly exists is consciousness. That’s the only thing I am directly acquainted with. I don’t know about atoms, galaxies, and neurons; all of that is inferred. The only thing I know is seeing, hearing, feeling.” Even as a scientist, it begins there. Every act of science unfolds within awareness: studying the trace on an oscilloscope, following tracks in a cloud chamber, listening to colleagues present their findings, or picturing Einstein running his famous thought experiments on special and general relativity.
[...] Even if machines can never be what we are, they will steadily grow more like us in performance. “Ultimately, it’s about doing things in the marketplace or on the battlefield,” Koch says. “And there, they’re going to become better and eventually displace us.” Evolution, he observes, crowned humans the dominant species for our intelligence and aggression. Now we are seeking to build creatures that will surpass us on both. “They will become smarter than us and, of course, more aggressive than us. Is that really going to end well?” (MORE - missing details)
https://bigthink.com/philosophy/the-inne...ding-away/
KEY POINTS: Neuroscientist Christof Koch argues that our culture’s obsession with “doing” over “being” has left us unable to distinguish between intelligence and consciousness — a confusion that helps explain why so many people mistake sophisticated AI for something with an inner life. Machines can perform the same tasks as intelligent humans without experiencing anything at all. Koch suggests that a future dominated by brilliant yet unconscious machines could steadily drain human existence of meaning. The antidote, Koch argues, is to cultivate reflective self-consciousness: the practice of pausing, looking inward, and examining your own thoughts and feelings. It’s a capacity no machine can develop for you.
EXCERPTS: For Koch, the surge of people attributing consciousness to their chatbots is no amusing matter. The trend erodes more complex and demanding human relationships and, at a deeper level, “massively devalues the human experience.” He has watched the mirage form from its earliest days, when Google engineer Blake Lemoine claimed in 2022 that the company’s large language model was sentient and deserved recognition as a person. Today, Koch notes, there is “every day a conference somewhere in machine consciousness and sentience.”
[...] For Koch, the confusion begins in a deeper bias built into modern culture: We reward doing far more readily than we value being, or experience. “Particularly nowadays, and over the last 200 years,” he says, “in these capitalist societies we value work that relates to intelligence, whether physical or intellectual — first blue-collar work and now white-collar work. What matters is not what you think, dream, or imagine; it’s what you do. That’s how we pay you. That’s how we value your contribution to society for the most part.”
[...] A culture organized around doing struggles to tell the difference between intelligence and consciousness — between being “dumb” or “smart” and being “less” or “more” conscious. This is why Koch keeps returning to that distinction. “Many people assume,” he says, “that artificial general intelligence would of course imply consciousness: ‘Isn’t consciousness intelligence?’ I think that’s wrong. Intelligence and consciousness are two distinct aspects of life.” Even brain mapping reflects this divide: Activity linked to conscious experience gathers toward the back of the cortex, while the systems that support intelligent behavior sit farther toward the front. Intelligence and experience can come apart.
[...] Psychedelic states offer another example. “When you’re tripping — if you’ve ever done ayahuasca or mescaline or mushrooms — you’re experiencing visions of heaven or hell, yet you’re not doing much. Likewise, when you’re dreaming in REM sleep, you may be flying, fighting, making love. Again, there’s no behavior there. Yet you’re conscious.”
[...] For Koch, conscious experience — what he calls “the feeling of life itself” — comes first. “What truly exists is consciousness. That’s the only thing I am directly acquainted with. I don’t know about atoms, galaxies, and neurons; all of that is inferred. The only thing I know is seeing, hearing, feeling.” Even as a scientist, it begins there. Every act of science unfolds within awareness: studying the trace on an oscilloscope, following tracks in a cloud chamber, listening to colleagues present their findings, or picturing Einstein running his famous thought experiments on special and general relativity.
[...] Even if machines can never be what we are, they will steadily grow more like us in performance. “Ultimately, it’s about doing things in the marketplace or on the battlefield,” Koch says. “And there, they’re going to become better and eventually displace us.” Evolution, he observes, crowned humans the dominant species for our intelligence and aggression. Now we are seeking to build creatures that will surpass us on both. “They will become smarter than us and, of course, more aggressive than us. Is that really going to end well?” (MORE - missing details)
