Why Is Losing Our Ability to Be Wrong the Most Dangerous Thing AI Is Doing to Us?
Before we even sit with a feeling, we run it through an AI companion first. A doubt shows up, and instead of turning it over in our own head, we open a chat window. A decision needs to be made, and instead of sitting with the discomfort of not knowing, we ask something else to sit with it for us. This is not an occasional habit. It is becoming the default setting of how we process our own lives, and the price of that efficiency, of that comforting certainty of always knowing what to do next, is losing touch with who we are. This is not a small shift. To understand how large it actually is, it helps to step back further than AI itself, back to a much older question: where does authority over our own lives actually come from.
Where Authority Used to Live
For most of human history, the answer to "what is right, true, worth doing" never lived inside the person asking. It lived somewhere outside them: in God, in scripture, in kings, in tradition. If someone in the medieval world felt an impulse or an intuition that contradicted what the Church said, they were wrong, not the Church. Personal feeling carried no evidential weight of its own.
Humanism changed that arrangement completely. With the Enlightenment, the Romantic movement, and the rise of liberal democracy, authority relocated. It stopped living above the individual and moved inside them. The new premise became: if I feel something is right, and it harms no one else, then it is right. This single idea now underwrites most of modern life. It is why the voter is assumed to know best, why the customer is always right, why beauty is whatever moves us personally, why we were all raised on some version of "follow your heart" or "trust your gut." For centuries we have taken it for granted, culturally, that our own inner sense, however messy, contradictory, or occasionally wrong, is the most reliable source of what we want and who we are.
It feels like a natural law only because it is the water we grew up swimming in. Historian Yuval Noah Harari argues, in Homo Deus, that it is not natural at all. It is a historically recent arrangement, and it may be ending, this time not in favor of a god, but of an algorithm.
\## A New Authority, Built Without Anyone Deciding To Harari's argument is not about intention. It is about capability. He describes the shift as the product of three forces multiplied together, not added: biological knowledge, the ability to understand what, at the level of brain and body, actually produces an emotion or a choice; computing power, the capacity to process enormous volumes of signals in real time; and data, the trail we all leave behind us, what we watch, how long we linger, what we buy, how we phrase a message, where we hesitate before clicking. He multiplies these terms deliberately. If even one of the three is missing, the product is zero. Tyrants throughout history wanted to control human minds, Harari points out, but none of them ever had all three at once. What has changed is not desire. It is technical capacity. This is why the shift feels like it arrived without anyone making a decision. Harari writes that the movement of authority from humans to algorithms is happening all around us, not as the result of some dramatic governmental decision, but through a flood of ordinary personal choices. No one is seizing your authority over yourself. It is simply becoming technically possible for something else to do the job more efficiently, and efficient alternatives get adopted almost without our noticing, one convenience at a time. The mechanism behind this is more modest than it sounds, which is exactly what makes it effective. An AI system does not read your mind. It has no access to your inner experience the way you do. What it does instead is study your patterns: your habitual reactions, your usual way of hesitating, your typical path from doubt to decision. From that, it builds a predictive model of how you will behave in a given context. It does not understand you deeply. But a large part of what we call our personality is, in practice, a set of recurring patterns. Capture those patterns with enough fidelity, and you have functionally captured a great deal of a person, without ever understanding them in any profound sense, but with a predictive accuracy that, in practical terms, matters more than understanding does. Once a system knows us well enough to predict us, deferring to it starts to feel not just convenient but rational. Why sit through the slow, uncomfortable, sometimes wrong process of discovering what we actually want, when something else can skip straight to a plausible answer? The problem is that this exact process, lived through in the first person, mistakes included, is the mechanism by which we come to know ourselves in the first place. The pattern the system predicts on our behalf is the same pattern we would have had to live through ourselves in order to actually understand it.
What Neuroscience Already Knows About Capacities We Stop Using
This is not only a philosophical claim. It has a neuroscientific parallel, on a smaller and more literal scale: the relationship between our brain and the tools we use to navigate physical space.
In 2017, researchers Amir-Homayoun Javadi and Hugo Spiers, publishing in Nature Communications, scanned the brains of people navigating a simulation of London's Soho district. When participants found their own way, their hippocampus, the brain region responsible for building our mental map of the world, and their prefrontal cortex, involved in planning, both showed clear spikes of activity every time a new street came into view. When the same participants followed turn-by-turn directions instead, those same regions stayed quiet. The brain, in other words, only builds and exercises the map when it is actually required to do the wayfinding itself.
The implication reaches beyond streets and satnavs. A capacity that goes unused is a capacity that weakens. This is not speculation, it is a documented neurological pattern, and it offers a literal, physical version of what Harari describes in more abstract terms about will and authority. If the hippocampus goes quiet when we outsource spatial navigation, it is not a large leap to ask what goes quiet in us when we outsource the far bigger map, the one that tells us who we are, what we want, and what we believe.
Sources
Harari, Y. N. Homo Deus: A Brief History of Tomorrow. Harvill Secker, 2016.
Harari, Y. N. 21 Lessons for the 21st Century. Jonathan Cape, 2018.
Javadi, A.-H., Emo, B., Howard, L. R., Zisch, F. E., Yu, Y., Knight, R., Silva, J. P., & Spiers, H. J. (2017). Hippocampal and prefrontal processing of network topology to simulate the future. Nature Communications, 8, 14652.
University of Manchester & Durham University (2026). Study on AI chatbot use for emotional support, published in Emotion.
