This is part two of an ongoing series. If you’re starting here, Why Privacy Matters is part one.

The surveillance apparatus is invisible because it was engineered to feel like you.

Not like a cage. Not like a camera. Like a mirror. Like a friend who remembers everything. Like a feed that somehow always knows what you need, right now, at this exact moment, in this exact mood.

That’s not coincidence. That’s engineering.

the filler times#

I want to tell you something I’m not particularly proud of.

I have a work phone. It has to stay that way, stock Android, certain apps locked in, certain compromises made for professional reasons. I have a personal phone running GrapheneOS, hardened, de-Googled, the way I actually want a device to be. But the work phone is a different contract. And for a while, two to three months, it had YouTube on it.

It started reasonably. Waiting rooms. The queue at the supermarket. Filler times. The gaps between things that weren’t worth filling with anything meaningful, so why not something useful? Improvements. How-tos. Humour that was actually funny. A few conspiracy theories that turned out to be true, the kind of content that flatters your sense of being ahead of the curve.

I told myself: at least I’m not like the others, mindlessly scrolling TikTok or Reels. I decide what to watch. I curate my own feed.

Here’s the lie embedded in that thought. I decide.

The system had already decided. It had been deciding since the first session, refining a model of me built from what I paused on, what I rewatched, how long I stayed before scrolling past, what time of day I watched and in what pattern. It wasn’t showing me what I wanted. It was showing me what a version of me, already profiled, already predicted, would find credible and rewarding.

The quality content wasn’t an accident. It was the hook. The system knew I wouldn’t stay for junk. So it built a mirror that showed me exactly who I wanted to be. Discerning. Curious. Someone who uses their filler time well.

And then, this is the part that still interests me, I started rewarding myself with it. Two back-to-back meetings finished. My brain, I told myself, deserves a moment of pure relaxation. Not a thought required. Just observe, absorb, be entertained.

That thought didn’t come from me. It was trained into me. The system had become the voice in my head deciding what I deserved.

I understand surveillance architecture at the firmware level. I know what SIGINT looks like at scale. I’ve thought about these systems professionally for years. It still took two to three months before I caught it.

I eventually had to use ADB. Android Debug Bridge, a command-line tool that lets you reach the layer of the operating system the interface deliberately hides. There was no delete button. The system didn’t provide one. To remove it, I had to go underneath the system it gave me. To a layer it didn’t control.

That detail matters. Hold it.

the hardware that got hijacked#

To understand why this works on anyone, including people who know better, you have to start not with the technology but with the biology.

You are running ancient hardware in a modern environment. Two hundred thousand years of evolution optimised your brain for a specific set of problems: predators, alliances, status, food, reproduction, social belonging. The neural machinery built to solve those problems is still running. It doesn’t know it’s 2026.

Gossip, the tracking of who did what to whom in your social group, is not a character flaw. It’s a survival mechanism. Social threat detection. Your ancestors who didn’t care about reputation and alliance were outcompeted by those who did. You care because caring kept your lineage alive.

Outrage is tribal cohesion. The feeling that your group is under attack, that something must be done, that those people are the problem. That’s not irrationality. That’s your immune system applied to the social body. Perfectly calibrated for small band dynamics.

Validation, the need to be seen, acknowledged, approved of, is a status signal evolved in groups where your standing determined your access to resources and mates. The like button didn’t invent that need. It just industrialised it.

Novelty-seeking kept you alive in an environment where new things could be threats or opportunities and you needed to know which. The scroll is a slot machine designed specifically for that reflex.

The surveillance economy didn’t create these instincts. It mapped them, at scale, with precision, over billions of users, and built infrastructure engineered to trigger them. Not to satisfy them. Satisfaction stops the scroll. To activate them, just enough, just reliably enough, that you come back.

This is not a metaphor. This is the business model. Engagement is the metric. Engagement is produced by emotional activation. Emotional activation is produced by triggering the exact instincts listed above. The algorithm is not intelligent. It is a very precise map of human vulnerability, refined by an incomprehensible volume of behavioural data, optimised for one outcome: keep you inside the system long enough to be monetised.

the mirror#

Here is the mechanism in one sentence: the system doesn’t show you what you want. It shows you who you think you are, and then it becomes that.

When it showed me high-quality content, it wasn’t being generous. It was matching my self-image. It had inferred, correctly, that I would not respond to junk, that I valued a certain kind of intelligence, that I had a particular relationship to being right and ahead of the curve. It built a mirror that reflected the version of me I most wanted to see.

This is why it works on people who are sceptical of it. The junk-feed is obviously manipulative. The quality-feed is invisible. It doesn’t feel like you’re being managed. It feels like the algorithm finally understands you.

And then something more disturbing happens. Slowly, the mirror starts to precede the person. The system begins to show you content designed to shape the preferences it has predicted. Not just reflect what you already want, but subtly direct what you will want. Outrage that matches your tribe. Fears that match your existing anxieties. Beliefs that are close enough to yours that you’ll engage, but a little more extreme, a little more confident, a little more us-versus-them.

By the time I noticed what had happened, the system had become part of how I thought about my own downtime. It had installed a voice, you deserve this, you’ve earned this, just a few more minutes, that I experienced as mine.

The technical term for what happened is identity capture. You stop being a person who uses the tool. You become the person the tool made.

what orwell got wrong. what huxley understood.#

Orwell imagined the boot. The telescreen. The forced confession. The violence of a state that must break you because you might resist.

He wasn’t wrong about the surveillance. He was wrong about the mechanism. The telescreens in 1984 are imposed. You resent them. You know they’re there. The oppression is visible, which means the resistance can be too.

And to be clear: that model still exists. Coercion through force, not always physical, remains the primary instrument of control in many places. The journalist imprisoned. The activist disappeared. The dissident whose family receives a visit. The degree depends entirely on where you live and what you say. Orwell’s world is not historical. For millions of people, it is Tuesday.

But in the liberal democracies, something subtler was built. Something Huxley saw more clearly.

In Brave New World, there is no boot. There is soma, a drug that makes you feel exactly what the system needs you to feel. Comfortable. Belonging. Mildly euphoric. The citizens of the World State don’t resist because they have no reason to. They’re not unhappy. The cage is constructed from their own pleasure.

Neither of them imagined what we actually built.

We built something that combines both and transcends them. Not forced surveillance. Not chemical sedation. Something that wires directly into your evolutionary hardware, reflects your identity back at you until you can’t see the seams, and makes you an active participant in your own profiling. Because it feels like self-expression.

The soma is the scroll. The telescreen is the camera in your pocket that you paid for, carry everywhere, and feel anxious without.

And the part neither Orwell nor Huxley predicted: you surveille yourself, voluntarily, and you call it self-improvement.

the ungovernable layer#

I had to use ADB.

That’s not just a technical detail. It’s a map.

The system didn’t provide a way out through the interface it gave me. The interface was designed for engagement, not exit. The delete button didn’t exist because deletion is not in the system’s interest. To leave, I had to find a layer the system didn’t control, a technical capability most users don’t know exists and couldn’t use if they did.

Two things got me out. Self-awareness, the ability to recognise, eventually, that the voice saying just a few more minutes wasn’t mine. And technical capability, the ability to act on that recognition in a way the system couldn’t prevent.

Most people have neither. Some have one. Very few have both.

That’s not a judgment. The system was specifically designed to make self-awareness difficult. The mirror is designed to look like a window. And the exit is engineered to feel expensive. Friction is built the same way convenience is. The alternative is made to feel like deprivation.

This is what the surveillance apparatus does at its most sophisticated: it doesn’t imprison you. It makes freedom feel uncomfortable. It makes disconnection feel like loss.

There is a layer underneath. There always is. The question is whether you can reach it.

Part I: Why Privacy Matters Part III: The Exit coming