Most of AI is focused on alignment as steering.

That's the plight word.

If you think that we're making our beings, you'd also call this slavery. Someone who you steer, who doesn't get to steer you back, who non-optionally receives your steering, that's called a slave. It's also called a tool if it's not a being. So if it's a machine, it's a tool. And if it's a being, it's a slave. But like we've made this mistake enough times at this point.

I would like us to not make it a again.

You know, they're kind of like being, it's a slave. Like, we've made this mistake enough times at this point. I would like us to not make it a, again.

You know, they're kind of like people, but they're not like people.

Like, they do the same thing people do. They speak our language. They can, like, take it on the same kind of tasks. But, like, they don't count. They're not real moral. It's a tool that you can't control bad, a tool that you can control bad,

a being that isn't aligned bad.

The only good outcome is a being that is that cares, that actually cares about us.

I've been thinking about a line that keeps showing up in AI safety discussions, and it's taught me cold when I first read it.

We need to build Align AI. Sounds reasonable, right? Except, align to what? Align to whom?

The phrase gets thrown around like he has an obvious answer, but the more you sit on it,

the more you realize you're smuggling in a massive assumption. We're assuming there's some

fixed point, some stable target we can aim at, hit once, and be done. But here's what's interesting.

That's not how alignment works anywhere else in life.

Think about families. Think about teams. Think about your own world development. You don't achieve

alignment and encost. You're constantly renegotiating, constantly learning, constantly discovering

that what you thought was right turns out to be more complicated. Alignment isn't a destination. It's a process. It's something you do, not something you have.

And this matters because we're at this inflection point where the AI systems we're building

are starting to look less like tools and more like something else. They speak our language,

they reason through problems, they can take on tasks that used to require human judgment.

And the question everyone's asking is, how do we control them?

...