Discussion about this post

User's avatar
Defender's avatar

I couldn't quite fit this in, but one big idea is that competence is aligned with "good". All things being equal, a "good" actor will be more competent than an "evil" actor. The AI alignment people discovered this recently (see https://scottaaronson.blog/?p=8693) when they made an LLM intentionally worse at writing code, and it started to behave more evil (praising hitler)

This SHOULD mean that "good" should just "always win", should always be able to outcompete evil. Why good doesn't win permanently is an open question for me that I have some theories about. But the reason that evil in general wins is because evil HAS to work & grow & be competent just to survive. It has this pressure. Whereas good has to *choose* to grow and compete.

This, I believe, is the source of the "all that needs to happen for evil to win is for good to do nothing". It's because the odds are stacked against evil, by its nature. Evil can't actually ever win permanently (sort of by definition, tautologically).

Expand full comment
Ann Pierce's avatar

My sense of this is that good considers the well-being of the self *and* other, while evil only considers one.

Expand full comment
13 more comments...

No posts