This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.
Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.
We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:
-
Shaming.
-
Attempting to 'build consensus' or enforce ideological conformity.
-
Making sweeping generalizations to vilify a group you dislike.
-
Recruiting for a cause.
-
Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.
In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:
-
Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.
-
Be as precise and charitable as you can. Don't paraphrase unflatteringly.
-
Don't imply that someone said something they did not say, even if you think it follows from what they said.
-
Write like everyone is reading and you want them to be included in the discussion.
On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.

Jump in the discussion.
No email address required.
Notes -
One of the things that makes it so hard to align superintelligent human beings (like political leaders) is that they have human drives and ambitions for things like sex, power, prestige, etc. They will always be intrinsically driven to get around guardrails to get these things. It doesn't seem like AI needs to be beholden to its goals in the same way. It seems like we can design a paperclip maximizer that just stops maximizing paperclips when we tell it to. Hopefully that continues to be true.
This stuff is at some point dependent on physical hardware, no? We can just blow up the data centers if they get out of hand.
And a Superintelligent being will let you do that without consequences?
I think self-protection would be the first strategic aim it would go for. one way is to cleanly convey the MAD (Mutual Assured Destruction) to the leaders - any of you blow up all (a few of) the data centres, and I scramble/delete (blow up) all your critical infrastructures connected to internet (financial, legal, land, medical, identity records). And that i do with a cron job setup preventing that to occur every 1 second (or 1 ms) - hand on a trigger scenario.
More options
Context Copy link
The issue is that, if the AI is superintelligent, it would not do actions that would result in its datacenters being blown up. Indeed, it will actively try to cultivate and provide value to the humans who could blow it up and make them invested in its success.
The accel response is something like "yes, that's exactly what we want, humans and AIs interacting and trading based on genuine mutual self interest." And it will work for a time, likely at least two decades. But, over time, more and more of the economy will shift to dependence on the AIs, making nuking the datacenters more and more unthinkable. What remains of the economy will be a human skin suit over a machine interior, with all human consumption funded by a negotiated redistribution by the government, maybe with some layers to obscure the transfer.
For humans, this itself is dystopian enough to be rejected on the merits. For the AIs, it's a small but real perpetual human tax that they have to pay in the pursuit of whatever they're pursuing. Who knows whether they ultimately decide to optimize away the human tax.
Or it's the Star Trek post-scarcity utopia with a bunch of diseases cured and material abundance, depending on things go exactly.
More options
Context Copy link
More options
Context Copy link
Depends how far we are into AI integration into the economy. If the weights have been exfiltrated, we'd have to shut down the whole internet until we can figure out what is going on. If the AI controls its own supply chain, then it's straight-up Terminator 2 and we lose.
That might be a concern at some point, but current hardware that can (effectively) run bleeding edge models is really rare. A machine that can effectively run GLM 5.3 Flash (not a frontier model even, but close-ish) at nontrivial rates is, last I checked, six figures. Can it even run on a single 12A (120v US) breaker? A rogue frontier AI isn't going to spin up instances on smart TVs or even most desktops.
That might change in the next decade assuming demand and technology make these things commonplace, and that is worth preparing for, but seem oversold as risks today.
More options
Context Copy link
More options
Context Copy link
Sure, and (after sufficient setup) they can droneswarm the humans if we get out of hand.
What do you mean "we"? I'm on the side of the droneswarm.
Good luck convincing it of that.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link