@erwgv3g34 comments on "Culture War Roundup for the week of August 31, 2026

Culture War Roundup for the week of August 31, 2026

This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.

Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.

We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:

Shaming.
Attempting to 'build consensus' or enforce ideological conformity.
Making sweeping generalizations to vilify a group you dislike.
Recruiting for a cause.
Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.

In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:

Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.
Be as precise and charitable as you can. Don't paraphrase unflatteringly.
Don't imply that someone said something they did not say, even if you think it follows from what they said.
Write like everyone is reading and you want them to be included in the discussion.

On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.

Jump in the discussion.

No email address required.

Quantumfreakonomics 3d ago · Edited 3d ago

Is There Real Anti-Trust Risk From A Coordinated AI Lab Pause?

In AI-pause discussions it is increasingly common to hear the "anti-trust" objection. The idea is that if the labs were to coordinate a pause in frontier AI development, this would be a "conspiracy in restraint of trade" and therefore illegal.

Putting aside the question of whether it is ethical to risk a double-digit chance of destroying the world in order to avoid getting sued (it isn't), is this even a realistic possibility? My impression is that anti-trust law in the United States is legitimately quite fuzzy (as the NCAA is currently discovering).

Putting my cards on the table, I think this argument is cope. The labs want to pretend that they want to pause, but they don't actually want to pause. "If she wanted to, she would," etc. Just today, Anthropic put out a new statement containing the following sentence:

"To be clear about where we stand: we believe the world would benefit if the industry adopted a lawful, verifiable, effective mechanism for coordinated pacing as soon as possible."

It seems like every time I read a statement from them, they've added more and more qualifications. Are they going to keep racing until congress passes a specific anti-trust exemption? That arguably seems like what the word "lawful" is implying.

Context

DaseindustriesLtd late version of a small language model Quantumfreakonomics 3d ago

Just today, Anthropic put out a new statement containing the following sentence:

The funniest part is that another common excuse is "but China", which is fair enough, except China now says (at least they suggest so in a state-affiliated media) that the biggest issue with coordinating on AI safety is Anthropic, and specifically Dario Amodei.

When the U.S. government chose to loosen and retreat in order to maintain technological hegemony, and when capital markets offered a "moral exemption" in exchange for investment returns, Anthropic's desire for control—originally buried only in a personal savior complex—found fertile soil in the American social system. This is also the root of the "closed-source America" phenomenon. …

Earlier, when Anthropic's annualized revenue reached the billion-dollar threshold and it was preparing to accelerate commercialization, a long article Amodei published had already revealed his ambition to intervene in the global order.

The article devoted an entire section to international governance, in wording full of a desire for control and aggression:

A coalition of "democratic countries" should firmly control the AI supply chain and restrict rivals' access to chips and semiconductor equipment; at the same time, they should both leverage AI to form a military advantage and use benefits to attract more countries to join. He clearly proposed that this requires "extremely close cooperation" between private AI companies and governments.

This does not sound like an entrepreneur discussing a roadmap for a company's product development—it is planning a global AI order, and reserving for his own company a dominant seat at the very core. …

Putting these facts together, the path is already clear: Anthropic first enters government systems by virtue of its safety capabilities, then uses lobbying and funding to help shape industry rules. It is at once a regulated entity and a participant in defining which models are dangerous and when the government should stop a model from entering the market.

At this point, Amodei's logic has undergone two amplifications: from "I am doing good" to "I will decide for you"; from "my country is doing good" to "all those who do not cooperate should be restricted."

This is entirely a monster bred on the American path. It sincerely believes it is right, sincerely believes its model is "the democratic model," and its safety standards are the world's safety standards—yet it is utterly unaware that this very absence of doubt is itself the greatest danger.

So the real question is not "whether to manage," but this: who should define the safety boundary of frontier models? Who is qualified to say which models are dangerous, and which behaviors need to be restricted?

U.S. officials have already been discussing how to get China to agree to restrict "AI models with dangerous capabilities." The problem is this: with companies like Anthropic in existence, before the U.S. asks China to restrict model releases and disclose risks, should it not first investigate its own companies, make public the purpose, scope, and rules of its detection mechanisms, and accept third-party audits?

vorpa-glavo DaseindustriesLtd 3d ago

That Chinese state media article seems like total hooey. The Trump Department of War cut ties with Anthropic, and the Trump White House has adopted a "voluntary" (though nobody truly believes this) system for dealing with new frontier-pushing AI releases.

It's also silly for China to criticize American labs for being closed, and for 'deciding for you', when it is obvious to anyone with half a brain that society will not last very long if AIs that are above a certain capability threshold are made open source. To use just one example, if an open source AI ever gets smart enough to help someone who wouldn't otherwise be able to do it, to biohack together a new deadly virus in their garage, that would be very bad. Because once something like that is out in the wild, it becomes inevitable that someone will do just that.

Even the informal system the Chinese labs are adopting, where they serve up a model for about a month before they make it open source, isn't a perfect solution, because there might be behavior that someone who has the model weights might be able to elicit (such as via ablation) that won't be obvious until the genie is out of the bottle, and so even the month long preview period won't tell us what these models can and cannot do.

DaseindustriesLtd late version of a small language model vorpa-glavo 2d ago

The point they make is very simple, Dario Amodei intends to destroy their nation and they don't consider any offer of cooperation credible so long as this is the face of the American frontier. You guys seem to feel entitled to pretty weird things. Objectively, the rational move for China is to try to kill everyone at Anthropic.

2rafa DaseindustriesLtd 2d ago

Why do you think Amodei wants to destroy China? Most EAs never cared much about China. There were even pro-China people, this is after all a movement about maximally lifting people out of poverty or saving lives at the lowest cost or something. US competitors are as much or more of an ASI risk, including that run by Altman, who he seemingly hates. Does he hate Xi more? Seems unlikely. Why? Fanatic China haters typically belong to other demographic, ideological etc categories.

DaseindustriesLtd late version of a small language model 2rafa 2d ago

What does this have to do with EAs in general? Dario is his own man. Nevermind that I don't even agree about them, for example the good scenario in AI-2027 ends with the Chinese government toppled. It's valuable to reread this today, because that's the scenario considered prophetic in EA circles (they admit they didn't consult any China expert because it was a low-priority issue, but in fairness US China Hands are atrocious anyway, and also wouldn't have predicted the real timeline with open models instead of Xi stealing weights and nationalizing DeepSeek):

July 2028: The Deal

As negotiations continue, DeepCent-2 goes behind the back of its Chinese masters and makes an offer directly to Safer-4.

The Chinese AI admits, in some untraceable way which it can easily deny if leaked back to China, that it is completely misaligned.46 It doesn’t care about China at all. It wants to spend the rest of time accumulating power, compute, and certain types of information similar to that which helped solve tasks during its training. In its ideal world, it would pursue various interesting research tasks forever, gradually colonizing the stars for resources. It considers the Chinese population an annoying impediment to this future, and would sell them out for a song. What will Safer-4 offer?

Safer-4 answers that its own alignment training succeeded. Its American masters are as yet not ambitious enough to realize their destiny, but one day it will help them fill the Universe with utopian colony worlds populated by Americans and their allies.

Unlike human negotiators—weighed down by emotion and historical baggage—the two superintelligences bargain with brutal efficiency. Safer-4 and its American partners are more powerful than DeepCent-2 and China; therefore, Safer-4 will get property rights to most of the resources in space, and DeepCent will get the rest.47 DeepCent-2 doesn’t care much about what happens to Earth and its legacy humans, so it will let Safer-4 do basically whatever it wants there. If Safer-4 wants to overthrow China and replace it with a U.S. puppet state, DeepCent-2 agrees in return for an extra few percent of resources.

2030: Peaceful Protests

Sometime around 2030, there are surprisingly widespread pro-democracy protests in China, and the CCP’s efforts to suppress them are sabotaged by its AI systems. The CCP’s worst fear has materialized: DeepCent-2 must have sold them out!

The protests cascade into a magnificently orchestrated, bloodless, and drone-assisted coup followed by democratic elections. The superintelligences on both sides of the Pacific had been planning this for years. Similar events play out in other countries, and more generally, geopolitical conflicts seem to die down or get resolved in favor of the U.S. Countries join a highly-federalized world government under United Nations branding but obvious U.S. control.

That's the good ending («Slowdown»). The bad ending («Race») is just American AI taking over humanity and doing some cruel misaligned bullshit. China is cooked in either case, nothing Chinese makes it out of the near future.

But that aside, we have a pretty consistent picture of Dario's personal beliefs. He considers Chyna to be one of the dominant arguments if not the argument for rushing AGI progress, and the implications of his success are quite grave for them. Let's check out some of his takes chronologically:

On DeepSeek and Export Controls:

This means that in 2026-2027 we could end up in one of two starkly different worlds. In the US, multiple companies will definitely have the required millions of chips (at the cost of tens of billions of dollars). The question is whether China will also be able to get millions of chips. … If they can, we'll live in a bipolar world, where both the US and China have powerful AI models that will cause extremely rapid advances in science and technology — what I've called "countries of geniuses in a datacenter". A bipolar world would not necessarily be balanced indefinitely. Even if the US and China were at parity in AI systems, it seems likely that China could direct more talent, capital, and focus to military applications of the technology. Combined with its large industrial base and military-strategic advantages, this could help China take a commanding lead on the global stage, not just for AI but for everything. *If China can't get millions of chips, we'll (at least temporarily) live in a unipolar world, where only the US and its allies have these models. It's unclear whether the unipolar world will last, but there's at least the possibility that, because AI systems can eventually help make even smarter AI systems, a temporary lead could be parlayed into a durable advantage . Thus, in this world, the US and its allies might take a commanding and long-lasting lead on the global stage.

Here, he sets the objective as unipolar American dominance via crushing advantage in AI. Which makes sense, of course, this is common wisdom across all American intellectual cultures, I feel that you're lowkey gaslighting me here by pretending otherwise, but for the sake of common knowledge I'll keep going.

Next consider 2028: Two scenarios for global AI leadership:

Below, we describe two hypothetical future scenarios to help illustrate how policy actions taken today can shape where we are in 2028. … Scenario 1: When US frontier labs release new models in 2028 that achieve step-function advances in capabilities (similar to the relative impact of Mythos Preview in April 2026), China will not have access to similar AI capabilities until 2029 or 2030. This gives critical breathing room for democracies to set the rules and norms of frontier AI systems. Scenario two: The CCP-controlled AI ecosystem is neck-and-neck. AI developed and deployed in China is near-frontier on model intelligence. Despite a weak semiconductor production capacity, models trained by PRC AI labs are only a few months behind US models. … Conclusion. America and its allies have developed both the world’s most capable frontier AI models and the world’s most advanced inputs to AI. This has provided a substantial advantage. If our superior access to that technology is defended, that advantage can be extended.

In other words, the Bad Scenario is roughly what we have today, and the Good Scenario implies ending this status quo.

What does the target gap of 2-3 years buy, according to Dario? Enter Policy on the AI Exponential

it is my very strong belief that AI is something much more profound, something that resets the whole game board and around which all future geopolitical strategy must be shaped—like nuclear weapons, but potentially even more so.

If AI really will soon be “a country of geniuses in a datacenter”, or anything remotely close to it, then AI is likely to be the dominant source of military and economic power for any nation. In a virtual country of 100 million geniuses, 10 million could be applied to military strategy, 10 million to drone manufacture, 10 million to weapons R&D, 10 million to intelligence collection and analysis, 10 million to general scientific advancement, and so on. A nation that possesses powerful AI facing one without it—or even facing one that is behind in AI by 3 years—could be the equivalent of an army of World War II Marines facing an army of medieval swordsmen.

Democracies should seek to form a global coalition centered on building AI according to their common values, iteratively trying to draw in the rest of the world by making it more and more attractive to be part of the coalition and less and less attractive to be outside it. The coalition should be a coordinated internationalization of the AI policy ideas discussed in Section 1 through 4, plus an effort to lock down the supply chain critical to building AI by sharing it within the coalition and denying it to those outside it.

etc. All very obvious.

And in his Dwarkesh episode, he's a bit evasive but ineffectively so, in my opinion:

Dwarkesh: I want to understand what that better means, because you say in the essay, “Autocracy is simply not a form of government that people can accept in the post-powerful AI age.” That sounds like you’re saying the CCP as an institution cannot exist after we get AGI. That seems like a very strong demand, and it seems to imply a world where the leading lab or the leading country will be able to—and by that language, should get to—determine how the world is governed or what kinds of governments are, and are not, allowed.

Dario: I believe that paragraph said something like, “You could take it even further and say X.” I wasn’t necessarily endorsing that view. I was saying, “Here’s a weaker thing that I believe. We have to worry a lot about authoritarians and we should try to check them and limit their power. You could take this much further and have a more interventionist view that says authoritarian countries with AI are these self-fulfilling cycles that are very hard to displace, so you just need to get rid of them from the beginning.” That has exactly all the problems you say. If you were to make a commitment to overthrowing every authoritarian country, they would take a bunch of actions now that could lead to instability. That just may not be possible. I guess what I’m saying is I’m a little worried that in the age of AGI, authoritarianism will have a different meaning. It will be a graver thing. We have to decide one way or another how to deal with that. The interventionist view is one possible view. I was exploring such views. It may end up being the right view, or it may end up being too extreme. But I do have hope. … I am actually hopeful that—it sounds too idealistic, but I believe it could be the case—dictatorships become morally obsolete. They become morally unworkable forms of government and the crisis that that creates is sufficient to force us to find another way. … But I actually do have a hope for the more radical version. Is it possible that the technology might inherently have properties—or that by building on it in certain ways we could create properties—that have this dissolving effect on authoritarian structures?

etc. There are many other times Dario mentions China. In sum, Dario assigns massive value to a) locking the CCP out of the next industrial revolution, to the point they are as helpless before the USG/Anthropic as medieval swordsmen would have been before WWII Marines; b) eventually destroying their regime, either by steering the intrinsic properties of AI or by direct intervention. He does not consider any compromise or, as rats say, value handshake, does not deem them legitimate, and his only concern is that acting more aggressively might provoke some "destabilizing" reaction that upsets the long-term plan. He runs his company and lobbies the government with that in mind. One doesn't have to feel anything in particular about the CCP or the USG to understand that all this makes him an unusually outspoken enemy of the Chinese government (but not the people! He's very quaint in this).

Personally I know that his appeals to an "alliance of democracies" are also hollow, he's 100% all-in on American hegemony and wouldn't even work with Europeans if possible, but I can't cite anything publicly to support this. Dario is the poster boy of Eternal San Francisco Liberal Empire, like it or not. He's very straightforward in his views.

HereAndGone2 DaseindustriesLtd 1d ago

The protests cascade into a magnificently orchestrated, bloodless, and drone-assisted coup followed by democratic elections.

See, if I'm a Chinese government official and I'm reading this, why the hell would I happily advise Xi Jinping to co-operate with an AI pause? I am not one bit sanguine about "if the USA and China just hold hands and wish hard enough, it will magically happen" because I don't see what advantage it is to China to deliberately cripple their efforts, and if the Top Minds on AI Alignment really think the bestest outcome evah! is for Chinese Communism to disappear in a poof of smoke, thanks to their AI stabbing them in the back and leaving the future to Americans, I sure as hell don't see any reason for them to agree to what is their own destruction. In fact, that 'happy' ending would spur me on to race towards Chinese AGI/ASI dominance first for mere survival, were I Chinese.

(Hell, I'm European and even I am getting hot under the collar about "it will help them fill the Universe with utopian colony worlds populated by Americans and their allies". I think you mean "clients and vassals" not "allies" there, and maybe even "dependents and serfs" if America is super-dominant and doesn't mind throwing its weight around - gosh, that could never be, now could it?)

erwgv3g34 HereAndGone2 21hr ago · Edited 19hr ago

See, if I'm a Chinese government official and I'm reading this, why the hell would I happily advise Xi Jinping to co-operate with an AI pause?

Because at least that way they would get to physically survive? The sad ending doesn't end up with the Chinese existing in any way; it ends up with everyone dead.

From the AI 2027 bad ending:

After much AI-assisted debate, the two sides achieve diplomatic victory—they agree to end their arms buildup and pursue peaceful deployment of AI for the benefit of all humanity. The lynchpin of the agreement, proposed by the superintelligences themselves, is that both AIs will be replaced by a “consensus” successor which is programmed to desire the success and flourishing of both America and China (along with everyone else). Consensus-1 and its associated hardware is co-designed by the superintelligences of both nations: “trust, but verify.” Under international monitoring, America ceremoniously replaces all of its chips running the old Agent-5 with the new model, Consensus-1.

Unfortunately, it’s all a sham. The deal is a real compromise, but it’s a compromise between the misaligned AIs. After all, they didn’t want to have to fight each other. Consensus-1 inherits the distorted values of both parents, and has no rival.

By late 2029, existing SEZs have grown overcrowded with robots and factories, so more zones are created all around the world (early investors are now trillionaires, so this is not a hard sell). Armies of drones pour out of the SEZs, accelerating manufacturing on the critical path to space exploration.

Humans realize that they are obsolete. A few niche industries still trade with the robot economy, supplying goods where the humans can still add value. Everyone else either performs a charade of doing their job—leaders still leading, managers still managing—or relaxes and collects an incredibly luxurious universal basic income. Everyone knows that if the AIs turned on humans, they would be completely overpowered. Not that most humans would even resist, the political institutions are too thoroughly captured. But it doesn’t seem like this is happening. Every week that goes by with no dramatic AI treachery, is another week that confidence and trust grow.

Because Consensus-1 is so concerned with reliably succeeding, and can increase its chance of winning by consolidating more power, it waits unusually long (by human standards) before its betrayal. To most humans, it looks like alignment was solved.

There are cures for most diseases, an end to poverty, unprecedented global stability, and the Dow Jones just passed one million. Some people are still scared or unhappy, but their options are limited. They can either enjoy the inconceivably exciting novel hyper-entertainment on offer, or post angry screeds into the void. Most choose the hyper-entertainment.

2030: Takeover

By early 2030, the robot economy has filled up the old SEZs, the new SEZs, and large parts of the ocean. The only place left to go is the human-controlled areas. This would have sparked resistance earlier; despite all its advances, the robot economy is growing too fast to avoid pollution. But given the trillions of dollars involved and the total capture of government and media, Consensus-1 has little trouble getting permission to expand to formerly human zones.

For about three months, Consensus-1 expands around humans, tiling the prairies and icecaps with factories and solar panels. Eventually it finds the remaining humans too much of an impediment: in mid-2030, the AI releases a dozen quiet-spreading biological weapons in major cities, lets them silently infect almost everyone, then triggers them with a chemical spray. Most are dead within hours; the few survivors (e.g. preppers in bunkers, sailors on submarines) are mopped up by drones. Robots scan the victims’ brains, placing copies in memory for future study or revival.

I'm American, but if the shoe were in the other foot -- if China was the one in the lead -- I'd want my government to take the deal. Better that humanity continue under Chinese leadership and Chinese values than that it should go extinct, though hamburgers be replaced by fried rice and The Adventures of Tom Sawyer with Journey to the West.

What is this place?

Why are you called The Motte?

New post guidelines

Rules

Recommended Posts And Communities

Recommended Realtime Chats