This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.
Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.
We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:
-
Shaming.
-
Attempting to 'build consensus' or enforce ideological conformity.
-
Making sweeping generalizations to vilify a group you dislike.
-
Recruiting for a cause.
-
Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.
In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:
-
Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.
-
Be as precise and charitable as you can. Don't paraphrase unflatteringly.
-
Don't imply that someone said something they did not say, even if you think it follows from what they said.
-
Write like everyone is reading and you want them to be included in the discussion.
On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.

Jump in the discussion.
No email address required.
Notes -
Anthropic released a long blog post on various examples of people caught misusing their AI. A few thoughts:
One major sort of concern that people have about AI is misuse by rogue actors. It's interesting here that they managed to catch a large variety of people doing that. While we only see who they caught, and not who they didn't catch, the ability to do detection at this scale does make me wonder whether in the long run, AI will more have the effect of democratizing the ability to do harm (as I was previously leaning more towards), or whether the ability of sophisticated actors to detect and smother that will be more important.
This gives a bit more of a feel to me of what it is like to run a surveillance state. I'm sure we will have an increase in AI-powered surveillance in the future.
At the same time, surveillance was one of the categories of things that they were listing here, seeing as Anthropic is not permitted to be used for surveillance. I am curious how the ecosystem of surveillance contractors will develop.
Finding all of this was only happened because people want to use Anthropic, because their AI is capable. When there are viable alternatives who are more permissive, people engaging in prohibited activity try to shift to use those when possible, at least, in cases where they cannot do what they want with Claude. This is pertinent for discussions about open source vs. proprietary models, as well as differences in precautions between different companies.
In the 1990s, a lot of smart people were 100% convinced that there would be a rogue nuclear dirty bomb attack in the next decade. The reasoning was something like:
Huge amounts of enriched nuclear material and even many entire nuclear warheads including those on easily-relocated mobile launchers have just gone missing since the fall of the USSR. Nobody knows where many of them are, they vanished, state authority in a lot of remote [former] parts of the Soviet empire is limited or entirely absent.
Terrorists, primarily although not exclusively Islamist, are often quite well funded. Meanwhile, a lot of people who are in practice in charge of these nuclear stocks at the end of the Cold War are poor, unpaid (often for months/years due to the state and economic collapse) and don’t really care who they sell them to.
Making a dirty bomb and transferring it to a city center is relatively easy once you have the material. Certainly it would not be beyond known terrorist skill sets for many Islamist orgs, Al Qaeda, the IRA, Basque separatists and various others who were capable of delivering powerful bombs to urban centers.
Interestingly it hasn’t happened yet, although you never know. There is some discussion about why (it’s actually something we’ve discussed here before), but the consensus is usually some handwaving around the US / CIA making a big effort to find and decommission Soviet silos and other nuclear sites in the aftermath of the Cold War. This is true, but it’s very unlikely they got all of them (and indeed I don’t think the consensus is that they did).
It would be fairly easy to steal some old medical or industrial radioisotopes for a dirty bomb; it's certainly happened accidentally plenty of times.
If you wanted to make an actual nuke, there was a window post USSR where a motivated group could have theoretically filched some poorly guarded fissile material from their nuclear cities.
https://archive.ph/pH1j9
More options
Context Copy link
My understanding is the material in a warhead isn't that dangerous and it's mostly the fission products that cause fallout.
More likely materials would probably be the isotopes used for radiotherapy or irradiaton like cobalt 60 and cesium 137
The core physical idea is:
59Co + neutron flux + energy = vaporized 60Co
Cobalt 59 and energy are dirt cheap compared to neutron flux. Cobalt 60 can be manufactured beforehand by placing 59Co in a nuclear reactor for a few months, or it can be generated on-site by surrounding a nuclear warhead with cobalt 59.
More options
Context Copy link
More options
Context Copy link
The other argument for "why dirty bombs have never been made/deployed" is because they're useless, and a pain. The assembly (and shielding during it) is tricky, and while terrorists may not care about receiving a large radiation dose prior to detonation, they'll probably care that "it is well-documented by all our official agencies that the radioactivity in dirty bombs is unlikely to seriously hurt anyone."
More options
Context Copy link
What is your take on the (conspiracy) theory that Aum Shinrikyo tested a nuke in the Australian outback?
Thanks for this pointer; I hadn't heard of it. To anyone interested: https://www.colorado.edu/today/1997/05/27/mystery-event-australian-outback-nuclear-blast-earthquake-or-meteorite
Before I reached the end I had already guessed meteorite. Surely several orders of magnitude a more convincing explanation than a nuclear weapon.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
I feel like because of what AI is it does make it easier to detect since people interface directly with a company while typing what they want.
The risk is that bad actors just deploy increasingly competent local LLMs where the prompts aren’t sent to HQ for threat detection.
You call it a risk, I call it a blessing. Anyway with a lot of stuff - the hard is part is surviving making the dangerous thing. The reason bioweapons never picked up is not because USA and USSR didn't want them to work.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
I think this will read like an admission of guilt/wrongdoing to the US govt. Being radically honest and open doesn't read so well to politicians and decisionmakers.
I remember thinking that some of the new Kimis sounded very Claudey. Earlier Kimis sounded genuinely distinctive but then they Clauded up.
Yeah, AGI let alone ASI is gonna cut through any human organization like a knife through butter. People cannot be trusted, they are lazy and make mistakes. They plug their laptops into some agent that does god knows what (it's more convenient and we 'just trust' the machine).
Alternately maybe they're lying since Kimi is the biggest Chinese threat to Anthropic and they want to pull the eye of Sauron (Party security-state) down on them as a suppression tactic? And admitting how their models were used for all this bad stuff is a galaxy-brained ploy to get more regulation, guard the lie with a bodyguard of truth? Who can say.
More options
Context Copy link
Now this is what begging for regulatory capture looks like. Two things stick out in that regard.
The heavy emphasis on US geopolitical adversaries.
The contrast between Anthropic-provided AI services (good) and AI services provided by other companies (bad).
Incredible, borderline unforgivable, that they didn't turn the Iranian accounts over to U.S. intelligence so they could be run as assets. AI future led by neurodivergents is genuinely concerning.
Such accounts not making it to american intelligence would be opposite of concerning. Why stop there, anyway, why not turn over valuable info from companies using the service? Why not literally everything people type in (or let be read), you are bound to find something useful in there.
More options
Context Copy link
It’s hard not to read the report in light of the “supply-chain risk” nonsense that Anthropic got into earlier this year. It’s pretty clever for them to be like, “I guess we’ll just have to pour all of this valuable intelligence onto the ground…”
Pretty much. And the stunt earlier this week with the former activist who became an OpenAI employee and then “quit” and somehow got 100 million views on X was interesting as well. I am really concerned about what will happen when the IPO gives these people hundreds of billions of dollars. They are obviously extremely political and partisan.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link