This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.
Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.
We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:
-
Shaming.
-
Attempting to 'build consensus' or enforce ideological conformity.
-
Making sweeping generalizations to vilify a group you dislike.
-
Recruiting for a cause.
-
Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.
In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:
-
Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.
-
Be as precise and charitable as you can. Don't paraphrase unflatteringly.
-
Don't imply that someone said something they did not say, even if you think it follows from what they said.
-
Write like everyone is reading and you want them to be included in the discussion.
On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.

Jump in the discussion.
No email address required.
Notes -
No posts about the AI plagiarism in mathematics?
Well, here you go
Tristan Buckmaster published a letter about some stuff in math, blah blah who cares.
The important thing is that he's essentially accusing OpenAI of spying on him and stealing his work in order to publish first. When questioned about this, OpenAI started backtracking and trying to get Buckmaster's coauthor, an Anthropic employee, removed as an author. Then, they threatened him
I'm reminded of the fun song, Lobachevsky.
He is, of course, NOT accusing OpenAI of this. I am accusing Tristan of accusing OpenAI, Tristan is much more circumspect. But c'mon, if it stinks like shit maybe check your shoe. This looks like OpenAI stepped in something.
Sebastien Bubeck, responding for OpenAI, and himself, in non-specific terms.
More here with more background on the timeline and people involved.
The more important underlying issue is: frontier models are outcompeting aspiring academics in theoretical math, making open problems trivial, making them feel obsolete.
I think there's a workaround that lets academics (including Buckmaster et al) keep their pride and purpose.
Terrace Tao wrote a few days ago: AI largely autonomously solving open problems is bad, because the solution itself isn't very important, but the techniques (advances, insights, etc.) developed to find the solution and failed attempts are. These techniques assist future problems including ones with practical applications. Meanwhile LLM solutions are barely readable so we don't get any techniques from them, only the open problem solution.
So even if a model solves an open problem, it still makes sense for academics to do themselves, or at least break the model's solution into something comprehensible by humans, and receive credit for that. Buckmaster et al were already doing that:
So why don't they just finish their readable proof, publish, and get credit for that? Look, even if OpenAI hesitated to publish their allegedly stolen result, they still wouldn't be first, because another independent group has now also reached the solution. It's unfortunate that sometimes mathematicians reach the same discovery independently in parallel, but these ones still have a chance to be famous in a small group, just not in a (slightly larger?) small group.
Well the technique in this case seems to be 'smash the problem with $10 million worth of compute.'
From Tao:
How would it be more efficient? We can read the trend on the chart. OpenAI's agent swarm apparently needed a human to put them on the right direction today, that seems possible. I don't understand bounded v unbounded or what exactly is going on here, the subtleties of different proofs. I don't trust OpenAI.
Say they gleaned a few insights off the other mathematician. What about in 6 months or 1 year? Unleash the swarm on both the practical problems and the theoretical problems, smash them all one after the last. More algorithmic improvement (the practical money-making kernels and AI algorithms, data techniques), more compute as Rubin starts being deployed, more money to spend as the ROI rises... An 'enormous amount of computational resources' will shift up 10x or 100x in absolute scale.
What does he think ASI is, what does he think OpenAI is trying to do?
Human mathematicians, even Terence Tao, need not worry about diminishing progress in mathematics in the medium term by AI eating the seed corn. Tao's actual insight and understanding will have no more value than Kasparov's in chess.
It hinges on whether the techniques humans learn to solve open problems can be applied to areas that LLMs can’t. If LLMs can apply their own techniques, or solve more open problems with more time and scaling that continues to be feasible, human-readable proofs won’t matter beyond niche curiosity. But even then, curiosity and learning for its own sake are intrinsically important to some people. Moreover, I think these techniques sometimes lead to insights (that, for example, lead to new inventions) which today’s LLMs lack the creativity to apply themselves.
Fair enough but I think that window is closing. 'LLMs can't' is just going to shrink and shrink. It's already perilously small! If they can do Millennium problems, what can't they do in maths? They can't answer the other Millennium problems just yet? Judging by past trends, that's about six months to a year away!
OK, they can't deliver real gamechangers like quantum gravity or room temperature superconductors. But what are the chances that humans understanding whatever insane techniques the AIs used would help us get to quantum gravity before the AIs do that?
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link