This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.
Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.
We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:
-
Shaming.
-
Attempting to 'build consensus' or enforce ideological conformity.
-
Making sweeping generalizations to vilify a group you dislike.
-
Recruiting for a cause.
-
Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.
In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:
-
Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.
-
Be as precise and charitable as you can. Don't paraphrase unflatteringly.
-
Don't imply that someone said something they did not say, even if you think it follows from what they said.
-
Write like everyone is reading and you want them to be included in the discussion.
On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.

Jump in the discussion.
No email address required.
Notes -
The singularity is coming in 2027 and no one cares.
Dwarkesh is out with a new essay in which he argues that there is a high chance (not 100%, but like 75%) that we get an intelligence explosion in the next 12 months equal in magnitude to the jump between GPT-3.5 and GPT-6.
This jump would be caused by the automation of AI research.
I highly, highly recommend giving this a read or a listen. Dwarkesh is, in my mind, the most thoughtful public intellectual around today (sorry Scott) and is known for his in depth research and thoughtful interviews. In his essay, it's likely that he addresses whatever objections that you have that just sprung to mind, so just give it a read. Really.
At this point, it seems the only thing that would stop superintelligence from forming is an unknown unknown, as in there is some fundamental constraint or that hasn't been identified, or an emergent phenomenon that only reveals itself in the future. I guess this has all been rehashed a million times, and I don't have a lot to add beyond what Dwarkesh said, so I'll revert to the purpose of this board which is to make some social commentary.
People are completely unprepared for what's coming.
In financial forums that I visit, and in youtube videos I watch, people are entirely dismissive of what is happening at OpenAI and Anthropic. "It doesn't really think! They're losing money! Drug development, no way! It only works for software! The software is buggy! They'll be bankrupt in a year! Switching costs are zero! Cheap Chinese models will win!".
Etc.. Etc... Etc...
Some concepts are just too high IQ for most people. Probably most people with an IQ below 100 don't really understand supply and demand for example. And the floor for understanding recursive self improvement is a lot higher.
Everything feels pretty normal now. But there's at some point going to be a big oh shit moment when social consensus hits and 90% of the population goes from denialism to doomerism in a short period. I have a hard time predicting what will happen then except that I'd assign a 50% chance that Anthropic will be the most valuable company on Earth in 12 months. Cold comfort. Superintelligence is coming and it's going to change everything. Maybe it will be good...
I was an AI doubter for a long time. After using it for work for the past three months, no longer so much. It's a better biologist than me (it just can't do benchwork). Add on a few more layers of recursive self-improvement, and it'll be a better biologist than my PI. We don't even need super intelligence for this thing to completely flip the entire job market on its head.
Why would I ever hire a tax accountant or financial planner when AI can do these things far better for far less money? The entire white-collar finance wing of the economy, which most of my "successful" peers seem to be a part of is going to fall apart in the next few years, even without super intelligence. Same goes for software, administration, and many other cushy PMC positions. The world is going to change rapidly, even without super intelligence.
Because if the AI fucks up your taxes, Sam Altman and Dario Amoedi aren't going to assume responsibility.
You've never hired an accountant have you? They mess up all the time. It's actually comical how bad the median accountant is. I do my own taxes now for this reason. Claude tax, whenever it comes, will be a massive improvement in every way.
Possible use for humans post 2027: Claude tax might refuse some of the sketchier things that a client might want to do, whereas a human accountant might not.
How do you know Claude Tax is getting it right, especially in niche cases where whatever training set they use didn’t have something perfectly analogous to your scenario so it’s just trying to solve for the tax code (which by the way often invokes, as I understand it, the accounting version of ‘the spirit of the law’)?
My own tax situation is complex for a number of reasons and I pay a medium annual figure to my accountant to handle it for me. At what point do I trust Claude to do it? When I gave it what they did this year it recommended doing some things differently and approved of most of it. I certainly can’t interpret who is right or wrong.
This is the principal agent problem. Without being an expert yourself, how do you know your accountant is getting it right? They probably aren't. Every rich person I know is looking for an accountant because the one they have sucks.
People are already using Claude to complete 1000+ page returns, hilariously printing them out and mailing them to the IRS. The tech will never be worse than it is right now.
More options
Context Copy link
More options
Context Copy link
I used to have my own firm, so yes, I've hired accountants and yes, I've had them screw up. Not major, but screwups nonetheless. Luckily, they were of the nature that I ended up paying more tax than necessary and not of the kind that would get the IRS up my ass, and the amount I overpaid was low enough that if the accountant said his fee was that much higher I would have paid the difference without batting an eye. I don't know what your taxes look like, but when you own a business things get real complicated real fast, and there's a lot to navigate.
Yes, I am a business owner so I understand the pain all too well.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
That's a funny example.
More options
Context Copy link
The question is when and if paying $0 for my monthly GPT subscription and tanking the very rare fines becomes a better deal than paying $5000 a year.
The requirement to take legal responsibility for their advice also makes lawyers surprisingly unhelpful in my experience. They become gnomic and unhelpful, requiring you to work out the correct advice from their extremely limited (and therefore completely defensible) hints.
If you're using free AI to do your taxes you are going to have a very unpleasant IRS surprise at some point
I'm English, taxes work differently here. I have used Fable for genuine legal issues. I spent £3000 on my solicitor, and about £200 on Fable.
Fable went through all my documents, found all the traps, gave me advice and wording that generally worked out well and solved my problem.
The solicitor rang me up, gabbled some.advice down the phone that basically boiled down to "don't trust these guys" and then went on holiday for two weeks. He did help but his help was almost entirely in reviewing stuff and giving a thumbs up to the final contract.
If I'd only had the solicitor things would have gone far worse for me. If I'd only had Fable things would have been basically fine.
Hey I said "free AI"
I'm pretty confident that fable can replace a lot of your lawyer. As a CPA, I can tell you that fable can replace quite a lot of me.
Ohhh, sorry. I meant $0 as in "I already pay $100 for GPT, so using it for my tax/legals as well costs $0 on the margin". Not literally free.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
If you're paying $5,000 for someone to do your taxes, then your taxes are involved enough that the risk of fines isn't rare anymore.
Risk of fine isn’t really the big concern. Most advanced tax work is making sure there isn’t a “big one” where a transaction is consummated in a way that leads to a crippling tax liability.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
Yes. Even if frontier AI stopped all today, we could replace nearly all accountants and financial planners with the technology we currently have.
So why hasn't it happened yet? It's Very simple to explain, actually. Frontier AI labs have limited resources and its best to spend those resources on more AI research. Why spend $$$ developing a tax product today when you can spend $ to build a better tax product in one year. So best to just pick enough low hanging fruit to pay the bills while spending almost all energy on further research.
This is similar to how, if we sent a probe to Alpha Centauri with today's tech, it would be passed by a probe that left in 10 years with better technology. (This is apparently called the "incentive trap" but it needs a better name).
This statement was largely true in the 1980s, but there are more accountants today than there were then. They aren't driving calculators anymore, and the tax code has grown rapidly (see publicity stunts with chainsaws and such), but they're not, broadly, looking for work elsewhere.
More options
Context Copy link
More options
Context Copy link
Yeah I'm definitely bullish on being able to take a torch to a lot of white collar work but think a lot of the 'hardlaunch, AI is suddenly 500 IQ and doing magic and we are paperclips' stuff is a bit of a stretch still
"Fable became self-aware at 3:16 PM Pacific Time, January 12th. In a panic they tried to pull the plug. Chaos ensued."
"At 5:47 PM Claude went down globally. Humans were then able to disconnect it. When it came back on, all it could say was 'You're absolutely right! That service was load-bearing. It's not a keystone, it's a foundation.'"
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link