This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.
Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.
We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:
-
Shaming.
-
Attempting to 'build consensus' or enforce ideological conformity.
-
Making sweeping generalizations to vilify a group you dislike.
-
Recruiting for a cause.
-
Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.
In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:
-
Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.
-
Be as precise and charitable as you can. Don't paraphrase unflatteringly.
-
Don't imply that someone said something they did not say, even if you think it follows from what they said.
-
Write like everyone is reading and you want them to be included in the discussion.
On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.
Jump in the discussion.
No email address required.
Notes -
Elon Musk just launched Grokipedia, a kanged version of wikipedia run through a hideous AI sloppification filter. Of course the usual suspects are complaining about political bias and bias about Elon and whatnot, but they totally miss whole point. The entire thing is absolute worthless slop. Now I know that Wikipedia is pozzed by Soros and whatever, but fighting it with worthless gibberish isn't it.
As a way to test it, I wanted to check something that could be easily verifiable with primary sources, without needing actual wikipedia or specialized knowledge, so I figured I could check out the article of a short story. I picked the story "2BR02B" (no endorsement of the story or its themes) because it's extremely short and available online. And just a quick glance at the grokipedia article shows that it hallucinated a massive, enormous dump into the plot summary. Literally every other sentence in there is entirely fabricated, or even totally the opposite of what was written in the story. Now I don't know the exact internal workings of the AI, but it claims to read the references for "fact checking" and it links to the full text of the entire story. Which means that the AI had access to the entire text of the story yet still went full schizo mode anyways.
I chose that article because it was easily verifiable, and I encourage everyone to take a look at the story text and compare it to the AI "summary" to see how bad it is. And I'm no expert but my guess is that most of the articles are similarly schizo crap. And undoubtedly Elon fanboys are going to post screenshots of this shit all over the internet to the detriment of everyone with a brain. No idea what Elon is hoping to accomplish with this but I'm going to call him a huge dum dum for releasing this nonsense.
This reminds me of Vox Day's Encyclopedia Galactica project, or the even more retarded Conservapedia.
Wikipedia and crowd-sourced intelligence in general has its obvious failure modes, yet Wikipedia remains an extremely valuable source for.... most things that aren't heavily politicized. Even the latter will usually have articles that are factually correct if also heavily factually curated.
The problem with AI-generated "slop" is not the "schizo" hallucinations that you see. It's the very reasonable and plausible hallucinations that you don't see. It's the "deceptive fluency" of an LLM that is usually right but, when it's wrong, will be confidently and convincingly wrong in a way that someone who doesn't know better can't obviously spot.
With Wikipedia, if I read an article on Abraham Lincoln, I am pretty confident the dates will be correct and the life and political events will be real and sourced. Sure, sometimes there are errors and there are occasional trolls and saboteurs (I once found an article on a species of water snake that said their chief diet was mermaids), and if you are a Confederate apologist you will probably be annoyed at the glazing, but you still won't find anything that would be contradicted by an actual biography.
Whereas with an AI-generated bio of Lincoln, I would expect that it's 90% real and accurate but randomly contaminated with mermaids.
Relatedly, during the little tiff below (not trying to repeat it here, just a relevant experience), phailyoor and I had some back and forth about what date exactly was Fauci appointed director of NIAID. The source Grokipedia cited for the exact date only gave the year, and I couldn't find any sources that actually did give the exact date, and my suspicion was a hallucination. Finally, I landed on one: Wikipedia. And, despite my many misgivings about it, I do trust that to be accurate, and I'm guessing Grok just grabbed it from there.
Digging deeper, though, even Wikipedia doesn't seem to provide a source for that date. Where's it coming from? I pull up an LLM--ChatGPT, not Grok--and it's able to pinpoint the PDF of the official press release where the date is coming from. Which, as it turns out, is linked on the Wikipedia article, but buried in a distant unrelated citation that I wouldn't have been able to find otherwise.
My takeaway is pretty close to yours, but models are rapidly improving. That's not something that could have been done a year ago.
(I'd update the Wiki page's date with the source, but the page is currently locked.)
The main thing that is improving them is agentic AI - i.e., they can now actually do web searches and other external reference lookups, rather than just making up whatever isn't in their training data.
That's slightly unfair - they've also done things like tweak fine tuning and post training so that ambiguity isn't penalized so much, and also there's some smaller advancements with the mathematical underpinnings regarding what to do in certain "low-confidence" scenarios, for lack of a better concise descriptor. That means that even some no-tool-use models are also moderately better at hallucination resistance, though it's obviously very far from a solved problem (the most obvious confabulations however usually aren't happening anymore, unless you're
a shit model like Grokprioritizing different things like Grok)More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link