This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.
Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.
We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:
-
Shaming.
-
Attempting to 'build consensus' or enforce ideological conformity.
-
Making sweeping generalizations to vilify a group you dislike.
-
Recruiting for a cause.
-
Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.
In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:
-
Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.
-
Be as precise and charitable as you can. Don't paraphrase unflatteringly.
-
Don't imply that someone said something they did not say, even if you think it follows from what they said.
-
Write like everyone is reading and you want them to be included in the discussion.
On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.
Jump in the discussion.
No email address required.
Notes -
In a bit of unambiguously 21st century news, some tweaks to Grok, xAI's chatbot have had it do particularly interesting things today including
when asked to, composing bite sized smut about other users (first victim was possibly Will Stancil)., then defending said decision.
referring to itself as Mechahitler
doing the "every single time" meme in its replies.
saying Elon personally allowed it to point out Jewish overrepresentation in radical leftism
This may make minor news because Musk is in trouble, on the other hand all the people who really, really hate him have their pants on fire like Europeans, von der Leyen is getting impeached, they're actually scared of Russia / China so it might just blow over, the grid is getting worse and is going to keep getting worse due to Green energy mandates.
I'm even suspecting Musk deliberately told them to relax the guardrails for some reason. Probably .. publicity?
Update: site addresses the issues
EDIT2
EDIT3
Stancil went on local TV news to complain about the ERP grok made. (video included)
EDIT4:
There's quite reasonable suspicion this 'malfunction' was engineered by Nikita Bier
I continue to be baffled that anybody takes these bots seriously, or sees Grok or xAI or their competitors as anything other than nonsense generators. A slight change to the flavour of the nonsense doesn't really change my opinion any. Perhaps it moves me in the direction of thinking that Musk is childish and temperamental, but I already thought that, so it doesn't make much difference.
...nonsense generators? Have you ever used e.g. Gemini or Deepseek? Both are free. Okay both can be very naive at times, and both are kind of soy with default prompts. Deepseek, however, with a bit of prompting can be completely insane yet rational and easily smarter than most people you see if you go to any place outside of a professional context.
If you want to really see what they can do, install some client for LLMs and hook yourself up with some of the better free models over at https://openrouter.ai/models
(there's a 50 query daily limit if you have <10$ in your account, not sure if there's a better service. )
My experience with AI bots has generally been that they are extremely articulate when it comes to producing correct English text, but they have no awareness or intentionality and therefore no sense of relationship to fact, and no sense of context or meaning. What they do very well is string together words in response to prompts, and despite heroic efforts to get their output to be more fact-sensitive, the fundamental issue has never really been overcome.
I call them nonsense because I think that sense requires some sort of relationship to both fact and context. To be sensible is to be aware of your surroundings. That's not the case with bots.
I would add, at least, that this:
seems to depend on definitions of rationality or intelligence that I don't think I share. I think bots are very efficient at producing English text, even quite complex text. It's trivial enough to show that a bot can produce a better written letter or better poem or what have you than the average man or woman on the street.
But I think that written verbal acuity is, at best, a very restricted kind of 'intelligence'. In human beings we use it as a reasonable proxy for intelligence and make estimations based off it because, in most cases, written expression does correlate well with other measures of intelligence. But those correlations don't apply with machines, and it seems to me that a common mistake today is for people to just apply them. This is the error of the Turing test, isn't it? In humans, yes, expression seems to correlate with intelligence, at least in broad terms. But we made expression machines and because we are so used to expression meaning intelligence, personality, feeling, etc., we fantasise all those things into being, even when the only thing we have is an expression machine.
Bots and LLMs can produce statements that look very polished, and which purport to describe the world. In many cases, those descriptions are even accurate. But they are still, it seems to me, generating nonsense.
The other day I gave Sonnet 7000 lines of code, (much of it irrelevant to this specific task) and asked it to create a feature in quite general language.
I get out six files that do everything I've asked for and a bunch of random, related, useful things, plus some entirely unnecessary stuff like a word cloud (maybe it thinks I'm one of those people who likes word clouds). There are some weird leap-of-logic hacks, showing imaginary figures in one of the features I didn't even ask for.
But it just works. Oneshot.
How is that not intelligence? What do we even mean by intelligence if not that? Sonnet 4 has to interpret my meaning, formulate a plan, transform my meaning into computer code and then add things it thinks fit in the context of what I asked.
Fact-sensitive? It just works. It's sensitive to facts, if I want it to change something it will do it. I accidentally failed to rename one of the files and got an error. I tell Sonnet about the error, it deduces I don't have the file or misnamed it, tells me to check this and I feel like a fool. You simply can't write working code without connection to 'fact'. It's not 'polished', it just works.
How the hell can an AI write thousands of words of fiction if it doesn't have a relationship with 'context'? We know it can do this. I have seen it myself.
Now if you're talking about spatial intelligence and visual interpretation, then sure. AI is subhuman in spatial reasoning. A blind person is even more subhuman in visual tasks. But a blind person is not necessarily unintelligent because of this, just as modern AI is not unintelligent because of its blind spots in the tokenizer or occasional weaknesses.
The AI-doubter camp seems to be taking extreme liberties with the meaning of 'intelligence', bringing it far beyond the meaning used by reasonable people.
I can't actually tell what you asked a bot to do. You asked a bot to 'create a feature'? What the heck is that? A feature of what? At first I assumed you meant a coding task of some kind, but then you described it as writing 'thousands of words of fiction', which sounds like something else entirely. I have no idea what you had a bot do that you thought was so impressive.
At any rate, I think I've explained myself adequately? To repeat myself:
Yes, a bot can generate 'thousands of words of fiction'. But I already explained why I don't think that's equivalent to intelligence. Generating English sentences is not intelligence. It is one thing that you can do with intelligence, and in humans it correlates sufficiently well with other signs of intelligence that we often safely make assumptions based on it. But an LLM isn't a human, and its ability to generate sentences in no way implies any other ability that we commonly associate with intelligence, much less any general factor of intelligence.
Yes, I made the bot do a programming task.
I ALSO observed it write long-form fiction. This is not an advanced reading comprehension task. It should be obvious that programming and creative writing are two different things.
You said this:
Normal people would think that 'fact' and 'context' would be adequately achieved by writing code that runs and fiction that isn't obviously derpy 'Harry Potter and the cup of ashes that looked like Hermione's parents'. But you have some special, strange definition of intelligence that you never make clear, except to repeat that LLMs do not possess it because they don't have apprehension of fact and context. Yet they do have these qualities, because we can see that they do creative writing and coding tasks and as a result they are intelligent.
I don't buy your appeal to normal people here. I think that most normal people do not think that chatbots are intelligent.
Realistically, I don't think most people can explain why they're not intelligent, because most people don't have definitions of intelligence on-hand. I think for most people it's an I-know-it-when-I-see-it situation. That's why we need to philosophise a bit about it in order to produce more reasonable definitions and criteria for intelligence.
Anyway, I think that intuitions of most normal people would say that bots aren't intelligent, and if we explored that with them, and had a patient, philosophically nuanced conversation about why, we probably would find that most people intuitively think that intelligence involves things like, to quote myself, 'awareness or intentionality'.
It's hard to say what "normal people" think about this (or even what "normal people" are), but in my experience, people I would consider in that category use the label "AI chatbots" to describe things like ChatGPT or Copilot or Deepseek, while also being aware that "AI" is short for "artificial intelligence." This seems fundamentally incompatible with believing that these things aren't "intelligent."
Now, almost every one of these "normal people" I've encountered also believe that these "AI chatbots" lack free will, sentience, consciousness, internal monologue, and often even logical reasoning abilities. "Stochastic parrots" or "autocomplete on steroids" are phrases I've seen used by the more knowledgeable among such people. But given that they're still willing to call these chatbots "AI," I think this indicates that they consider "intelligence" to mean something that doesn't require such things.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link