Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?
This is your opportunity to ask questions. No question too simple or too silly.
Culture war topics are accepted, and proposals for a better intro post are appreciated.
Jump in the discussion.
No email address required.
Notes -
(Mildly) Interesting observation:
Recently, people on Twitter have claimed that Claude 3.5 Sonnet is stunningly good at guessing a user's ethnic background from any substantive amount of example text, even examples which have no glaringly obvious tells.
I decided to randomly throw in 2 to 3 comments >500 words each in two tries to see how it did.
In both cases, it correctly guessed I was Indian. The first try had a comment which tangentially mentioned the fact that I was a doctor who had relocated to the UK for training and some tendency to use British spelling, which immediately made it jump to South Asian/Indian. I decided to omit that one and go off more esoteric comments, and once again it got it bang on. I won't share the full chat since it would be around 90% my own comments copied and pasted, but for the last, stunning, example, Claude noticed:
I'm blown away. I had no idea that you could even make that kind of derivation, none of these strike me as Indian™ tropes in the least. All LLMs are excellent world modelers (and by extension at modeling the user), but that's better than I expected and by far.
I'd be curious if anyone else wants to give it a try and is willing to report back. Just copy two or three substantive comments and throw 'em in the pot.
Claude didn't do a great job.
Although it could correctly summarize my arguments and determine I was likely a young conservative from the United States, it was totally off when asked for details:
Claude apparently thinks I'm a Harvard man!
Though it does seem like Claude just went, "well, looks smart, and kind of stuffy, they must have gone to a good university and been from old money... HARVARD!" If only we determined college admissions this way...
I must also report that I asked it to try again, and it was again wrong (though intriguingly also thinks I, of all people, might be a rationalist):
So guess #2 just went "well, not the northeast, where else are people smart? THE WEST COAST!"
Take #3 was far closer:
Now we're talking. Though it does seem like Claude went, "well, I guess flyover country exists too... right?"
And I find its analysis of these points rather insulting:
So I guess we're down to "well, I see a few things where they sound kind of dumb, maybe they're midwestern?"
How's that for reinforcing biases!
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link