site banner

Culture War Roundup for the week of July 10, 2023

This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.

Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.

We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:

  • Shaming.

  • Attempting to 'build consensus' or enforce ideological conformity.

  • Making sweeping generalizations to vilify a group you dislike.

  • Recruiting for a cause.

  • Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.

In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:

  • Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.

  • Be as precise and charitable as you can. Don't paraphrase unflatteringly.

  • Don't imply that someone said something they did not say, even if you think it follows from what they said.

  • Write like everyone is reading and you want them to be included in the discussion.

On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.

13
Jump in the discussion.

No email address required.

Firstly, they're the SOTA today, anyone wanting to bet that GPT-5 won't be another leap ahead within a couple years is welcome to take it up with me, I could use the money.

I don't bet. And actually, someone independently posted pointing out that most LW-style bets are irrational from the point of view of profit motive and are signalling.

Also, they said the same thing about self-driving cars. It turns out that the last bit is a lot harder to get right than the first bit.

I find none of the reasons you stated convincing.

Firstly, bets are a tax on bullshit, you either pay up with money or lost social prestige. That's less of an issue on a pseudonymous forum, but no amount of words can convey the force of putting your money where your mouth is.

Secondly, you're not dealing with a malicious genie or rules-lawyer here, if someone wanted to bet a modest amount, up to say a thousand dollars, I see no reason for me to refuse to pay up. I can only hope my reputation speaks for itself. You shouldn't make a bet with someone if you don't expect them to pay up after all.

Third, if I wanted to be "purely profit maximizing", I'd be heading to prediction markets that pay out real money, where that approach scales. Unfortunately, they're often better calibrated than the kind of person I expect to take me up on my offer, but I still intend to dabble in them when I have more money to do so. I enjoy the satisfaction of being proven right in a public forum, with a small amount of money to spice it up.

I'd bet up to like 5000 USD, on terms and metrics for evaluation that could be discussed further, but I would strongly prefer lower stakes bets of 10-100 USD where the incentives to defect are smaller.

If your wife and kids are averse to you spending the equivalent of a succulent Chinese meal, then you really ought to be doing better (if anyone thinks I'm being an asshole for no reason, this references a reason in Jiro's own first link) I can understand if larger sums make you leery.

Oh, and on the self-driving cars, they're already operating autonomously in California and Arizona. While self-driving cars may or may not be human level, you can take my word for it that GPT-4 is a good doctor, what reason do I have to lie as one myself? I ought to have the opposite incentive, barring my general desire to be honest. Kind of a moot point whether it can happen in the future when we're already there.

I'm not gonna bet either, because I'm pretty agnostic-yet-skeptical of this approach -- no strong feelings, open to being surprised. (unlike say self-driving cars)

But I'm curious what would be your criteria for "great leap forward" in GPT-5? It all seems a bit subjective.

(the main reason to be skeptical is that AFAIK there has been no great leap forward in anything other than the size of the model and that of the corpus over the past few GPT iterations -- the former is typically subject to diminishing returns at a certain point, and the latter is probably pretty maxed out. of course that doesn't say that some clever Dick at OAI won't come up with improvements to the underlying algo (which is why I don't want to bet), but it's far from a given)

Hmm, the most important one in my eyes is performance on the USMLE, GPT-4 is 95th percentile today, I expect GPT-5 or the best SOTA model to reach 99% at the least by the end of 2025.

There are plenty of other benchmarks, and I could eyeball them as needed to formulate the bet, but I'm not particularly interested if nobody wants to take up the bet. Those are the closest to objective ways of assessing this as far as I know.

(the main reason to be skeptical is that AFAIK there has been no great leap forward in anything other than the size of the model and that of the corpus over the past few GPT iterations -- the former is typically subject to diminishing returns at a certain point, and the latter is probably pretty maxed out. of course that doesn't say that some clever Dick at OAI won't come up with improvements to the underlying algo (which is why I don't want to bet), but it's far from a given)

  1. Diminishing returns !=no returns or negative returns. The scaling laws still hold firm. In fact, the latest scaling laws suggest existing models are undertrained for their size and would benefit from more data.
  2. I've seen figures for the GPT-4 training run being around ~$50 million. That is nowhere near the limit of what FAANG tier or Tier 2 companies or nations can afford, we can easily go into the tens of billions.
  3. I contest the idea that we're tapped out on text, there's plenty of things like proprietary datasets, video transcripts and the like that are within the budget when text tokens become a truly limiting factor. You can trade-off compute in multiple ways, often training a model on a fixed data set but scaling parameters, and while it may not be optimal, even the best modern models can do more with the same number of tokens.
  4. Synthetic datasets are already being tested and may serve as a route to bootstrapping even without having more "real" data. Models can learn by self-play or self-debate, the former is already how AlphaGo works, and the latter is brand new but seems promising.
  5. Filtering for good data is also beneficial, LLMs of a given size trained on corpuses that are of the same size but one having better data than the other(code, scientific papers) will perform differently, with the one with better data doing better.
  6. Newer models can be taught with multimodal data, not just text.

Will we run out of ML data? Evidence from projecting dataset size trends

Our projections predict that we will have exhausted the stock of low-quality language data by 2030 to 2050, high-quality language data before 2026, and vision data by 2030 to 2060. This might slow down ML progress.

All of our conclusions rely on the unrealistic assumptions that current trends in ML data usage and production will continue and that there will be no major innovations in data efficiency. Relaxing these and other assumptions would be promising future work.

Even considering only high quality data, we're unlikely to run out before 2025, enough for at least a GPT-3 to GPT-4 delta.

Points 1 and 2 suggest that if the marginal return on training is positive, models will only get better. After all, they will also be able to do much higher value cognitive and physical labor, so instead of just replacing the average doctor or code monkey, they can promise to even kill the specialists.

@DasenidustriesLtd will be better positioned to answer all of this, even though I am confident I'm better versed on the topic than the overwhelming majority of Mottizens.

If bets are a tax on bullshit, they are the regressive tax that is put there by special interest groups in the government to benefit themselves.

Your willingness to bet can mean

  • you have justified confidence in X.
  • you have unjustified confidence in X
  • you are bad at general risk assessment or just very foolhardy with your money
  • You are rich or otherwise value money less than the other guy, and you're using your money to buy status
  • you aren't very risk averse. I won't take a bet with a positive expected value that gives me a 90% chance of winning money and a 10% chance of losing, unless the amounts are unbalanced by far more than 9 to 1.

I'm not going to bet with someone unless at a minimum I'd be willing to lend them money. And I'm not going to lend money to some guy over the Internet.

Once again, I must point out that I'm not endorsing betting with absolutely anyone who asks. At least in rat and rat-adjacent circles, almost anyone with any degree of reputation who makes bets falls into the "you have justified confidence in X", and if it turns out to be unjustified, it's often in hindsight.

Since, barring unresolvable cases, someone must have been wrong for the bet to pay out, calling being wrong the same as unjustified isn't warranted.

Certainly the argument that I don't value the money is trivially false, I'm a Third Worlder. Nor does the risk averse aspect play into it, because I have very strong confidence in my assessment.

I'm not going to bet with someone unless at a minimum I'd be willing to lend them money. And I'm not going to lend money to some guy over the Internet.

You do you. If my reputation doesn't meet your requirements, then so be it. I still think worse or you for turning it down, especially for trivial stakes. After all, unlike simply lending someone the money straight away, neither of us will be out on anything right now since I never asked for money to change hands until it resolves.

Still, points for a smart decision, because I do expect that if you took it up, you'd lose the money. If I didn't, why would I even offer?

Once again, I must point out that I'm not endorsing betting with absolutely anyone who asks.

There's no bright line between "you" and "anyone on the internet who asks". Which means the best policy is to not do these bets with you.

Secondly, you're not dealing with a malicious genie or rules-lawyer here

In my experience, people often act exactly like these.

You shouldn't make a bet with someone if you don't expect them to pay up after all.

Well, yes, but that's Jiro's point.

You also missed the point about making the challenge being a way to "win" right now while the loss (even if the loser doesn't weasel out of it) ends up in the future when no one cares any more.

In my experience, people often act exactly like these.

I'm not most people. If you don't think I will keep my word, then simply don't bet at all. You don't see me offering this bet on 4chan, nor would I offer it to a throwaway account. If you're a regular here with even a minimal amount to lose, I can at least debate the odds and stakes.

You also missed the point about making the challenge being a way to "win" right now while the loss (even if the loser doesn't weasel out of it) ends up in the future when no one cares any more.

I read that point and disagree with it. It signals that both people have strong conviction and confidence in their beliefs, and I fail to see how that makes either of them losers. I would respect someone with the confidence to stake anything at all beyond words more, and so would many other rats or rat-adjacents, regardless of whether they win or not. I certainly lose a great deal of respect for people who bow out before they even get to that point, no matter what excuses they raise to justify it.

Presuming the Motte still exists when said bet resolves, he would have my permission to point and laugh if I reneged on the deal, as long as he returned the favor.

I'm not most people. If you don't think I will keep my word, then simply don't bet at all.

No, I am not sufficiently confident that you will keep your word.

Of course, politeness norms normally preclude saying that, but you are taking advantage of politeness norms when you use my failure to say that as reason why I shouldn't mind betting. So I have to say it.

Like I said, it's your call. You're evidently willing to pay the small price of losing a portion of my respect, not that I expect you to lose sleep over it.

I certainly am not so full of myself that I can't accept that someone might not want to take up a bet with a pseudonymous stranger, my issue is only that you claimed to have a general aversion to betting at all, and didn't bother to caveat it with even (excessive) qualifiers like offering bets to people you'd lend money. If that counts as "talking advantage of politeness norms" to you, I clearly disagree.

For what it's worth, a person here here has already offered me substantial sums with absolutely no strings attached, and I haven't taken it up because my condition isn't so dire that I can't do without it. No, I'm not going to post proof, unless said person sees this and approves disclosure. I'm happy that someone values me enough to make the same offer.

and didn't bother to caveat it with even (excessive) qualifiers like offering bets to people you'd lend money.

Because most people don't routinely add nitpicky qualifiers to statements like that.

If I tell you that I don't eat brussels sprouts, I may in fact eat brussels sprouts if I was offered $500 to do so, or if there was a gun at my head. The fact that I left that out isn't "didn't bother to caveat it", that's talking normally.

Besides, I did say:

I'm not going to bet with someone unless at a minimum I'd be willing to lend them money.

in a different post. Pointing out that I didn't say it in the exact post you're referring to is an even worse nitpick.

If your wife and kids are averse to you spending the equivalent of a succulent Chinese meal, then you really ought to be doing better. I can understand if larger sums make you leery.

Someone who has spent the past several posts wringing his hands about how obsolete and poor he's gonna be instead of getting his promised future as a rich doctor really ought to knock that shit off. You don't get to mock "poorcel!" when you're begging "anyone know a way I can get into America, I want to be rich and live a good life?"

It's not just a question of affording the money, it's also a question of how you budget and spend, and the wife and kids question is separate from that.

I could afford an arbitrary expense of a few hundred dollars. But if you want me to risk money, you'll have to do better then tell me "if you get that unlucky 10% chance, you'll be out a few hundred dollars, but hey, you can afford it", unless you have a very sophisticated idea of "afford" which is not just "you have $X and no plans to use it for anything".

On the contrary, this seems consistent with the belief that any functioning adult in the US is richer than God.

Since God has a net worth of about zero, I can't disagree.

If not, I hope he's filing his taxes properly, assuming they're not tax exempt on religious grounds.

C'mon man -- He's got the whole world in His hands, just because he struggles with liquidity doesn't make him poor.

I might be poor in 5 years. Well, if not poor, then unemployed, which isn't the same.

I can afford a 100 dollar bet over a timespan of 1 year, and I'm pretty sure anyone else here could too, including justifying it to the missus. Even 1-5k is feasible, especially since I don't have to pay out right now. If my circumstances are so dire that I can't afford that in a mere 2 years, things are so FUBAR that we all have bigger problems to worry about

You're mistaking it as an accusation of poverty in the first place, it's more of an accusation of mild hypocrisy, I think it's a lame excuse when people regularly make far bigger spends on impulse. I know I have, and I'm already among the poorest Mottizens in absolute terms.

Snarking at someone about "if your family would be impoverished by the price of a meal" is pretty much sounding like an accusation of poverty. I don't bet because I think it's stupid, and I never win anyway, so whether or not I can afford to bet a tenner isn't why I avoid bets. Maybe the other person has a different reason, but "if you don't take up my bet it's because you're poor, boo sucks to be you" isn't a mature argument.

You might want to open the first link he shared, because among the myriad (bad, IMHO) reasons he shared for refusing to take bets, one was that he couldn't justify it to the wife and kids.

If memory serves, he's a lawyer or in an associated field, and he's certainly not going to end up in the doghouse for a sum that small. Even if he isn't one, he's almost certainly wealthier than I am by a country mile.

I already am amongst the poorest Mottizens around, at least in absolute terms, and given that I don't want to be paid out adjusted to purchasing power parity, there is no way this represents a worse deal for him than it does me.

After all, both parties taking bets expect to win, with a net positive expectation after taking the odds into account.

I can't force anyone to take a bet can I? If he can't afford to bet, it's a completely different scenario to giving reasons why he doesn't bet in general.

I don't bet because I think it's stupid, and I never win anyway, so whether or not I can afford to bet a tenner isn't why I avoid bets

If you keep losing bets, then the smart decision is both to not bet, and temper your expectations on how right you are about things.

This isn't something like horse racing, where you have a middleman taking a cut, meaning that you have to be better than merely being right more often than not to have it be worth your time.

I'm right on things I care to bet on more often than not, and since I recently missed an opportunity to make bank on Nvidia because I couldn't convince my dad to invest in time nor had the money to do so myself, I have no qualms about taking on one.

because among the myriad (bad, IMHO) reasons he shared for refusing to take bets, one was that he couldn't justify it to the wife and kids.

In your opinion, indeed. You sound like you're offended he wouldn't bet with you. My view on this is nobody has to bet on anything and "I don't want to" is sufficient reason. "Oh, you're so pussy-whipped your missus won't let you bet" and "boo-hoo, your family will starve if you bet a small amount of money, loser" are not, as I said, convincing arguments and make you sound like a playground bully.

His reasons are his reasons. You proposed a bet, he refused, there we are. Again, my own view is that "if you really believed the postion you hold, you'd bet money on it and if you don't you're a pussy/coward/poorcel loser" is fucking stupid, like the local tough guy trying to chivvy someone into drinking drunk because "a real man can hold his booze and if you don't want to go pint for pint with me, you're a dum-dum loser!"

Then again, I'm a woman, and these male dick-measuring rituals don't impress me much.

I've also never liked the Rationalist love of betting and I considered writing an effortpost about it at one point.

There is a certain machismo to it that I find distasteful. I also don't think it's a coincidence that the same belief structure that loves to make people pay rent (via utilitarianism) also love to make beliefs pay rent (via betting). The motto is the same in both cases: "if you're not useful, you're out".

I am only mildly offended that he wouldn't take a bet with me.

I take much more umbrage with his dismissal of betting in general, which I consider it a rather good rationalist tradition, though it's certainly not exclusive to them. Like I said, it's a tax on bullshit, and a strong signal of confidence in one's claims.

I certainly would be embarrassed if my wife and kids stopped me from spending 10-100 dollars on a whim. If saying that counts as bullying in your eyes, so be it, I wouldn't have even thought to bring it up if he hadn't clearly mentioned it.

We're (hopefully) all adults here, and I for one don't see it as bullying in the least to point out flaws in someone else's policies, nor do I complain when others criticize me without making blatantly unjustified accusations.

Hlynka's claims that I misunderstood him because apparently I might have mistranslated from English to "Indian" is just about the only one, barring some idiot who insinuated that my medical degree was fake because he got mad at me speaking ill of C.S. Lewis. And even then, I only found it laughable rather than anything I care about, not that I minded the people speaking up for me. I'm not looking for a school marm to stop people from saying mean things of me, or in this case, simply making a negative judgement. If that's not to your taste, I'm sure you can acknowledge that I'm not a hypocrite about it.

For what it's worth, Brockman and Altman seem to say that GPT-5 will be in an entirely different format, either a purely B2B offer or something direct-to-research institutions, so I am not sure if that bet would be resolvable.

where did you learn that from?

https://youtube.com/watch?v=65zOlQV1qto&t=1854

Looking back at it I've read too much into his words. I do think it's a possible interpretation though.

I'm sure they'll provide evidence of its competence publicly, even if they hide the details (at least in the case of GPT-4, most likely because it's a rather standard Mixture of Experts, rather than some kind of earthshaking breakthrough, wait, let me get my "All You Need is Scale" t-shirt ready) or refuse to let us plebs use it. I think the most likely scenario where that's the case is if they think GPT-4 is sufficient for most use cases, and think that they might make more money by market segmentation and offering the best models to companies that will pay $$$ for them.

And I'm not strictly concerned with just something coming out of OAI, I could easily be pursuaded to consider models from other companies, and posit that at least 1 of them will be superior to GPT-4 on terms that are easily verifiable.

If the bet doesn't resolve, it doesn't resolve and nobody loses anything.