Because that is within his potential remit, while the hard maths of alignment is well outside his potential remit
Yudkowsky, MIRI, and related orgs sure, but why would Scott, a psychiatrist who happens to be interested in ratsphere ideas, be responsible? That's like saying a random Trump voter should already have solved the Iran crisis.
But at least on the former, I would agree with post by RandomRanger above that it's not clear what value creating a benchmark 10 years ago would even have in the current environment. I'm pretty sure that MIRI were working on solving alignment itself, rather than working on hypothetical benchmarks for potential future AI technologies. Unless there is a demonstratable link, why would you ask them to do that?
Scattered thoughts on this:
- Marshall's failure to get behind the KMT and defeat the CCP really could be the greatest blunder in American history
- As with AI 2027, this seems like it was written primarily as a PR piece, something to appeal to politicians, decision makers, etc., rather than as a completely serious forecast. And as with AI 2027, I expect there to be a lot of people who either don't understand this or don't agree that this was how it was written, and start nitpicking things obviously intended to appeal to Washington rather be maximally truthful. Case in point: in the comments, Scott says they deliberately didn't use "UBI" as they were advised it would turn off Republicans
- Looking at it as a forecast, I think I'd agree with OP here and give it no real chance of success. Politics is too fractured, China is too untrustworthy, and there are too many dangerously retarded people like Marc Andreesen arguing for the other side. I don't think Trump is necessarily a point against; in fact, I would argue that "only Trump could go to China (to regulate AI)". You have to have a leader with strong control over his own party, who doesn't give a shit about the attacks of his enemies to get this through. But this feels like something Trump 1 could have done, back before he wasn't nearly so senile.
- Although I stressed above that this was written for a political audience, I'm a bit disappointed they weren't more imaginative in their economic predictions. I can't really comprehend their future in which 100% of industries are really quite rapidly fully automated and constantly growing, while at the same time there is still standard capitalism with some redistribution. Who are the buyers in this market? How is cash moving around the system with sufficient velocity, particularly when it comes to more third and second world countries that might have far more difficulty arranging fair redistribution?
When you say "they" are you referring to the authors of this piece?
What is the value of having a benchmark to judge progress?
- Prev
- Next

This is what we would term uncharitable thinking on any other post
More options
Context Copy link