Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?
This is your opportunity to ask questions. No question too simple or too silly.
Culture war topics are accepted, and proposals for a better intro post are appreciated.

Jump in the discussion.
No email address required.
Notes -
The AI 2027 guys have updated their timeline, pushing back the estimated time until a superhuman coder appears to 2032.
Does anybody else feel like they just got a stay of execution?
Not particularly, this seems to be following the usual trajectory of "in five years time" for all claimed World-Shattering Advances. As we get nearer to 2032, I wouldn't be surprised for more 'updated' timelines about "well we mean by 2036" and so on.
I'm not saying AI won't happen, I'm saying the fairytale AI won't happen. No superhuman ASI better at everything than the best human. AI integrated into our work lives the same way email and the Internet became integrated, and for once a shakeup in white collar jobs first, but no "now we have AI running the economic planning for us". Robot factories supervised by four or five humans cranking out cars? Yeah, that's plausible. AI working out how to colonise the light cone? Come off it.
I'm not sure how you could be confident of that because the entire point of "fast takeoff" is the nonlinearity. It's not saying "AI is going to improve steadily at a fast pace and we're going to get 10% of the way closer to lightcone speed each year for 10 years. It's "At some point, AI will be slightly smarter than humans at coding. Once it does that, it can write its own code and make itself smarter. Once it can do that, growth suddenly become exponential because the smarter AI can make itself smarter faster. And then who knows what happens after that?"
I'm not 100% convinced that this is how things play out, but "AI is gradually but slowly getting better at coding" is weak evidence towards that possibility, not against it.
We're relying heavily on "the AI can make itself smarter" for this. We've been trying to make ourselves smarter for a long time, and the results are mixed. Perhaps "regression to the mean" will apply to AI also, and the product of "it rewrote its code to be smarter" is "well uh turns out that made it reset to an earlier state".
What? We have basically no forms of self-modification available whatsoever. You can study and reason, I guess, which is vaguely like adding training data to an AI. You can try Eugenics, but that's highly controversial, incredibly slow, and has not been tried at scale for long enough. Hitler tried and then people stopped him before he could get very far. Gene editing technology is very new and barely used due to controversy and not being good enough and taking decades to get any sort of feedback on.
We have NOT been "trying to make ourselves smarter" in the same way or any way comparable to an AI writing code for a new AI with the express purpose of making it smarter. What we have been doing is trying to make AI smarter with more powerful computers and better algorithms and training and it has worked. The AI of this year is way smarter than the AI of last year, because coders got better at what they're doing and made progress that made it smarter. If you have more and better coders you get smarter AI. We can't do that to humans... yet. Maybe some day we will. But we don't have the technology to genetically engineer smarter humans in a similar way, so I don't know what sort of comparison you're trying to make here.
Education, better nutrition, recommendations from Top Medical Men about what to/what not to eat, drink, sleep, wear, how hot or cold your house should be, and the old-fashioned "just do it like we breed racehorses: get smart men to marry smart women and pump out smart kids".
We haven't yet been able to stick pins into our brains to re-write our code, but we'll try that as soon as something seems vaguely plausible (Neurolink, maybe?) Somebody out there is going to try and use AI to do "adult genetic engineering, rewrite your cells on the fly" to get Moar Bigger Brain.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link