RandomRanger
Just build nuclear plants!
No bio...
User ID: 317
RandomRanger
Just build nuclear plants!
9hr ago
IMO Gold is an important signal but not that significant in and of itself, again, it's longer-term capabilities that matter.
How long do you think it takes, between open source AIs that win IOI&IMO Gold for pennies, and formally verified kernels for everything, in a security-obsessed nation that has dominated image recognition research just because it wanted better surveillance?
To proof a complex system against hacking, you'd need ASI. This is a superhuman feat, no humans have ever written a provably secure system that actually does useful work as opposed to just being a toy proof of concept.
By the time these kernels come out and are deployed, it's pointless to hack the datacentre.
And yet nobody is using provably correct software because the core requirement is 'does it actually work' not 'is it totally secure'. This is the first thing they teach you in a cybersecurity course, the mission comes first. It's not cost-efficient to security-max.
Only a strong AI can do this cost-effectively, not even the state actors can manage this, they get hacked all the time. And given we're talking about what happens when strong AIs first emerge, people are not going to have provably secure software already widely proliferated from kernel to application.
More options
Context Copy link