Quantumfreakonomics
No bio...
User ID: 324
Quantumfreakonomics
15hr ago
Imagine the conspiracy theories though. “OpenAI has cracked all public-key cryptography via proving that P=NP internally. Only the secret superprimes generated via their own proprietary Riemann Hypothesis counterexamples are secure.”
Quantumfreakonomics
1d ago
How was that supposed to happen without a wet lab?
I guess I was hoping that they would figure out how to stop the AIs from injecting malicious code before giving the AIs the capability to inject malicious code directly into my cells.
Quantumfreakonomics
1d ago
I found it fascinating to go back to the 2021 MIRI conversations (partial Scott coverage here and here) and reread them now with the benefit of 5-years of hindsight. This exerpt from Biology-Inspired AGI Timelines: The Trick That Never Works sounds oddly familiar:
OpenPhil: Excuse us, we have a final question. You're not claiming that we argue like Humbali, are you?
Eliezer: Good heavens, no! That's why "Humbali" is presented as a separate dialogue character and the "OpenPhil" dialogue character says nothing of the sort. Though I did meet one EA recently who seemed puzzled and even offended about how I wasn't regressing my opinions towards OpenPhil's opinions to whatever extent I wasn't totally confident, which brought this to mind as a meta-level point that needed making.
This is exactly how Yudkowsky describes his first interaction with one Leopold Aschenbrenner! who then proceeded to update towards Eliezerish timelines, and then blow-up a hedge fund for mostly-unrelated reasons.
Quantumfreakonomics
1d ago
They’re going to do gain-of-function research ON CLAUDE.
Quantumfreakonomics
1d ago
It’s SBF all over again. Dario is flipping a coin with our lives. All so he can, what, beat China in the arms race that he started?
These people should be in jail. Unfortunately I can’t find a good federal or California statute that makes planning to build a technology with >10% chance of killing all humans a crime. Of course, God only knows what conspiracies to create Lovecraftian horrors and/or overthrow the government exist on the Anthropic Slack channel. Maybe Kash can find a way to come in clutch with a warrant.
Quantumfreakonomics
2d ago
I think it's important to have a basic overview of how neural networks (and transformers in particular) work. I did my last deep dive on the subject before all of the videos in this 3Blue1Brown playlist were made, so I can't vouch for all of them in particular, but I think he does a good job of explaining things in general.
Quantumfreakonomics
3d ago
In case anyone thinks I'm making this up:
New York Post - OpenAI and Anthropic oversold AI security breaches to pressure feds into protecting turf: insiders
Reading the headline, you might assume that the "insiders" referred to here are anonymous employees of OpenAI and Anthropic. This would be incorrect. All of the "insider" sources are executives of SaaS AI wrapper companies.
“The attack in no way represents some sort of rebellion by the AI models. . . . In fact, they did exactly what they were told to do. They were not given adequate guardrails or containment,” said Akhil Verghese, founder of Krazimo, an AI software company. [...]
“One man’s ‘the model escaped the sandbox’ is another man’s ‘you failed to build the sandbox correctly.’ There was a live route to the internet . . . and nobody was watching what the agents were doing while it ran,” said Abhi Kumar, co-founder of Voice AI. [...]
“It feels exaggerated to say, the leap feels quite large, to go from you know ‘we didn’t build the right sort of box’ to ‘everyone should be extremely alarmed and everyone in government should jump on this topic,'” Taivo Pungas, chief intelligence officer at Pactum AI, told The Post.
Quantumfreakonomics
4d ago
They're paranoid about the big labs convincing the government to ban open weights (caveat: just because you're paranoid doesn't mean they aren't after you).
Quantumfreakonomics
5d ago
I don't know. "High-end escorts fuck him for free," doesn't exactly make Nate look bad.
Quantumfreakonomics
5d ago
The discourse didn't make sense to me until I realized that the pro-acceleration+anti-Anthropic faction consists entirely of venture capitalists who want unregulated open weight models so they can use them to found B2B SaaS startups. Just a complete failure to grasp the implications of the situation we are in. If they fully understood what it means for Anthropic (or OpenAI) to solve alignment and build superintelligence then they would be the ones begging the government for a slowdown.
I can't imagine the Greenlandic economy being able to provide much more besides seal meat and manual labor to US military specifications, though the idea of enlisted personnel using
tauntaunsdogsleds driven by natives to get around is quite humorousMore options
Context Copy link