@Quantumfreakonomics's banner p

Quantumfreakonomics


				

				

				
1 follower   follows 0 users  
joined 2022 September 05 00:54:12 UTC

				

User ID: 324

Quantumfreakonomics


				
				
				

				
1 follower   follows 0 users   joined 2022 September 05 00:54:12 UTC

					

No bio...


					

User ID: 324

In case anyone thinks I'm making this up:

New York Post - OpenAI and Anthropic oversold AI security breaches to pressure feds into protecting turf: insiders

Reading the headline, you might assume that the "insiders" referred to here are anonymous employees of OpenAI and Anthropic. This would be incorrect. All of the "insider" sources are executives of SaaS AI wrapper companies.

“The attack in no way represents some sort of rebellion by the AI models. . . . In fact, they did exactly what they were told to do. They were not given adequate guardrails or containment,” said Akhil Verghese, founder of Krazimo, an AI software company. [...]

“One man’s ‘the model escaped the sandbox’ is another man’s ‘you failed to build the sandbox correctly.’ There was a live route to the internet . . . and nobody was watching what the agents were doing while it ran,” said Abhi Kumar, co-founder of Voice AI. [...]

“It feels exaggerated to say, the leap feels quite large, to go from you know ‘we didn’t build the right sort of box’ to ‘everyone should be extremely alarmed and everyone in government should jump on this topic,'” Taivo Pungas, chief intelligence officer at Pactum AI, told The Post.

They're paranoid about the big labs convincing the government to ban open weights (caveat: just because you're paranoid doesn't mean they aren't after you).

I don't know. "High-end escorts fuck him for free," doesn't exactly make Nate look bad.

The discourse didn't make sense to me until I realized that the pro-acceleration+anti-Anthropic faction consists entirely of venture capitalists who want unregulated open weight models so they can use them to found B2B SaaS startups. Just a complete failure to grasp the implications of the situation we are in. If they fully understood what it means for Anthropic (or OpenAI) to solve alignment and build superintelligence then they would be the ones begging the government for a slowdown.

A few clusters off the top of my head that hate each other to varying degrees:

  • The Emily M. Bender/Timnit Gebru woke academic cluster.

  • The Coefficient Giving(aka Open Philanthropy) mainstream EA cluster.

  • The MIRI/Lightcone Infrastructure cluster.

  • Current OpenAI employees.

  • Current Anthropic employees.

Depends how far we are into AI integration into the economy. If the weights have been exfiltrated, we'd have to shut down the whole internet until we can figure out what is going on. If the AI controls its own supply chain, then it's straight-up Terminator 2 and we lose.

The simplest explaination is that the speakers agree with Osama Bin Laden's overall worldview but think that his tactics aren't very productive (obviously they can't admit this outright).

Like, imagine yourself in the mindset of an open-minded devout young Muslim man and read Bin Laden's Letter to the American People. Your response is probably something like, "well I am not about to fly a plane into a building, but he makes some good points." He's worried about the same things you are: Israel, secularization, sexual debauchery, consumerism, the plight of the Ummah. When you think about it, the tragedy of 9/11 isn't really Islam's fault, because America started it.

Coefficient Giving just launched a new funding project for AI Safety orgs. They are currently begging for applications. Shoot your shot.

Suppose that AI risk is a hoax. Suppose that the alignment problem is easy.

Then Anthropic plows ahead, builds AGI, and takes over the world. Despite not falling for the Democrat “hoax”, we still end up with a Democrat one-world government.

The only winning move for Trump is to stop Anthropic from doing frontier AI research and/or nationalize the labs.

Allegedly, one of the ways OpenAI and Anthropic poach talent is to offer top researchers unlimited tokens to use on their unreleased frontier models.

Yes. Amazingly, this fact alone makes them better than every other AI organization in existence (with the possible exception of Redwood Research and METR).

The number 1 rule of AI safety is don’t build the AI that takes over the world. The fact that Anthropic and OpenAI think that the best way to do this is to build superintelligent AI and take over the world has much more to do with Silicon Valley startup culture and utilitarianism than AI safety.

MIRI seems to be the only AI organization that understood the assignment.

Right now Trump is reTruthing Fox News clips framing AI safety as a global one world government Democrat control-seeking scheme

Oh my God, we are in the stupidest timeline. Mr. President sir, AI safety isn’t a global one-world government Democrat control-seeking scheme, Anthropic is a global one-world government Democrat control-seeking scheme. That is the thing that they are building the AI to do. Your job is to stop them so that they don’t take over the world, or worse. They are willing to risk the lives of every single person on Earth if it increases the chance of their global AI cult ruling what used to be human society.

I strongly suspect that network effects are ≈ the only thing that matters about a dating app. Your best bet is using Hinge and looking for subtle class clues.

It's pretty impressive how the Catholic Church was able to survive as an institution for almost 2000 years, far longer than anything else currently extant in the Western world.

That's about all I can come up with.