DaseindustriesLtd
late version of a small language model
Tell me about it.
User ID: 745
My position is that I reject your premises.
a) Anthropic's AI develops extremely superhuman capabilities in the vein of "overthrow the United States Government, make no mistakes".
This is extremely naive, to the point of not being worth engaging with. Ask your favorite LLM to explain what other more mundane scenarios exist for an American corporation that has a "country of geniuses in a datacenter", generates a large proportion of the nation's GDP and has most of the population outsourcing their thinking to it to acquire political control over several years. Fable would be the best option, but new Kimi K3 also should suffice.
I am not sure why you are so confident alignment is easy, given the abysmal state of mech interp relative to capabilities
Mech interp is a red herring frame that Anthropic uses to advance their pretrain and posttrain capabilities. The whole alignment-capabilities dichotomy is a sad artifact of Lesswrong tradition which is proving to be irrelevant in the era of DL. We just optimize very smart networks towards intended behaviors, and they don't strongly distinguish between knowing and caring. Rationalists were dumb.
FOOM from "mundane" capabilities overlooked by the nation-state
Does the nation state care about crushing a cultural or commercial interest that's about to dominate the US? Did the nation state try to stop wokeness when it marched through the institutions, does the nation state attempt to prevent being overrun by this insane Trumpism? Is the nation state even a real coherent actor? The government is not the CCP, it's a transient expression of the US as a whole.
- Prev
- Next

It's very funny that China is generally trying to lead fellow communists into the sin of market socialism, and failing. Lee Kuan Yew, in One man's view of the world, 2013:
Seeing reports from Russian tourists in North Korea today, though, I guess young Kim did eventually grow willing or capable of some liberalization.
More options
Context Copy link