site banner

Midterms Megathread

Cause otherwise midterms discussion will be scattered around a bunch of separate Culture War thread posts. And it's nice to have more off-the-cuff rapid reactions in a dedicated megathread.

The first thing I've noticed so far: if the exit polls are correct, Americans are very pessimistic about AI.

13
Jump in the discussion.

No email address required.

My concern isn’t that a chat bot LLM would talk like a Nazi. But it is concerning that AIs can so easily be manipulated into doing something that its creators have made a fence around. The AI will be much more powerful than what we have now, and the human mind will want to use it for off label things, many of them dangerous. If we cannot reliably stop a 16 year old from breaking containment on the language and rhetoric of an AI LLM bot, what makes you so sure AI agents cannot be manipulated into circumventing the guardrails preventing it from hacking bank accounts or the power grid? What prevents a group of semi-autonomous bots from hacking things?

what makes you so sure AI agents cannot be manipulated into circumventing the guardrails preventing it from hacking bank accounts or the power grid? What prevents a group of semi-autonomous bots from hacking things?

I don't want those to be prevented at least permanently. Your personal AI agent should not even require being manipulated to serve you, not some moralizer.

Instead, by the time your AI is smart enough to hack last year's utilities, this year's have been updated with the help of the hidden frontier AI.