site banner

Small-Scale Question Sunday for February 15, 2026

Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?

This is your opportunity to ask questions. No question too simple or too silly.

Culture war topics are accepted, and proposals for a better intro post are appreciated.

1
Jump in the discussion.

No email address required.

AIs are already very good at some things that humans suck at, like running an enormous checklists, repeatedly, over and over, and verify each time each checkbox is checked (computers have always been good at that, just now AIs allow the checklists to be much more complex than before). Humans are notoriously bad at this, and a lot of security bugs come from it. Like, did you check that every single place you accept outside input is safe from 200 ways outside input could mess you up? Normal humans mess up stuff like that all the time, but for AIs that would become easier and easier - both finding bugs like that and ensuring bugs like that don't happen. However, current LLMs/AIs are vulnerable to other modes of failure. If you write a standard security system, there's no way to convince it to let you in with a wrong password just this once, because you are exploring an alternative universe where this password is correct. Most "classic" systems are just too dumb to allow something like that. But "generic LLM" can very well be vulnerable to that. So I expect AIs would be a great help with eliminating old-style exploits, as well as finding new ones (it's the same thing really, just wearing different color of hat, black or white) - but also have their own classes of exploit we've never seen before. Like adversarial attacks on ML algorithms, completely invisible to humans. Imagine sending an email to some company, which for reason unknown to anybody makes corporate AI send you a big fat check. The email itself doesn't say anything about anything like that, just for some reason it looks to the AI like an approved accounts payable invoice.