site banner

Friday Fun Thread for June 5, 2026

Be advised: this thread is not for serious in-depth discussion of weighty topics (we have a link for that), this thread is not for anything Culture War related. This thread is for Fun. You got jokes? Share 'em. You got silly questions? Ask 'em.

1
Jump in the discussion.

No email address required.

I know a lot of people reading this are AI evangelist. Where did I go wrong? What the fuck do people see in this shit?

You used a "4B" model which is about an order of magnitude below the level where I find AI starts to be useful for more than just single line autocomplete. But most of the evangelists aren't using 30-40B class local models, either, they're using frontier models which are scaled another order of magnitude, and usually closer to two. Capabilities obviously aren't linear with model size and one can get surprising results from small models at times, but "small" here usually doesn't mean "fits on your phone".

I have no idea what the market is for shitty, small models. Well, in Gemma's case I think it might be for on-device inference to save Google compute costs, and "fits on your phone" is a core constraint and market demand never really factored into it.