site banner

Friday Fun Thread for May 15, 2026

Be advised: this thread is not for serious in-depth discussion of weighty topics (we have a link for that), this thread is not for anything Culture War related. This thread is for Fun. You got jokes? Share 'em. You got silly questions? Ask 'em.

1
Jump in the discussion.

No email address required.

What fun thing are you doing with AI?

Experimenting with selective edits on books - partially expunge a plotline, remove inner life of a character, paper over a plothole and try to keep it consistent later, remove repetitive passages. No results yet, only hours of fiddling with workflow - trying to get it to make decent notes ("The User is right, I read 8 chapters but the note file is empty. This is bad.") or keep it reading in full without it deciding to start skimming was fun. Getting a feeling this may be too complex of a task to get right with a few naive prompts if the goal is first to build extensive understanding of the books read, not just do smart find&replace.

Third book of Prince of Nothing was the trigger.

not gentle fixfic, but brutal nonconsensual editing

Unfathomably based (1 2).


trying to get it to keep it reading in full without it deciding to start skimming

Paper:

Context Length Alone Hurts LLM Performance Despite Perfect Retrieval

Our systematic experiments across five open- and closed-source LLMs on math, question answering, and coding tasks reveal that, even when models can perfectly retrieve all relevant information, their performance still degrades substantially (13.9–85 %) as input length increases but remains well within the models' claimed lengths.

See table 2.

Nvidia investigation

Despite achieving nearly perfect performance on the vanilla needle-in-a-haystack (NIAH) test, most models exhibit large degradation on tasks in RULER as sequence length increases.

Funny quote:

What is the current largest context window for an open LLM?

Does not matter as all these long-context models develop dementia when using 10 % of their context window.

Unfathomably based (1 2).

Word, LaTeX, Notepad++—there are many ways to fuck the text into submission and ejaculate your grammatical and orthographical preferences all over its fertile womb. Just Do It!

I approve of this message. Also hilariously, with this book in particular, I wanted to, among other things, to tone down the comparably smutty bits Bakker insists on.

Context Length Alone Hurts LLM Performance Despite Perfect Retrieval

Something to take into account, thanks. I'm only pushing the model to read in full in the first two note taking passes, then later to work from notes (anchored to the text via paragraph markers injected into unpacked ebook). I should switch to the PI agent fork and try multiple agents, more limited context.