Be advised: this thread is not for serious in-depth discussion of weighty topics (we have a link for that), this thread is not for anything Culture War related. This thread is for Fun. You got jokes? Share 'em. You got silly questions? Ask 'em.
- 159
- 1
Jump in the discussion.
No email address required.
Notes -
LLMs being described as having ‘memory’ of things in the training set is almost certainly far closer to the colloquial, human understanding of what ‘memory’ is than either of the above concepts are to computer memory or an encyclopedia.
So if someone colloquially says the LLM has its training set in its memory this is no less accurate than saying that you remember what the water cycle is even though you cannot recall the precise page and content and diagram of the school textbook that you learned it from. Or why you can identify a line of text written in ‘Trump voice’ even though you cannot exhaustively list every Trump tweet you’ve ever seen.
It's one thing to say something is in the LLM's memory. It's quite another to say it's doing some kind of lookup in a database or into the training data.
More options
Context Copy link
More options
Context Copy link