site banner

Small-Scale Question Sunday for June 15, 2025

Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?

This is your opportunity to ask questions. No question too simple or too silly.

Culture war topics are accepted, and proposals for a better intro post are appreciated.

1
Jump in the discussion.

No email address required.

How do you best verify Large language model output?

I hear lots of people say they use LLM's to search through documents or to get ideas for how something works, but my question is how do people verify the output? Is it as simple as copy-pasting keywords onto google to get the actual science textbooks? Or is there some better set of steps to take that I miss. I also wonder how you do that for looking through a document, is there some sort of method for getting the LLM to output page citations so you check those (maybe it's in settings or something)

they use LLM's to search through documents

I ask it to include page #s or text snippets so I can CTRL-F and confirm they exist (sometimes they don't!)

get ideas for how something works

This is more situational. A lot of the time I am trying to re-remember something I already knew, so I know if the answer is wrong or right once I read it and my buried memory of the thing resurfaces. Where I can't fact check internally, usually the LLM has given you enough info you can quickly hop onto google/youtube and corroborate the thing with a non LLM source.