Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?
This is your opportunity to ask questions. No question too simple or too silly.
Culture war topics are accepted, and proposals for a better intro post are appreciated.
Jump in the discussion.
No email address required.
Notes -
How do you best verify Large language model output?
I hear lots of people say they use LLM's to search through documents or to get ideas for how something works, but my question is how do people verify the output? Is it as simple as copy-pasting keywords onto google to get the actual science textbooks? Or is there some better set of steps to take that I miss. I also wonder how you do that for looking through a document, is there some sort of method for getting the LLM to output page citations so you check those (maybe it's in settings or something)
Verifying the output depends on the use. Code gives you a pretty easy time verifying. Searching docs depends: if you’re trying to find some info in the docs, this can be sufficient to get keywords and navigate to the section you want.
Lots of current LLMs are pretty good at copying text out of prompts when told to, e.g. page numbers. That can help a lot, since verifying is very quick.
Hallucinations and other errors are still very common and you must account for them.
More options
Context Copy link
More options
Context Copy link