Skip to main content
PProfileMatch
← Path

Large Language Models · LLM Sampling: Temperature, Top-p and Why Hallucinations Happen

0 XP
  1. 1 current stop: learning
  2. 2 upcoming
  3. 3 upcoming
  4. 4 upcoming
  5. 5 upcoming

Finish after stop 5

Stop 1 of 5 · Workshop dial marked cool to hot

Trick to keep in mind+3 XP

Cold for facts, warm for fun.

Temperature rescales the scores before they become probabilities. A low setting makes the favourite dominate, so output is predictable, which suits extraction, classification and factual answers. A higher setting gives unlikely tokens a real chance, which suits brainstorming and playful variety, where a surprise is welcome.

Read it once, then a question tests whether the trick stuck.