Likelihood trap highlights likelihood sweet spot
If language models output either very high-likelihood or very low-likelihood completions, they are rated as worse by humans. There seems to be a sweet spot of desired likelihood in text. This is likely true for machine-generated text as well as human-written text.
There are no notes linking to this note.