Gao's blog
Home
Tags
Language
English
Spanish
Chinese
Perplexity
Author: Gao
October 14, 2024
Tags:
Perplexity
NLP
information theory
cross-entropy
LLM
transformer
Introduction
Defition of perplexity of discrete probability distribution
Evaluating probability model using perplexity
Calcuting of perplexity of a tokenized sequence
Reference