Cross-Entropy - Graph View An information-theoretic measure of dissimilarity between two probability distributions, ubiquitous as the loss function for classification and language modeling. View concept details Related ConceptsShannon Entropy KL Divergence Mutual Information Information Theory Perplexity Large Language Models (LLMs) Next-Token Prediction ← Back to full graph