Shannon Entropy - Graph View Information-theoretic measure of the average uncertainty or surprise carried by a random variable, quantified in bits. View concept details Related ConceptsInformation Theory Entropy Mutual Information KL Divergence Cross-Entropy Channel Capacity Kolmogorov Complexity Huffman Coding Perplexity Information Compression Signal to Noise Ratio Redundancy ← Back to full graph