Entropy

Definition

$H(X)=-E_{x\sim p(x)}[\log p(x)]=-{\int }_{x}p(x)\log p(x)dx$

The entropy of a Random Variable quantifies the average level of uncertainty or information associated with the variable’s potential states or possible outcomes.