Joint Entropy

Definition

$H(X,Y)=-E_{(X,Y)\sim p(x,y)}[\ln (p(x,y))]=-{\int }_{X,Y}p(x,y)\ln p(x,y)dxdy$

Joint entropy is a measure of the uncertainty associated with a set of random variables.