Cross-Entropy Loss

Definition

Suppose the number of data is $n$ and the number of classes is $K$, then the cross entropy loss is defined as $R(\theta )=-\sum _{i=1}^n\sum _{k=1}^K{y}_{ik}\ln f_k(x_i)$