Exponential Linear Unit

Definition

$f(x)=\{\begin{array}{ll}x& x\ge 0\\ \alpha (e^x-1)& x<0\end{array}$ where $\alpha \ge 0$ is a hyperparameter