class ELU

class ELU

Exponential Linear Unit (ELU) defined as.

\[\begin{split} y_i= \left\{ \begin{array}{ll} x_i & (x > 0)\\ \alpha (\exp(x_i) - 1) & (x \leq 0) \end{array} \right.. \end{split}\]

Inputs:

• N-D array.

Outputs:

• N-D array with the same shape as input.

See also

Clevart et al., Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). http://arxiv.org/abs/1511.07289

Template Parameters:

T – Data type for computation.

Param alpha:

Coefficient for negative outputs. \(\alpha\) in definition.