Verbose Tethics

Topic

Activation Function

A collection of 2 issues

Maxout Activation Function

General purpose neuron activation function that outputs maximum value from a set of linear functions in output range (-∞ , ∞)

Softmax Activation Function

Math functions that calculate weighted sum of inputs and adds bias to give non-linearity to output of neuron.