Difference between revisions of "Activation Functions"

From
Jump to: navigation, search
(Replaced content with "[http://www.youtube.com/results?search_query=activation+functions+deep+learning YouTube Search]]")
Line 1: Line 1:
 
[http://www.youtube.com/results?search_query=activation+functions+deep+learning YouTube Search]]
 
[http://www.youtube.com/results?search_query=activation+functions+deep+learning YouTube Search]]
 +
 +
Activation algorithms are the gates that determine, at each node in the net, whether and to what extent to transmit the signal the node has received from the previous layer. A combination of weights (coefficients) and biases work on the input data from the previous layer to determine whether that signal surpasses a given treshhold and is deemed significant. Those weights and biases are slowly updated as the neural net minimizes its error; i.e. the level of nodes’ activation change in the course of learning.
 +
 +
<youtube>-7scQpJT7uo</youtube>
 +
<youtube>NkOv_k7r6no</youtube>
 +
<youtube>m0pIlLfpXWE</youtube>
 +
<youtube>FXwKlBXNXdg</youtube>
 +
<youtube>9vB5nzrL4hY</youtube>
 +
<youtube>3r65ZuFyi5Y</youtube>
 +
<youtube>kGAo32JgY48</youtube>
 +
<youtube>I2rMl0Ea5UE</youtube>

Revision as of 06:59, 13 August 2018

YouTube Search]

Activation algorithms are the gates that determine, at each node in the net, whether and to what extent to transmit the signal the node has received from the previous layer. A combination of weights (coefficients) and biases work on the input data from the previous layer to determine whether that signal surpasses a given treshhold and is deemed significant. Those weights and biases are slowly updated as the neural net minimizes its error; i.e. the level of nodes’ activation change in the course of learning.