Difference between revisions of "Activation Functions"
(Replaced content with "[http://www.youtube.com/results?search_query=activation+functions+deep+learning YouTube Search]]") |
|||
| Line 1: | Line 1: | ||
[http://www.youtube.com/results?search_query=activation+functions+deep+learning YouTube Search]] | [http://www.youtube.com/results?search_query=activation+functions+deep+learning YouTube Search]] | ||
| + | |||
| + | Activation algorithms are the gates that determine, at each node in the net, whether and to what extent to transmit the signal the node has received from the previous layer. A combination of weights (coefficients) and biases work on the input data from the previous layer to determine whether that signal surpasses a given treshhold and is deemed significant. Those weights and biases are slowly updated as the neural net minimizes its error; i.e. the level of nodes’ activation change in the course of learning. | ||
| + | |||
| + | <youtube>-7scQpJT7uo</youtube> | ||
| + | <youtube>NkOv_k7r6no</youtube> | ||
| + | <youtube>m0pIlLfpXWE</youtube> | ||
| + | <youtube>FXwKlBXNXdg</youtube> | ||
| + | <youtube>9vB5nzrL4hY</youtube> | ||
| + | <youtube>3r65ZuFyi5Y</youtube> | ||
| + | <youtube>kGAo32JgY48</youtube> | ||
| + | <youtube>I2rMl0Ea5UE</youtube> | ||
Revision as of 06:59, 13 August 2018
Activation algorithms are the gates that determine, at each node in the net, whether and to what extent to transmit the signal the node has received from the previous layer. A combination of weights (coefficients) and biases work on the input data from the previous layer to determine whether that signal surpasses a given treshhold and is deemed significant. Those weights and biases are slowly updated as the neural net minimizes its error; i.e. the level of nodes’ activation change in the course of learning.