Difference between revisions of "Activation Functions"
| Line 7: | Line 7: | ||
<youtube>9vB5nzrL4hY</youtube> | <youtube>9vB5nzrL4hY</youtube> | ||
<youtube>3r65ZuFyi5Y</youtube> | <youtube>3r65ZuFyi5Y</youtube> | ||
| + | <youtube>kGAo32JgY48</youtube> | ||
| + | <youtube>I2rMl0Ea5UE</youtube> | ||
| − | |||
| − | + | === tanh === | |
| − | |||
| − | + | <youtube>ZyThOXVZXgc</youtube> | |
| − | |||
| − | |||
=== ReLU === | === ReLU === | ||
| Line 27: | Line 25: | ||
<youtube>mlaLLQofmR8</youtube> | <youtube>mlaLLQofmR8</youtube> | ||
<youtube>LLux1SW--oM</youtube> | <youtube>LLux1SW--oM</youtube> | ||
| + | |||
| + | === Sigmoid === | ||
| + | |||
| + | <youtube>0RTvFKCQ_yo</youtube> | ||
=== identity === | === identity === | ||
<youtube>aHQgFpJ_xp8</youtube> | <youtube>aHQgFpJ_xp8</youtube> | ||
| − | |||
Revision as of 21:39, 1 May 2018
Contents
tanh
ReLU
Softmax
Sigmoid
identity
