Neural Nets 6: Activation Functions @WhatsACreel
Neural Nets 6: Activation Functions  @WhatsACreel
Uploaded November 2019 | Updated November 2026, 3 hours ago
In this video, we'll explore activation functions. What they are, why they're used, and then we'll implement 3 of them along with their derivatives in our Neural Net library.

Thank you Bob and Trish, for lending me your living once again :)

Activation Functions Wikipedia:
en.wikipedia.org/wiki/Activation_function

E mathematical constant Wikipedia:
en.wikipedia.org/wiki/E_(mathematical_constant)

Andrew Ng's Coursera Course (no programming, but it's very good!)
coursera.org/learn/machine-learning

Support What's a Creel? on Patreon:
patreon.com/whatsacreel

FaceBook:
facebook.com/whatsacreel

Music Channel:
youtube.com/channel/UC2nWRGqPL6O-Lm8mexWhISQ

Another channel with random things:
youtube.com/channel/UCK7bPumWNzWRnb3N8LCzKsA




Software used to make this vid:

Visual Studio 2019 Community:
visualstudio.com/downloads

Blender:
blender.org

Audacity:
audacityteam.org

OBS:
obsproject.com

Davinci Resolve 16:
blackmagicdesign.com/products/davinciresolve
Neural Nets 6: Activation FunctionsCompiling 64 bit Applications in Visual C# Expressx64 Assembly and C++ Tutorial 67: SSE Min and Max InstructionsHow To Convert Hexadecimal to DecimalC++ STL: Vector vs ListThat unbelievable function that can compute EVERYTHING! An Adventure in Discrete MathematicsC# Windows 8 Tutorial 2: Calculator 2 Operators and Decimal PointAES Encryption 5: Expand Keys and Encryption FlowC++ Tutorial 9: ArraysAVX512 (3 of 3): Deep Dive into AVX512 MechanismsDouble it Like Dekker 2: Dekker Multiplication and DivisionDirect2D Tutorial 4: Pixels, Coordinates and Colors
Creel |

Neural Nets 6: Activation Functions

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER