The SoftMax Derivative, Step-by-Step!!! @statquest
The SoftMax Derivative, Step-by-Step!!!  @statquest
Uploaded February 2021 | Updated September 2026, 1 week ago
Here's step-by-step guide that shows you how to take the derivatives of the SoftMax function, as used as a final output layer in a Neural Networks.

NOTE: This StatQuest assumes that you already understand the main ideas behind SoftMax. If not, check out the 'Quest: youtu.be/KpKog-L9veg

For a complete index of all the StatQuest videos, check out:
statquest.org/video-index

If you'd like to support StatQuest, please consider...

Patreon: patreon.com/statquest
...or...
YouTube Membership: youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join

...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store...
statquest.org/statquest-store

...or just donating to StatQuest!
paypal.me/statquest

Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
twitter.com/joshuastarmer

0:00 Awesome song and introduction
0:57 SoftMax derivative with respect to the output of interest
3:58 SoftMax derivative with respect to other outputs

#StatQuest #NeuralNetworks #SoftMax
The SoftMax Derivative, Step-by-Step!!!Using Bootstrapping to Calculate p-values!!!Regularization Part 2: Lasso (L1) RegressionNaive Bayes, Clearly Explained!!!Live 2020-05-18!!! Bayes TheoremExpected Values for Continuous Variables!!!Human Stories in AI: Simon StochholmXGBoost Part 1 (of 4): RegressionMiss CarolinaType 1 ErrorsAttention for Neural Networks, Clearly Explained!!!The Sensitivity, Specificity, Precision, Recall Sing-a-Long!!!
StatQuest with Josh Starmer |

The SoftMax Derivative, Step-by-Step!!!

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER