MLVU: Lagrange multipliers @riskone1
MLVU: Lagrange multipliers  @riskone1
Uploaded February 2021 | Updated November 2026, 3 hours ago
NOTE: To simplify the discussion of KKT multipliers, we assume that the constraint is active. To work this assumption into the problem, you need a condition called complimentary slackness, which isn't discussed in the video.

To work out the kernel trick for SVMs, we need to know how to apply the method of Lagrange multipliers to a constrained optimization problem. We discuss both the classical case, with equality constraints, leading to the method of Lagrange multipliers and the modern case with inequality constraints, leading to KKT multipliers.

slides: mlvu.github.io/lectures/32.LinearModels2.annotated.pdf
lecturer: Peter Bloem
MLVU: Lagrange multipliers04 Methodology 2: Data cleaning, Principal Component Analysis (MLVU2018)MLVU Course details 2024MLVU 1.3 Other abstract tasks: regression, clustering, density estimationMLVU 9.2: Generative adversarial networks (GANs)1 Introduction to Machine Learning (MLVU2020)8 Probability 2: Maximum Likelihood, Gaussian Mixture Models and Expectation Maximization (MLVU2019)MLVU 5.3: The (naive) Bayes classfierMLVU 13.5: Social impact 46 Linear Models 2: Neural Networks, Backpropagation, SVMs and Kernel methods (MLVU2019)MLVU 3.6: No free lunch11 Sequential Data: Markov Models, Word Embeddings and LSTMs
MLVU |

MLVU: Lagrange multipliers

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER