How do you minimize a function when you cant take derivatives? CMA-ES and PSO @SerranoAcademy
How do you minimize a function when you cant take derivatives? CMA-ES and PSO  @SerranoAcademy
Uploaded September 2022 | Updated November 2026, 5 days ago
What happens when you want to minimize a function, say, the error function in order to train a machine learning model, but the function has no derivatives, or they are very hard to calculate? You can use Gradient-Free optimizers. In this video, I show you two of them:
- CMA-ES (Covariance matrix adaptation strategy)
- PSO (Particle swarm optimization)

This video is a sequel to "What is Quantum Machine Learning"
youtube.com/watch?v=j0DV_75LkFo
and also part of the blog post:
zapatacomputing.com/why-generative-modeling-is-leading-the-race-to-practical-quantum-advantage

Introduction: (0:00)
CMA-ES: (1:23)
PSO (9:17)
Conclusion: (14:00)
How do you minimize a function when you cant take derivatives? CMA-ES and PSOEulers number, derivatives, and the bank at the end of the universeDid AI Solve Navier-Stokes? The $1M Millennium Problem, ExplainedGaussian Mixture ModelsWhat are Transformer Models and how do they work?Retrieval Augmented Generation (RAG), Search, and Vector DatabasesThe Binomial and Poisson DistributionsKL Divergence - How to tell how different two distributions areThe Gini Impurity Index explained in 8 minutes!After AI, whats next for humans? - The pyramid of human evolutionHow to stay relevant in AIThe Stone-Weierstrass Theorem - How to approximate functions
Luis Serrano Academy |

How do you minimize a function when you can't take derivatives? CMA-ES and PSO

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER