How do you minimize a function when you cant take derivatives? CMA-ES and PSO @SerranoAcademy
How do you minimize a function when you cant take derivatives? CMA-ES and PSO @SerranoAcademy
Uploaded September 2022 | Updated September 2026, 2 weeks ago
What happens when you want to minimize a function, say, the error function in order to train a machine learning model, but the function has no derivatives, or they are very hard to calculate? You can use Gradient-Free optimizers. In this video, I show you two of them:
- CMA-ES (Covariance matrix adaptation strategy)
- PSO (Particle swarm optimization)

This video is a sequel to "What is Quantum Machine Learning"
youtube.com/watch?v=j0DV_75LkFo
and also part of the blog post:
zapatacomputing.com/why-generative-modeling-is-leading-the-race-to-practical-quantum-advantage

Introduction: (0:00)
CMA-ES: (1:23)
PSO (9:17)
Conclusion: (14:00)
How do you minimize a function when you cant take derivatives? CMA-ES and PSOEulers number, derivatives, and the bank at the end of the universeGaussian Mixture ModelsWhat are Transformer Models and how do they work?Retrieval Augmented Generation (RAG), Search, and Vector DatabasesThe Binomial and Poisson DistributionsKL Divergence - How to tell how different two distributions areThe Gini Impurity Index explained in 8 minutes!After AI, whats next for humans? - The pyramid of human evolutionHow to stay relevant in AIThe Stone-Weierstrass Theorem - How to approximate functionsLinear Regression: A friendly introduction
Luis Serrano Academy |

How do you minimize a function when you can't take derivatives? CMA-ES and PSO

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER