13.3.1 L1-regularized Logistic Regression as Embedded Feature Selection (L13: Feature Selection) @SebastianRaschka
13.3.1 L1-regularized Logistic Regression as Embedded Feature Selection (L13: Feature Selection)  @SebastianRaschka
Uploaded December 2021 | Updated September 2026, 2 weeks ago
Sebastian's books: sebastianraschka.com/books

Without going into the nitty-gritty details behind logistic regression, this lecture explains how/why we can consider an L1 penalty --- a modification of the loss function -- as an embedded feature selection method.

Slides: sebastianraschka.com/pdf/lecture-notes/stat451fs21/13_feat-sele__slides.pdf

Code: github.com/rasbt/stat451-machine-learning-fs21/blob/main/13-feature-selection/02_lasso-path.ipynb

Links to the logistic regression videos I referenced:
sebastianraschka.com/blog/2021/dl-course.html#l08-multinomial-logistic-regression--softmax-regression

-------

This video is part of my Introduction of Machine Learning course.

Next video: youtu.be/ycyCtxZ0a9w

The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KyGirGEvKlniaWeLOHhUF3

A handy overview page with links to the materials: sebastianraschka.com/blog/2021/ml-course.html

-------

If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
13.3.1 L1-regularized Logistic Regression as Embedded Feature Selection (L13: Feature Selection)L18.5: Tips and Tricks to Make GANs WorkL8.8 Softmax Regression Derivatives for Gradient DescentL17.5 A Variational Autoencoder for Handwritten Digits in PyTorch   Code ExampleL5.1 Online, Batch, and Minibatch ModeL12.5 Choosing Different Optimizers in PyTorchL9.3.3 Multilayer Perceptron in PyTorch   Code Example Part 3/3 (Script Setup)L18.4: A GAN for Generating Handwritten Digits in PyTorch   Code ExampleL3.0 Perceptron Lecture OverviewL12.4 Adam: Combining Adaptive Learning Rates and MomentumL19.6 DistilBert Movie Review Classifier in PyTorch   Code ExampleL19.1 Sequence Generation with Word and Character RNNs
Sebastian Raschka |

13.3.1 L1-regularized Logistic Regression as Embedded Feature Selection (L13: Feature Selection)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER