13.4.1 Recursive Feature Elimination (L13: Feature Selection) @SebastianRaschka
13.4.1 Recursive Feature Elimination (L13: Feature Selection)  @SebastianRaschka
Uploaded December 2021 | Updated November 2026, 4 hours ago
Sebastian's books: sebastianraschka.com/books

In this video, we start our discussion of wrapper methods for feature selection. In particular, we cover Recursive Feature Elimination (RFE) and see how we can use it in scikit-learn to select features based on linear model coefficients.

Slides: sebastianraschka.com/pdf/lecture-notes/stat451fs21/13_feat-sele__slides.pdf

Code: github.com/rasbt/stat451-machine-learning-fs21/blob/main/13-feature-selection/04_recursive-feature-elimination.ipynb


Logistic regression lectures:

L8.0 Logistic Regression – Lecture Overview (06:28)
youtube.com/watch?v=10PTpRRpRk0

L8.1 Logistic Regression as a Single-Layer Neural Network (09:15)
youtube.com/watch?v=ncZ5iSZekVQ

L8.2 Logistic Regression Loss Function (12:57)
youtube.com/watch?v=GxJe0DZvydM

L8.3 Logistic Regression Loss Derivative and Training (19:57)
youtube.com/watch?v=7rR1L7t2EnA

L8.4 Logits and Cross Entropy (06:47)
youtube.com/watch?v=icQaFxKa_J0

L8.5 Logistic Regression in PyTorch – Code Example (19:02)
youtube.com/watch?v=6igMArA6k3A

L8.6 Multinomial Logistic Regression / Softmax Regression (17:31)
youtube.com/watch?v=L0FU8NFpx4E

L8.7.1 OneHot Encoding and Multi-category Cross Entropy (15:34)
youtube.com/watch?v=4n71-tZ94yk

L8.7.2 OneHot Encoding and Multi-category Cross Entropy Code Example (15:04)
youtube.com/watch?v=5bW0vn4ISqs

L8.8 Softmax Regression Derivatives for Gradient Descent (19:38)
youtube.com/watch?v=aeM-fmcdkXU

L8.9 Softmax Regression Code Example Using PyTorch (25:39)
youtube.com/watch?v=mM6apVBXGEA

-------

This video is part of my Introduction of Machine Learning course.

Next video: youtu.be/VUvShOEFdQo

The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KyGirGEvKlniaWeLOHhUF3

A handy overview page with links to the materials: sebastianraschka.com/blog/2021/ml-course.html

-------

If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
13.4.1 Recursive Feature Elimination (L13: Feature Selection)L14.2: Spatial Dropout and BatchNormL15.6 RNNs for Classification: A Many-to-One Word RNNBuild A Reasoning Model From Scratch 5: Inference Scaling 2 (Logprob Scoring, Self-Refinement)What I Learned From Implementing LLM Architectures From Scratch (And How to Get Started)Introduction to Generative Adversarial Networks (Tutorial Recording at ISSDL 2021)L16.1 Dimensionality ReductionL17.0 Intro to Variational Autoencoders   Lecture OverviewL5.0 Gradient Descent   Lecture Overview13.4.2 Feature Permutation Importance (L13: Feature Selection)L10.0 Regularization Methods for Neural Networks   Lecture OverviewL6.3 Automatic Differentiation in PyTorch   Code Example
Sebastian Raschka |

13.4.1 Recursive Feature Elimination (L13: Feature Selection)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER