13.4.1 Recursive Feature Elimination (L13: Feature Selection) @SebastianRaschka
13.4.1 Recursive Feature Elimination (L13: Feature Selection)  @SebastianRaschka
Uploaded December 2021 | Updated September 2026, 1 week ago
Sebastian's books: sebastianraschka.com/books

In this video, we start our discussion of wrapper methods for feature selection. In particular, we cover Recursive Feature Elimination (RFE) and see how we can use it in scikit-learn to select features based on linear model coefficients.

Slides: sebastianraschka.com/pdf/lecture-notes/stat451fs21/13_feat-sele__slides.pdf

Code: github.com/rasbt/stat451-machine-learning-fs21/blob/main/13-feature-selection/04_recursive-feature-elimination.ipynb


Logistic regression lectures:

L8.0 Logistic Regression – Lecture Overview (06:28)
youtube.com/watch?v=10PTpRRpRk0

L8.1 Logistic Regression as a Single-Layer Neural Network (09:15)
youtube.com/watch?v=ncZ5iSZekVQ

L8.2 Logistic Regression Loss Function (12:57)
youtube.com/watch?v=GxJe0DZvydM

L8.3 Logistic Regression Loss Derivative and Training (19:57)
youtube.com/watch?v=7rR1L7t2EnA

L8.4 Logits and Cross Entropy (06:47)
youtube.com/watch?v=icQaFxKa_J0

L8.5 Logistic Regression in PyTorch – Code Example (19:02)
youtube.com/watch?v=6igMArA6k3A

L8.6 Multinomial Logistic Regression / Softmax Regression (17:31)
youtube.com/watch?v=L0FU8NFpx4E

L8.7.1 OneHot Encoding and Multi-category Cross Entropy (15:34)
youtube.com/watch?v=4n71-tZ94yk

L8.7.2 OneHot Encoding and Multi-category Cross Entropy Code Example (15:04)
youtube.com/watch?v=5bW0vn4ISqs

L8.8 Softmax Regression Derivatives for Gradient Descent (19:38)
youtube.com/watch?v=aeM-fmcdkXU

L8.9 Softmax Regression Code Example Using PyTorch (25:39)
youtube.com/watch?v=mM6apVBXGEA

-------

This video is part of my Introduction of Machine Learning course.

Next video: youtu.be/VUvShOEFdQo

The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KyGirGEvKlniaWeLOHhUF3

A handy overview page with links to the materials: sebastianraschka.com/blog/2021/ml-course.html

-------

If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
13.4.1 Recursive Feature Elimination (L13: Feature Selection)L14.2: Spatial Dropout and BatchNormL15.6 RNNs for Classification: A Many-to-One Word RNNL2.4 The Deep Learning Hardware & Software LandscapeWhat I Learned From Implementing LLM Architectures From Scratch (And How to Get Started)Introduction to Generative Adversarial Networks (Tutorial Recording at ISSDL 2021)Deep Learning News #2, Feb 6 2021L3.4 Perceptron in Python using NumPy and PyTorchDeep Learning News #1, Jan 27 2021L16.1 Dimensionality ReductionL17.0 Intro to Variational Autoencoders   Lecture OverviewL5.0 Gradient Descent   Lecture Overview
Sebastian Raschka |

13.4.1 Recursive Feature Elimination (L13: Feature Selection)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER