5 Probability 1: Entropy, (Naive) Bayes, Cross-entropy loss (MLVU2019) @riskone1
5 Probability 1: Entropy, (Naive) Bayes, Cross-entropy loss (MLVU2019)  @riskone1
Uploaded February 2019 | Updated September 2026, 3 days ago
slides: mlvu.github.io/lectures/31.ProbabilisticModels1.annotated.pdf
course materials: mlvu.github.io

Apologies for the bad audio (and missing video). A technical mishap meant we had to improvise.

Today, we discuss probabilistic approaches to Machine Learning. We start by reviewing the basics of probability theory and information theory, and then discuss some approaches to probabilistic classification, including the (naive) Bayes classifier and logistic regression, which is a combination of a linear model, a sigmoid function and cross-entropy loss.
5 Probability 1: Entropy, (Naive) Bayes, Cross-entropy loss (MLVU2019)MLVU 5.2: Learning with probabilityMLVU 4.4: Principal Component AnalysisMLVU 11.3: Recurrent neural nets and LSTMsMLVU 4.2: Class imbalance and feature design12 Matrix models: Recommender systems, PCA  and Graph convolutionsMLVU 2.4 Linear ClassificationMLVU 1.5 Generalization in machine learningMLVU 8.4: Expectation-maximization from first principlesMLVU Live Stream10 Tree Models and Ensembles: Decision Trees, Boosting, Bagging, Gradient Boosting (MLVU2018)MLVU Course details 2023
MLVU |

5 Probability 1: Entropy, (Naive) Bayes, Cross-entropy loss (MLVU2019)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER