11 Sequences: Markov Models, Word2Vec and LSTMs (MLVU) @riskone1
11 Sequences: Markov Models, Word2Vec and LSTMs (MLVU)  @riskone1
Uploaded March 2020 | Updated November 2026, 3 hours ago
slides: mlvu.github.io/lectures/61.SequentialModels.annotated.pdf
course materials: mlvu.github.io


errata: In slide 20, one of the factors of the decomposed joint probability is missing.



In the last lectures, we will discuss various deviations from the standard offline machine learning recipe we've discussed so far. Today: learning sequences. Language, music, time series and so on.
In the first half, we discuss the simple, but powerful approach of the Markov Model, and our first embedding model: word2vec.

In the second half, we discuss recurrent neural networks. A very powerful, but a bit more complex approach to dealing with sequences. Specifically, we focus on the LSTM; one of the most popular neural networks in use today.
11 Sequences: Markov Models, Word2Vec and LSTMs (MLVU)12 Recommendation, Embeddings and Matrix FactorizationMLVU 6.3: BackpropagationMLVU 3.3: ROC Curves, Area Under the CurveMLVU 8.1: Normal distributions7 Deep learning  1: Backpropagation for tensors, Convolutional Neural Networks (MLVU2019)MLVU 3.4: Social Impact 2MLVU 2.1 Linear regression8 Probability 2: Density estimation. Maximum likelihood, Normal Distributions,13 Reinforcement Learning: Policy Gradients, Q Learning, AlphaGo (MLVU2018)MLVU: Lagrange multipliers04 Methodology 2: Data cleaning, Principal Component Analysis (MLVU2018)
MLVU |

11 Sequences: Markov Models, Word2Vec and LSTMs (MLVU)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER