11 Sequential Data: Markov Models, Word Embeddings and LSTMs @riskone1
11 Sequential Data: Markov Models, Word Embeddings and LSTMs  @riskone1
Uploaded March 2019 | Updated September 2026, 3 days ago
slides: mlvu.github.io/lectures/61.SequentialModels.annotated.pdf
course materials: mlvu.github.io

In the last lectures, we will discuss various deviations from the standard offline machine learning recipe we've discussed so far. Today: learning sequences. Language, music, time series and so on.
In the first half, we discuss the simple, but powerful approach of the Markov Model, and our first embedding model: word2vec.

In the second half, we discuss recurrent neural networks. A very powerful, but a bit more complex approach to dealing with sequences. Specifically, we focus on the LSTM; probably still the most power recurrent network available.
11 Sequential Data: Markov Models, Word Embeddings and LSTMsMLVU 3.1: Machine learning experimentsMLVU 9.4: Variational autoencoders (VAEs)MLVU 9.1: Generator networks06 Deep Learning 1: Neural networks, Convolutional layers (MLVU2018)5 Probability 1: Logistic regression, Log loss, Entropy (MLVU2020)MLVU 8.2: Maximum likelihood estimators10 Tree Models and Ensembles: Decision Trees, AdaBoost, Gradient Boosting (MLVU2019)MLVU 10.4: Boosting: Adaboost and gradient boostingMLVU 5.5: Information theoryMLVU 11.2: Deep learning on sequencesMLVU 1.2 Classification
MLVU |

11 Sequential Data: Markov Models, Word Embeddings and LSTMs

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER