Uploaded October 2021 | Updated September 2026, 2 weeks ago
DeepMind recently released a new type of Transformer called the Perceiver IO, which was able to achieve state of the art accuracy across multiple data types (text, images, point clouds, and more). In this episode of the AlphaCare series, I'll explain how Perceiver works, and how we used it to improve accuracy scores for Cardiac video data. The EchoNet dataset was recently made public by Stanford University, and it contains 10K privatized heart videos from patients. We'll also discuss why Transformer networks work so well, and how by using 2 key features (Cross attention & positional embeddings), the Perceiver improved on all variants of Transformers. Get hype!
Big thanks to RapidAPI for sponsoring this video series:
rapidapi.com/hub?utm_source=Siraj-Raval&utm_medium=DevRel&utm_campaign=DevRel
Code & Coding Challenge:
github.com/llSourcell/AlphaCare/tree/main/Perceiver
Challenge Submission Link:
https://forms.gle/2DJkYts4HAfHMKpm8
More Learning Resources:
Perceiver explainer by Yannic Kilcher:
youtube.com/watch?v=P_xeshTnPZg&t=1365s
AlphaCare Episode 1 link:
youtu.be/fGv6VmfGMLc
Perceiver Explainer by AI Epiphany:
youtube.com/watch?v=WJWBq4NZfvY
MIT Video on CNNs:
youtube.com/watch?v=iaSUYvmCekI
Henry AI Labs Video on 3D CNNs:
youtube.com/watch?v=rcnKGMNyVu4
ECG Time Series Classification Video in PyTorch:
youtube.com/watch?v=qN3n0TM4Jno
Awesome list of papers + code on ECG Classification:
paperswithcode.com/task/ecg-classification
List of awesome materials on Deep Learning in healthcare:
github.com/XiaoleiZ/awesome-list-machine-learning-healthcare
Free EdX course on ML in Healthcare:
edx.org/course/machine-learning-for-healthcare
Andrew Ng's Free Deep Learning courses:
deeplearning.ai
Dr David Sinclair at Harvard Medical's Book that inspired me:
lifespanbook.com
My Math of Intelligence Playlist:
youtube.com/watch?v=xRJCOz3AfYY&list=PL2-dafEMk2A7mu0bSksCGMJEmeddU_H4D
Free Book on Intro to Statistical Learning:
statlearning.com
Follow me:
INSTAGRAM:
instagram.com/sirajraval
TWITTER:
twitter.com/sirajraval
FACEBOOK:
facebook.com/sirajologyyy
LINKEDIN:
linkedin.com/in/sirajraval
TIKTOK (i'll start posting soon):
tiktok.com/@sirajraval?lang=en
Please subscribe for more programming videos! That's what keeps me going. Join my AI community: chatgptschool.io Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available): https://www.wagergpt.xyz
DeepMind recently released a new type of Transformer called the Perceiver IO, which was able to achieve state of the art accuracy across multiple data types (text, images, point clouds, and more). In this episode of the AlphaCare series, I'll explain how Perceiver works, and how we used it to improve accuracy scores for Cardiac video data. The EchoNet dataset was recently made public by Stanford University, and it contains 10K privatized heart videos from patients. We'll also discuss why Transformer networks work so well, and how by using 2 key features (Cross attention & positional embeddings), the Perceiver improved on all variants of Transformers. Get hype!
Big thanks to RapidAPI for sponsoring this video series:
rapidapi.com/hub?utm_source=Siraj-Raval&utm_medium=DevRel&utm_campaign=DevRel
Code & Coding Challenge:
github.com/llSourcell/AlphaCare/tree/main/Perceiver
Challenge Submission Link:
https://forms.gle/2DJkYts4HAfHMKpm8
More Learning Resources:
Perceiver explainer by Yannic Kilcher:
youtube.com/watch?v=P_xeshTnPZg&t=1365s
AlphaCare Episode 1 link:
youtu.be/fGv6VmfGMLc
Perceiver Explainer by AI Epiphany:
youtube.com/watch?v=WJWBq4NZfvY
MIT Video on CNNs:
youtube.com/watch?v=iaSUYvmCekI
Henry AI Labs Video on 3D CNNs:
youtube.com/watch?v=rcnKGMNyVu4
ECG Time Series Classification Video in PyTorch:
youtube.com/watch?v=qN3n0TM4Jno
Awesome list of papers + code on ECG Classification:
paperswithcode.com/task/ecg-classification
List of awesome materials on Deep Learning in healthcare:
github.com/XiaoleiZ/awesome-list-machine-learning-healthcare
Free EdX course on ML in Healthcare:
edx.org/course/machine-learning-for-healthcare
Andrew Ng's Free Deep Learning courses:
deeplearning.ai
Dr David Sinclair at Harvard Medical's Book that inspired me:
lifespanbook.com
My Math of Intelligence Playlist:
youtube.com/watch?v=xRJCOz3AfYY&list=PL2-dafEMk2A7mu0bSksCGMJEmeddU_H4D
Free Book on Intro to Statistical Learning:
statlearning.com
Follow me:
INSTAGRAM:
instagram.com/sirajraval
TWITTER:
twitter.com/sirajraval
FACEBOOK:
facebook.com/sirajologyyy
LINKEDIN:
linkedin.com/in/sirajraval
TIKTOK (i'll start posting soon):
tiktok.com/@sirajraval?lang=en
Please subscribe for more programming videos! That's what keeps me going. Join my AI community: chatgptschool.io Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available): https://www.wagergpt.xyz
