Face Mesh Detection with ml5.js @TheCodingTrain
Face Mesh Detection with ml5.js  @TheCodingTrain
Uploaded November 2024 | Updated November 2026, 11 hours ago
In this video, I explore the FaceMesh model using ml5.js. I demonstrate how to track all 468 face landmark positions as well as texture map an image onto the triangular mesh with uv coordinates. Code: thecodingtrain.com/tracks/ml5js-beginners-guide/ml5/facemesh

πŸš€ Watch this video ad-free on Nebula nebula.tv/videos/codingtrain-facemesh-with-ml5js

p5.js Web Editor Sketches:
πŸ•ΉοΈ FaceMesh - Keypoints: editor.p5js.org/codingtrain/sketches/KHm9CI2RJ
πŸ•ΉοΈ FaceMesh - Part: editor.p5js.org/codingtrain/sketches/HaGkT63qG
πŸ•ΉοΈ FaceMesh - Custom List (Lips): editor.p5js.org/codingtrain/sketches/CYL9bQtvc
πŸ•ΉοΈ FaceMesh - Centered Face: editor.p5js.org/codingtrain/sketches/DGEuFKf87
πŸ•ΉοΈ FaceMesh - Triangles: editor.p5js.org/codingtrain/sketches/EjIrb89WY
πŸ•ΉοΈ FaceMesh - Texture Map: editor.p5js.org/codingtrain/sketches/zUKp9n4MW
πŸ•ΉοΈ FaceMesh - 3D: editor.p5js.org/codingtrain/sketches/zUKp9n4MW
πŸ•ΉοΈ FaceMesh - Blow Bubbles: editor.p5js.org/codingtrain/sketches/Mf74RjP92
πŸ•ΉοΈ FaceMesh - Stretch and Skew: editor.p5js.org/codingtrain/sketches/tS6bxPzmE

πŸŽ₯ Previous: youtu.be/vfNHdVbE-l4?list=PLRqwX-V7Uu6YPSwT06y_AEYTqIwbeam3y
πŸŽ₯ Next: youtu.be/2h8VArJ3gnQ?list=PLRqwX-V7Uu6YPSwT06y_AEYTqIwbeam3y
πŸŽ₯ All: youtube.com/playlist?list=PLRqwX-V7Uu6YPSwT06y_AEYTqIwbeam3y

References:
πŸ’» ml5.js: ml5js.org
🎹 Mouth Controlled Synteszier: jackbdu.com/blog/mouth-controlled-synthesizer
πŸ“„ Face and hand tracking in the browser with MediaPipe and TensorFlow.js: blog.tensorflow.org/2020/03/face-and-hand-tracking-in-browser-with-mediapipe-and-tensorflowjs.html
πŸ“„ Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs: arxiv.org/pdf/1907.06724
πŸ“„ Face Mesh Model Card: drive.google.com/file/d/1VFC_wIpw4O7xBOiTgUldl79d9LA-LsnA/view
β–΅ Face Mesh UV Keypoints Map: developers.google.com/static/ml-kit/vision/face-mesh-detection/images/uv_unwrap_full.png
πŸ“„ Destructuring Assignment: developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Operators/Destructuring_assignment
☁️ Clouds From Plane Window: en.wikipedia.org/wiki/File:Cloud_From_Plane_Window.jpg

Videos:
πŸŽ₯ youtu.be/FlBRSIz5AcQ
πŸš‚ youtu.be/nMUMZ5YRxHI

Related Coding Challenges:
πŸš‚ youtu.be/Bxdt6T_1qgc
πŸš‚ youtu.be/JunJzIe0hEo

Timestamps:
0:00 Introduction
1:15 Technical background for the model
2:30 Related projects and inspiration.
3:01 Adapting handpose example to facemesh.
5:29 Keypoints and parts of the facemesh.
11:28 Face bounding box.
13:36 What is a mesh? Rendering the triangles
21:19 Texturing mapping with UV coordinates
30:48 FaceMesh in 3D
31:10 Goodbye!

Editing by Mathieu Blanchette
Animations by Jason Heglund
Music from Epidemic Sound

πŸš‚ Website: thecodingtrain.com
πŸ‘Ύ Share Your Creation! thecodingtrain.com/guides/passenger-showcase-guide
🚩 Suggest Topics: github.com/CodingTrain/Suggestion-Box
πŸ’‘ GitHub: github.com/CodingTrain
πŸ’¬ Discord: thecodingtrain.com/discord
πŸ’– Membership: youtube.com/thecodingtrain/join
πŸ›’ Store: standard.tv/codingtrain
πŸ–‹οΈ Twitter: twitter.com/thecodingtrain
πŸ“Έ Instagram: instagram.com/the.coding.train

πŸŽ₯ youtube.com/playlist?list=PLRqwX-V7Uu6ZiZxtDDRCi6uhfTH4FilpH
πŸŽ₯ youtube.com/playlist?list=PLRqwX-V7Uu6Zy51Q-x9tMWIv9cueOFTFA

πŸ”— p5.js: p5js.org
πŸ”— p5.js Web Editor: editor.p5js.org
πŸ”— Processing: processing.org

πŸ“„ Code of Conduct: github.com/CodingTrain/Code-of-Conduct

This description was auto-generated. If you see a problem, please open an issue: github.com/CodingTrain/thecodingtrain.com/issues/new

#machinelearningml #facemesh #ml5js #texture #uvcoordinates #ml5js #javascript
Face Mesh Detection with ml5.jsLava Lamp #genuary #genuary12A Banner of Unnecessary DetailExploring Transformers.js Embeddings and Other UpdatesCoding Challenge 160: Spring ForcesThe mouse sees: A collaborative zine for the Computer Mouse Conference (Night 2)Coding Train Live: Autoencoders Part 2Coding Train Live!2.3: Incrementation Operators - p5.js TutorialPose Estimation with ml5.jsSide Project Sunday?Coding TRAIN WRECK: Bayesian Text Classification
The Coding Train |

Face Mesh Detection with ml5.js

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER