Skip to main content
AmigoFish

Hand Pose Detection with ml5.js

From The Coding Train Β· Β· 15 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

In this video, I explore the HandPose model using ml5.js. I'll demonstrate how to track hand keypoints and create an interactive painting sketch using gestures. Code: https://thecodingtrain.com/tracks/ml5js-beginners-guide/ml5/hand-pose

πŸš€ Watch this video ad-free on Nebula https://nebula.tv/videos/codingtrain-hand-pose-detection-with-ml5js

p5.js Web Editor Sketches: πŸ•ΉοΈ HandPose - Keypoints: https://editor.p5js.org/codingtrain/sketches/o5wnL6esQ πŸ•ΉοΈ HandPose - Painting: https://editor.p5js.org/codingtrain/sketches/LCEHJm6PA πŸ•ΉοΈ Simple painting: https://editor.p5js.org/codingtrain/sketches/3VcKxx_GY πŸ•ΉοΈ HandPose Painting - Stroke Weight: https://editor.p5js.org/codingtrain/sketches/-C3Og5Wzs πŸ•ΉοΈ HandPose Painting - Color: https://editor.p5js.org/codingtrain/sketches/InzaVXI-R πŸ•ΉοΈ HandPose - Thumbs up or Thumbs Down: https://editor.p5js.org/codingtrain/sketches/0_qPHtsF_ πŸ•ΉοΈ HandPose - Particles: https://editor.p5js.org/codingtrain/sketches/t7l5pYDDI

πŸŽ₯ Previous: https://youtu.be/T99fNXTUUaQ?list=PLRqwX-V7Uu6YPSwT06y_AEYTqIwbeam3y πŸŽ₯ Next: https://youtu.be/2h8VArJ3gnQ?list=PLRqwX-V7Uu6YPSwT06y_AEYTqIwbeam3y πŸŽ₯ All: https://www.youtube.com/playlist?list=PLRqwX-V7Uu6YPSwT06y_AEYTqIwbeam3y

References: πŸ’» ml5.js: https://ml5js.org/ 🏫 Introduction to ML for the Arts: https://github.com/ml5js/Intro-ML-Arts-IMA-F24 πŸ“Ί Jack B. Du's YouTube channel: https://www.youtube.com/channel/UCUP34ETx7nvIbd4ypkR02hg 🎨 Jack B. Du's Instagram: https://www.instagram.com/jackbdu/ πŸ’» On-Device, Real-Time Hand Tracking with MediaPipe: https://research.google/blog/on-device-real-time-hand-tracking-with-mediapipe/ πŸ“„ 3D Hand Pose with MediaPipe and TensorFlow.js: https://blog.tensorflow.org/2021/11/3D-handpose.html

Timestamps: 0:00 Introduction 1:23 Technical background of the model 3:52 Convert BodyPose to HandPose 5:54 Detecting more than one hand 6:14 Detecting handedness (left or right) 6:51 Creating a painting sketch with index and thumb 10:19 Add a layer using createGraphics() 12:40 Storing previous hand position to draw a line 14:17 Exercise ideas for you! 15:27 Goodbye!

Editing by Mathieu Blanchette Animations by Jason Heglund Music from Epidemic Sound

πŸš‚ Website: https://thecodingtrain.com/ πŸ‘Ύ Share Your Creation! https://thecodingtrain.com/guides/passenger-showcase-guide 🚩 Suggest Topics: https://github.com/CodingTrain/Suggestion-Box πŸ’‘ GitHub: https://github.com/CodingTrain πŸ’¬ Discord: https://thecodingtrain.com/discord πŸ’– Membership: http://youtube.com/thecodingtrain/join πŸ›’ Store: https://standard.tv/codingtrain πŸ–‹οΈ Twitter: https://twitter.com/thecodingtrain πŸ“Έ Instagram: https://www.instagram.com/the.coding.train/

πŸŽ₯ https://www.youtube.com/playlist?list=PLRqwX-V7Uu6ZiZxtDDRCi6uhfTH4FilpH πŸŽ₯ https://www.youtube.com/playlist?list=PLRqwX-V7Uu6Zy51Q-x9tMWIv9cueOFTFA

πŸ”— p5.js: https://p5js.org πŸ”— p5.js Web Editor: https://editor.p5js.org/ πŸ”— Processing: https://processing.org

πŸ“„ Code of Conduct: https://github.com/CodingTrain/Code-of-Conduct

This description was auto-generated. If you see a problem, please open an issue: https://github.com/CodingTrain/thecodingtrain.com/issues/new

#machinelearningml #webcam #posedetection #ml5js #handpose #ml5js #javascript

Back to The Coding Train Β· Report a problem