Real-Time Gesture Tracking for Mobile #MediaPipe #HandLandmark #SignLanguage #MachineLearning #AI #TensorFlow lite @GoogleAI

Gesture Tracking from Google AI Blog: On-Device, Real-Time Hand Tracking with MediaPipe

 

MediaPipe is an open source framework for processing perceptual data. They recently announced real-time hand tracking for mobile applications. You can imagine the fun that could be had with gesture interpretation (hearts, peace fingers, etc.) as well as more practical applications like sign language interpretation. The pipeline involves a detector model, hand landmark model and the gesture interpreter that classifies gestures:

* A palm detector model (called BlazePalm) that operates on the full image and returns an oriented hand bounding box.
* A hand landmark model that operates on the cropped image region defined by the palm detector and returns high fidelity 3D hand keypoints.
* A gesture recognizer that classifies the previously computed keypoint configuration into a discrete set of gestures.

The hope is that this technology will be used for new and creative solutions in the developer community. If you’d like to learn more about hand tracking with MediaPipe check out their GitHub and hand tracking code base.


Have an amazing project to share? The Electronics Show and Tell is every Wednesday at 7:30pm ET! To join, head over to YouTube and check out the show’s live chat and our Discord!

Join us every Wednesday night at 8pm ET for Ask an Engineer!

Join over 38,000+ makers on Adafruit’s Discord channels and be part of the community! http://adafru.it/discord

CircuitPython – The easiest way to program microcontrollers – CircuitPython.org


New Products – Adafruit Industries – Makers, hackers, artists, designers and engineers! — New Products 11/15/2024 Featuring Adafruit bq25185 USB / DC / Solar Charger with 3.3V Buck Board! (Video)

Python for Microcontrollers – Adafruit Daily — Python on Microcontrollers Newsletter: A New Arduino MicroPython Package Manager, How-Tos and Much More! #CircuitPython #Python #micropython @ThePSF @Raspberry_Pi

EYE on NPI – Adafruit Daily — EYE on NPI Maxim’s Himalaya uSLIC Step-Down Power Module #EyeOnNPI @maximintegrated @digikey

Adafruit IoT Monthly — The 2024 Recap Issue!

Maker Business – Adafruit Daily — Apple to build another chip at TSMC Arizona

Electronics – Adafruit Daily — SMT Tip – Stop moving around!

Get the only spam-free daily newsletter about wearables, running a "maker business", electronic tips and more! Subscribe at AdafruitDaily.com !


No Comments

No comments yet.

Sorry, the comment form is closed at this time.