Making a face-controlled computer with Python #Python #ML #AI
CheekyKeys uses Python + OpenCV so you can code with your face.
CheekyKeys uses OpenCV and MediaPipe’s Face Mesh to perform real-time detect of facial landmarks from video input. From there, relative differences are calculated to determine specific facial gestures and translate those into commands sent via keyboard.
This version 0.1 is hardcoded to my facial features, but thresholds can easily be modified. It’s also built for a Mac keyboard, but you can also swap i.e. Windows key for Command simply enough.
The primary input is to “type” letters, digits, and symbols via Morse code by opening and closing your mouth quickly for . and slightly longer for -. Rather than waiting a set time after every letter, you scrunch your mouth upward once to finish a letter, or twice to add a space (end a word). Three mouth scrunches types enter/return.
See the video below and the GitHub repo for more including the code.
Have an amazing project to share? The Electronics Show and Tell is every Wednesday at 7:30pm ET! To join, head over to YouTube and check out the show’s live chat and our Discord!
Python for Microcontrollers – Adafruit Daily — Python on Microcontrollers Newsletter: A New Arduino MicroPython Package Manager, How-Tos and Much More! #CircuitPython #Python #micropython @ThePSF @Raspberry_Pi
EYE on NPI – Adafruit Daily — EYE on NPI Maxim’s Himalaya uSLIC Step-Down Power Module #EyeOnNPI @maximintegrated @digikey