BodyPix 2.0 – Person Segmentation in the Browser #tensorflow #machinelearning #deeplearning @tylerzhu3 @oveddan
The release of BodyPix 2.0 was announced on the TensorFlow blog this week. It boasts improved accuracy and multiperson support. The BodyPix model is open source and is able to do realtime mapping of a person into 24 segments. The model is based on the ResNet-50 model which is a convolutional neural network trained on images from the ImageNet database.
BodyPix 2.0 has applications in augmented reality, photography, and video editing. The new release has a live in-browser demo using TensorFlow.js. Take a look at the example above and give it a try! Having access to the browser increases accessibility removing the need for costly hardware. All you need is internet and a webcam:
Why would you want to do this in the browser? Similar to the case of PoseNet, real-time person segmentation was only possible to do before with specialized hardware or hard-to-install software with steep system requirements. Instead both BodyPix and PoseNet can be used without installation and just a few lines of code. You don’t need any specialized lenses to use these models — they work with any basic webcam or mobile camera.
If you would like to learn more check out the project repo on GitHub!
Written by Rebecca Minich, Product Analyst in Data Science at Google. Opinions expressed are solely my own and do not express the views or opinions of my employer.
Stop breadboarding and soldering – start making immediately! Adafruit’s Circuit Playground is jam-packed with LEDs, sensors, buttons, alligator clip pads and more. Build projects with Circuit Playground in a few minutes with the drag-and-drop MakeCode programming site, learn computer science using the CS Discoveries class on code.org, jump into CircuitPython to learn Python and hardware together, TinyGO, or even use the Arduino IDE. Circuit Playground Express is the newest and best Circuit Playground board, with support for CircuitPython, MakeCode, and Arduino. It has a powerful processor, 10 NeoPixels, mini speaker, InfraRed receive and transmit, two buttons, a switch, 14 alligator clip pads, and lots of sensors: capacitive touch, IR proximity, temperature, light, motion and sound. A whole wide world of electronics and coding is waiting for you, and it fits in the palm of your hand.