0

Paint by AI with GauGAN! #GAN #pytorch #machinelearning @NVIDIADesign @liu_mingyu

Left: Segmentation map (aka paint-style doodle). Right: Resulting GauGAN output.

 

With GauGAN you can transform segmentation maps (paint-style doodles) into beautiful landscape pictures. The demo was announced on Twitter  last month by Ming-Yu Liu. GauGAN was created using PyTorch deep learning framework and gets it’s name from the use of generative adversarial networks (GANs). The basic idea behind GANs is that two models compete, in this case one attempts to create a realistic image and a second tries to detect the fake images. The result is higher fidelity images with less training data.

Despite lacking an understanding of the physical world, GANs can produce convincing results because of their structure as a cooperating pair of networks: a generator and a discriminator. The generator creates images that it presents to the discriminator. Trained on real images, the discriminator coaches the generator with pixel-by-pixel feedback on how to improve the realism of its synthetic images.

The NVIDIA team has a great blog post about GauGAN and GANs, they are also giving talks this Sunday at SIGGRAPH about their work. To learn more take a look at their abstract or try implementing the code on GitHub.

Last but not least, here’s some more GauGAN fun:

Top-Left: Courthouse Towers from Arches National Park. Photo Credit: Rebecca Minich. Top-Right: Resulting segmentation map generated by GauGAN. Lower-Left: the realistic GauGAN generated picture. Lower-Right: Stylistic filter based on Leonid Afremov’s work ‘Mysterious Rain Princess’


Stop breadboarding and soldering – start making immediately! Adafruit’s Circuit Playground is jam-packed with LEDs, sensors, buttons, alligator clip pads and more. Build projects with Circuit Playground in a few minutes with the drag-and-drop MakeCode programming site, learn computer science using the CS Discoveries class on code.org, jump into CircuitPython to learn Python and hardware together, or even use Arduino IDE. Circuit Playground Express is the newest and best Circuit Playground board, with support for MakeCode, CircuitPython, and Arduino. It has a powerful processor, 10 NeoPixels, mini speaker, InfraRed receive and transmit, two buttons, a switch, 14 alligator clip pads, and lots of sensors: capacitive touch, IR proximity, temperature, light, motion and sound. A whole wide world of electronics and coding is waiting for you, and it fits in the palm of your hand.

Join 13,000+ makers on Adafruit’s Discord channels and be part of the community! http://adafru.it/discord

CircuitPython 2019!

Have an amazing project to share? The Electronics Show and Tell with Google Hangouts On-Air is every Wednesday at 7:30pm ET! To join, head over to YouTube and check out the show’s live chat – we’ll post the link there.

Join us every Wednesday night at 8pm ET for Ask an Engineer!

Follow Adafruit on Instagram for top secret new products, behinds the scenes and more https://www.instagram.com/adafruit/


Maker Business — Charitable business and the Buy-One Give-One angle

Wearables — Stitch marks

Electronics — Capacitor ESR

Biohacking — Vitamin-C + Gelatin for Accelerated Recovery

Python for Microcontrollers — The Top Programming Languages 2019 – Python tops the charts with a CircuitPython nod! #Python #Adafruit #CircuitPython #PythonHardware @circuitpython @micropython @ThePSF @Adafruit

Adafruit IoT Monthly — Adafruit IO Updates, RGB Stream Deck Message Panel, and more

Microsoft MakeCode — Welcome to the MakeCode Newsletter!

Get the only spam-free daily newsletter about wearables, running a "maker business", electronic tips and more! Subscribe at AdafruitDaily.com !



No Comments

No comments yet.

Sorry, the comment form is closed at this time.