Jller Robot Analyzes Pebbles with Computer Vision, Sorts Them Into Geologic Taxonomies

Jller is part of an ongoing research project in the fields of industrial automation and historical geology. It is an apparatus, that sorts pebbles from a specific river by their geologic age. The stones were taken from the stream bed of the German river Jller, shortly before it merges with the Danube, close to the city of Ulm. The machine and its performance is the first manifestation of this research.

A set of pebbles from the Jller are placed on the 2×4 meter platform of the machine, which automatically analyzes the stones in order to then sort them. The sorting process happens in two steps: Intermediate, pre-sorted patterns are formed first, to make space for the final, ordered alignment of stones, defined by type and age. Starting from an arbitrary set of stones, this process renders the inherent history of the river visible.

The history, origin and path from each stone found in a river is specific to the location, as every river has a different composition of rock types. The origin of those stones is well documented. For instance, the ones from the river Jller derive from two origins. Some come from rocks, that are the result of erosions in the Alps and are carried in from smaller rivers. Other stones have been ground and transported by glaciers that either still exist, or existed in the ice ages. As the Alps and flats, that were once covered by glaciers, have shifted, even deeper rock-layers were moved and as a result, stones from many geologic periods make their way into a river.

When the history of a river is known, the type of stone can be directly related to its geological age. One very common sedimentary rock is the dark grey limestone from the Triassic period (225 million years ago). It was formed from the layers of sediments in the primeval ocean. Granodiorite, on the other hand, is an igneous rock of volcanic origin from the Tertiary Period (30 to 40 million years ago). Between those types there is a variety of metamorphic rocks, created by the transformation of existing rock types through the influence of temperature and pressure over time. Furthermore, a small amount of pebbles are formed by non-rock materials like red brick or slag, that have their origin in the Anthropocene.

Most of the time, stones do not appear as a singular uniform material, but as a composition of different, laminated or layered materials. A prominent example of his are the white lines of lime in grey pebbles.

Jller was presented as part of Ignorance, a collaborative exhibition of German artist Benjamin Maus and Czech artist Prokop Bartoníček.

Technology: The machine works with a computer vision system that processes the images of the stones and maps each of its location on the platform throughout the ordering process. The information extracted from each stone are dominant color, color composition, and histograms of structural features such as lines, layers, patterns, grain, and surface texture. This data is used to assign the stones into predefined categories. Those categories represent the range of stones that can be found in the specific river and correspond directly to the age of the stone. They are the result of a classification system that is trained by sets of manually selected and labeled stones. Because there are only a limited number of stone types that can be found in a specific river, this system proves to be very accurate.

The stones get picked up by an industrial vacuum gripper, which can rotate around its own axis. This way the pebbles can also be aligned.


Adafruit publishes a wide range of writing and video content, including interviews and reporting on the maker market and the wider technology world. Our standards page is intended as a guide to best practices that Adafruit uses, as well as an outline of the ethical standards Adafruit aspires to. While Adafruit is not an independent journalistic institution, Adafruit strives to be a fair, informative, and positive voice within the community – check it out here: adafruit.com/editorialstandards

Join Adafruit on Mastodon

Adafruit is on Mastodon, join in! adafruit.com/mastodon

Stop breadboarding and soldering – start making immediately! Adafruit’s Circuit Playground is jam-packed with LEDs, sensors, buttons, alligator clip pads and more. Build projects with Circuit Playground in a few minutes with the drag-and-drop MakeCode programming site, learn computer science using the CS Discoveries class on code.org, jump into CircuitPython to learn Python and hardware together, TinyGO, or even use the Arduino IDE. Circuit Playground Express is the newest and best Circuit Playground board, with support for CircuitPython, MakeCode, and Arduino. It has a powerful processor, 10 NeoPixels, mini speaker, InfraRed receive and transmit, two buttons, a switch, 14 alligator clip pads, and lots of sensors: capacitive touch, IR proximity, temperature, light, motion and sound. A whole wide world of electronics and coding is waiting for you, and it fits in the palm of your hand.

Have an amazing project to share? The Electronics Show and Tell is every Wednesday at 7pm ET! To join, head over to YouTube and check out the show’s live chat – we’ll post the link there.

Join us every Wednesday night at 8pm ET for Ask an Engineer!

Join over 36,000+ makers on Adafruit’s Discord channels and be part of the community! http://adafru.it/discord

CircuitPython – The easiest way to program microcontrollers – CircuitPython.org


Maker Business — “Packaging” chips in the US

Wearables — Enclosures help fight body humidity in costumes

Electronics — Transformers: More than meets the eye!

Python for Microcontrollers — Python on Microcontrollers Newsletter: Silicon Labs introduces CircuitPython support, and more! #CircuitPython #Python #micropython @ThePSF @Raspberry_Pi

Adafruit IoT Monthly — Guardian Robot, Weather-wise Umbrella Stand, and more!

Microsoft MakeCode — MakeCode Thank You!

EYE on NPI — Maxim’s Himalaya uSLIC Step-Down Power Module #EyeOnNPI @maximintegrated @digikey

New Products – Adafruit Industries – Makers, hackers, artists, designers and engineers! — #NewProds 7/19/23 Feat. Adafruit Matrix Portal S3 CircuitPython Powered Internet Display!

Get the only spam-free daily newsletter about wearables, running a "maker business", electronic tips and more! Subscribe at AdafruitDaily.com !



No Comments

No comments yet.

Sorry, the comment form is closed at this time.