Ribbit Network’s Automated Fleet of Distributed ‘Frogs’ Runs On Golioth
Ribbit Network sought a solution for managing a global fleet of low-powered microcontrollers efficiently. Traditional tech options weren't aligned with their IoT-centric goals.
Golioth empowered Ribbit Network to guarantee remote fleet management, critical for IoT deployments. It streamlined software updates and data transfer, facilitating scale and ensuring project viability.
Discovering Golioth, Ribbit Network quickly connected with the platform. Golioth's IoT infrastructure enabled seamless fleet management, including secure over-the-air updates.
Managing a Fleet of Microcontrollers isn’t Easy
In order to enable a world-wide fleet of citizen scientists, Ribbit Network was looking to develop a low-powered solar version of their air quality sensor. To do that, they had to switch from Raspberry Pi’s and BeagleBones to microcontrollers. As they built out the technology, they realized that while there are many solutions for managing fleets with full operating systems, there aren’t a lot of solutions for managing low-powered microcontrollers (MCU).
“We were desperately looking around for solutions that could manage a fleet of microcontrollers. We even asked ourselves if we should write our own thing. We really didn’t want to do that because it’s a ton of work that would distract us from our mission,” explains Johnson, “So we literally typed ‘microcontroller fleet management’ into Google and stumbled across Golioth.”
While there were other options to build out infrastructure with bigger tech players, the Ribbit Network team felt strongly that they didn’t want to invest in technologies that weren’t aligned with IoT at their core. “It’s extremely risky to pick a fundamental piece of technology and use a company where the core business is not aligned with keeping that piece of technology around,” Johnson continues, “Google IoT and Amazon AWS has their own flavor for IoT but on top of being ultra expensive, their products are often confusing. And because the core business lacks focus on IoT, it’s highly likely they will stop investing in that product. In fact, that’s exactly what happened with Google IoT.”
Ribbit Network was able to connect with the Golioth team quickly, once they identified that someone was building something to solve that problem.
Production-Ready Infrastructure for a Distributed Fleet
In order for the low-powered solar MCU version of the product to work, Ribbit Network needed to guarantee that they could manage their fleet remotely. “For us the gatekeeping factor in building the microcontroller based version of the product was figuring out fleet management. We had a rudimentary version of one put together, and we knew that our core idea would work on a microcontroller. But we couldn’t proceed until we had fleet management,” says Johnson. “I think that is probably a common story for any actual product that you want to deploy in the year 2023. You do not want to send something out unless you can securely update the software on it.”
“What drew us to Golioth initially was the idea of having all the infrastructure and framework to send software updates to a fleet of devices automatically and securely. That is not something that we wanted to build the infrastructure to do and is really critical for any IoT fleet,” Johnson continues, “We were already operating a fleet that was above the scale where we could manually manage devices. So, we didn’t want to be going around and as new devices come on board, we’d have to force our users to update them manually or check in to see if there are updates. The workflow that we have, we really want to just publish software, and let the fleet handle itself from our perspective.”
“Our first impression with Golioth was ‘this fits exactly what we need’. The next best plan that we had at the time was this solution that someone was building on our side, which was not going to work very well. We didn’t have the time to factor in all the considerations for a fully-featured production platform. We were planning to accept technical debt, just to move it forward, and hopefully fix it later. Which is not a great plan, but it’s not uncommon.”
“Having all the infrastructure and framework to send over the air updates automatically and securely is really critical.”
Unexpected Features and Helpful Support Along the Way
“We started off with just a few test units and the Golioth free trial. We’re working on ESP32-based microcontrollers and there was a really good quickstart from Golioth. We got up and running with the ESP IDF Golioth integration, which works really well. We did a bunch of testing: what if you pull the power to the device while it’s updating? Or, while it’s downloading the update? That’s a really common failure mode that is not good for a lot of IoT devices. But it all worked beautifully. Because of the way that partitioning, like all works out, it was pretty obvious that Golioth was well designed and thoughtful.”
The Ribbit Network team uses the Golioth platform to manage all the software updates on their schedule. “You can’t guarantee that devices are always on all the time when you push the update. So you need a service where–as devices are turning on and off and doing their thing out in the wild–they are still able to update.” Their design works such that if one of the Ribbit Network sensors comes online and sees that the software has been updated, it will apply the update on itself, without requiring the aid of a human.
“Executing remote firmware updates in a really robust and secure way is certainly non trivial to do. That’s a lot of software and testing. That is not our core competency, and we don’t really want it to be because there are other great folks already doing it. And so we’d much rather just use a tool that works well like Golioth.” Johnson explains.
Once the Ribbit Network finalized their hardware design, they shifted their fleet into production. “One of the things that we’ve done–which is really great–is we’ve got a nice, continuous integration system. So when we push code to our GitHub, it pushes a build automatically to Golioth, and deploys that to our fleet automatically,” Johnson goes on to elaborate, “So we use the Golioth CLI and their API for that. We really have very little DevOps related to the IoT fleet. We have engineers writing code, and then it just sort of permeates itself out to the fleet once it’s ready. We don’t really have to think about it ever, which is ideal.”
Johnson explains, “I think one of the worst feelings you get with a new tool or piece of software is when there’s limited support. I think that’s a really common story. For a lot of enterprise software it’s very difficult to figure out who I ask or to get some directional sense of the right way to be thinking about this small question that I have,” he continues, “Golioth was pretty supportive the whole way. The communities around Golioth on Discord and on the forums are super active. And the folks in the team are very helpful. We definitely had a lot of questions in the beginning–there were some early ESP IDF integration challenges that we had.”
“One of the things that we hadn’t really thought too much about is the LightDB Stream process. It’s actually a Golioth feature that we’ve started using quite a lot in addition to fleet updates. Moving the data off the devices was not really a problem we initially were looking for a solution to solve because we knew some ways to do that, and had considered how it was going to happen,” Johnson continues, “But Golioth’s service has ended up being really useful. So now that’s the primary way that we move our IoT data off the device, as well as we use LightDB Stream. We transfer it via webhooks on the Golioth side out into our actual databases. And that has ended up being vastly simpler than what we were doing before, because we can use one set of authentication keys between the device and the web. Before, we had one set of authentication for fleet management and then we had a different set of authentication for device data. And anytime you have multiple sets of those authentication combinations running around, it just increases your vectors for messing things up. But Golioth’s authentication solution is simpler and it’s probably the thing that we enjoy the most about Golioth.”
.svg)