Fast Eventual Consistency: Inside Corrosion, the Distributed System Powering Fly.io

This talk explores Corrosion, an open-source solution built on SQLite that delivers fast, eventually consistent replication across distributed nodes. Initially developed at Fly to replace Consul for service discovery, Corrosion has evolved to power the platform, enabling the rapid dissemination of machine and service data across numerous nodes with a p99 latency of one second. Leveraging technologies such as Conflict-free Replicated Data Types (CRDTs) for conflict resolution, the SWIM gossip protocol for membership management, and the QUIC transport protocol, Corrosion is implemented in Rust and is open-source. In this talk, we will explore these technologies, dive into architectural and design decisions, and discuss how Corrosion is used in production at Fly. Whether you're familiar with these concepts or they're new to you, join us for an in-depth look at Corrosion.


Speaker

Somtochi Onyekwere

Software Engineer @fly.io, Previously Developer Experience Engineer @Weaveworks

InfraOps Engineer at Fly.io. Currently working on distributed systems and networking software. Previously worked on Kubernetes @Weavework

Read more
Find Somtochi Onyekwere at:

From the same track

Session augmented reality

Developing Meta's Orion AR Glasses

Monday Apr 7 / 11:45AM BST

Meta announced the Orion AR Glasses in September 2024. It is a time machine to demonstrate that it's possible to build an immersive augmented reality experience in a glasses form-factor. There were numerous technical challenges to make this a reality.

Speaker image - Jinsong Yu

Jinsong Yu

Software Engineer @Meta, Led the Development of Orion AR Glasses Software Stack, Previously @Google and @Microsoft

Session AI/ML

Lessons Learned From Building LinkedIn’s First Agent: Hiring Assistant

Monday Apr 7 / 05:05PM BST

In October 2024, we announced LinkedIn’s first agent, Hiring Assistant to a select group of LinkedIn customers.

Speaker image - Karthik Ramgopal

Karthik Ramgopal

Distinguished Engineer & Tech Lead of the Product Engineering Team @LinkedIn, 15+ Years of Experience in Full-Stack Software Development

Speaker image - Daniel Hewlett

Daniel Hewlett

Principal AI Engineer & Technical Lead for AI @LinkedIn, 12+ Years of Expierence in ML and AI Engineering, Previously @Google

Session architecture

Architecture in the Lead: Scaling Today, Shaping Tomorrow

Monday Apr 7 / 10:35AM BST

The BBC’s websites and apps handled well over 100 million visitors in 2024, with 40 million people arriving on UK Election night alone. That’s a lot of scale for an architecture to handle, but it’s just the beginning.

Speaker image - Matthew Clark

Matthew Clark

Head Of Architecture for the @BBC's Digital Products, 25+ Years Developing Online Software

Speaker image - Ian Arundale

Ian Arundale

Lead Architect for the @BBC's Digital Products, 20+ Years in Software Engineering

Session AWS serverless

Kraken's Serverless Architecture for Keeping the Grid Green

Monday Apr 7 / 02:45PM BST

The green energy transition is real, and happening, but it needs technology to make it successful. Everything from renewable energy generation onto the grid, to how consumers use energy, needs technology to be effective and keep up with today's demands.

Speaker image - Kevin Bowman

Kevin Bowman

Platform Engineering @KrakenTech (Octopus Energy), Previously @SkyBet and Others, Passionate About Removing Friction From Getting Stuff Successfully Into Production

Session

Connecting the Dots: Architectures (Limited Space - Registration Required)

Monday Apr 7 / 01:35PM BST