Abstract
Date
Tuesday Mar 17 / 05:05PM GMT ( 50 minutes )
Location
Rutherford (4th Fl.)
Video
Video is not available
Slides
Slides are not available
Connecting the Dots: Modern Data Engineering & Architectures (Limited Space - Registration Required)
From the same track
Session
Kafka
Introducing Tansu.io -- Rethinking Kafka for Lean Operations
Tuesday Mar 17 / 01:35PM GMT
What if Kafka brokers were ephemeral, stateless and leaderless with durability delegated to a pluggable storage layer?
Peter Morgan
Founder @tansu.io
Session
Machine Learning Infrastructure
From S3 to GPU in One Copy: Rethinking Data Loading for ML Training
Tuesday Mar 17 / 11:45AM GMT
ML training pipelines treat data as static. Teams spend weeks preprocessing datasets into WebDataset or TFRecords, and when they want to experiment with curriculum learning or data mixing, they reprocess everything from scratch.
Onur Satici
Staff Engineer @SpiralDB & a Core Maintainer of Vortex (LF AI & Data), Previously Building Distributed Systems @Palantir
Session
streaming
The Rise of the Streamhouse: Idea, Trade-Offs, and Evolution
Tuesday Mar 17 / 03:55PM GMT
Over the last decade, streaming architectures have largely been built around topic-centric primitives—logs, streams, and event pipelines—then stitched together with databases, caches, OLAP engines, and (increasingly) new serving systems.
Giannis Polyzos
Principal Streaming Architect @Ververica
Anton Borisov
Principal Data Architect @Fresha
Session
Generative AI
Ontology‐Driven Observability: Building the E2E Knowledge Graph at Netflix Scale
Tuesday Mar 17 / 10:35AM GMT
As Netflix scales hundreds of client platforms, microservices, and infrastructure components, correlating user experience with system performance has become a hard data problem, not just an observability one.
Prasanna Vijayanathan
Engineer @Netflix
Renzo Sanchez-Silva
Engineer @Netflix
Session
Chronon - Mixed-Workload Data Processing Framework
Tuesday Mar 17 / 02:45PM GMT
Chronon is a data processing framework open-sourced by Airbnb. It is adopted across organizations like Stripe, Netflix, OpenAI, and Uber. Chronon was originally built for ML applications.
Nikhil Simha
Co-Founder & CTO @zipline.ai, Author of "Chronon Feature Platform", Previously @Airbnb, @Meta, and @Walmartlabs