AI Engineering

Engineering with AI is no longer about proving capability. It is about ensuring reliability. While LLMs offer immense potential, their non-deterministic nature creates a significant gap between a successful PoC and an enterprise-grade application. 


This track focuses on the engineering fundamentals required to bridge that gap. We move past the hype to explore the tools, techniques, and architectural patterns needed to design, build, and maintain scalable AI-native systems.


What you will learn

  • Production Patterns for AI Agents: Practical methods to move agents from promising automation to reliable enterprise tools.
  • Evaluation & Assessment Frameworks: How to measure and validate non-deterministic systems in production environments.
  • Scaling AI-Native Architecture: Blueprints for integrating AI into the full software lifecycle without compromising system stability.
  • Strategic Investment Guidance: Frameworks for technical leaders to decide when, where, and how to invest in emerging AI technologies.


Why this matters now 
Roadmaps are rapidly adding AI-assisted features, but delivery velocity is often throttled by concerns over safety and reliability. This track provides the practitioner-led patterns to de-risk your AI implementation and turn experimental models into durable, production-ready systems.
 


From this track

Session

Beyond Context Windows: Building Cognitive Memory for AI Agents

AI agents are rapidly changing how users interact with software, yet most agentic systems today operate with little to no intelligent memory, relying instead on brittle context-window heuristics or short-term state.

Speaker image - Karthik Ramgopal

Karthik Ramgopal

Distinguished Engineer & Tech Lead of the Product Engineering Team @LinkedIn, 15+ Years of Experience in Full-Stack Software Development

Session

Refreshing Stale Code Intelligence

Coding models are helping software developers move even faster than ever before, but weirdly, they’re not keeping up with our fast progress. The models that power code generation are often based on months to years old snapshots of open source code.

Speaker image - Jeff Smith

Jeff Smith

CEO & Co-Founder @ 2nd Set AI, AI Engineer, Researcher, Author, Ex-Meta/FAIR

Session

Beyond the Demo: RAG is Easy, Production RAG is Not

Everyone is building RAG systems now. But few are building reliable retrieval systems.

Speaker image - Lan Chu

Lan Chu

AI Tech Lead and Senior Data Scientist

Track Host

Hien Luu

Sr. Engineering Manager @Zoox & Author of MLOps with Ray, Speaker and Conference Committee Chair

Hien Luu is a Sr. Engineering Manager at Zoox, leading the Machine Learning Platform team. He is particularly passionate about building scalable AI/ML infrastructure to power real-world applications. He is the author of MLOps with Ray and the Beginning Apache Spark 3 book. He has given presentations at various conferences such as MLOps World, QCon (SF,NY, London), GHC 2022, Data+AI Summit, XAI 21 Summit, YOW Data!, appy()

Read more
Find Hien Luu at: