You are viewing content from a past/completed conference.
  
    
  
  
        
    
  
    
      
  
What is Derived Data? (And do You Already Have Any?)
    
  
    
      
	
	
	
	
	
		
		
	
	
		
			
				
					
					                    Abstract
					
						There is a growing trend of databases specializing in derived data ingestion and serving. They complement more traditional “primary data” (or “source of truth”) systems. This talk proposes a new vocabulary for navigating the evolving landscape of data systems and exploring their tradeoffs.
Besides explaining what derived data is, we will also dive into four major use cases which fit in the derived data bucket, including: graphs, search, OLAP and ML feature storage. We will explore the systems which support these use cases at LinkedIn, including open source solutions such as Pinot, which powers Who Viewed My Profile, and Venice, which powers People You May Know.
					 
					
						
					
					
					Speaker
     
    
    
            Felix GV
      Principal Staff Engineer @LinkedIn
          
    Felix joined LinkedIn's data infrastructure team in 2014, first working on Voldemort, the predecessor of Venice. Over the years, Felix participated in all phases of the development lifecycle of Venice, from requirements gathering and architecture, to implementation, testing, roll out, integration, stabilization, scaling and maintenance.
      Find
      Felix GV
      at:
    
    
       
 
 
				
			 
		 
	
			
			
				From the same track
				
					
    
        Session
        consistency
        Eventual Consistency – Don’t Be Afraid!
        Monday Mar 27 / 10:35AM BST
        
            
            Distributed data-intensive systems are increasingly designed to be only eventually consistent.
      
        
        	
		 
		
			Susanne Braun
			Principal Tech Lead @SAPSignavio
		 
	 
 
        Eventual Consistency – Don’t Be Afraid!
     
 
    
        Session
        cloud native
        The Commoditization of the Software Stack: How Application-first Cloud Services are Changing the Game
        Monday Mar 27 / 11:50AM BST
        
            
            The runtime boundaries between applications and the cloud are shifting from virtual machines to containers and functions. The integration boundaries are moving away from pure data access to one where the mechanical parts of the application are running within the cloud.
      
        
        	
		 
		
			Bilgin Ibryam
			Principal Product Manager @Diagrid, Co-author of “Kubernetes Patterns“, Previously Architect @RedHat
		 
	 
 
        The Commoditization of the Software Stack: How Application-first Cloud Services are Changing the Game
     
 
    
        Session
        OpenTelemetry
        Effective and Efficient Observability with OpenTelemetry
        Monday Mar 27 / 02:55PM BST
        
            
            Modern architectures require effective observability solutions to be able to monitor their health and understand how system changes affect operations distributed across multiple services.
      
        
        	
		 
		
			Daniel Gomez Blanco
			Principal Engineer @Skyscanner
		 
	 
 
        Effective and Efficient Observability with OpenTelemetry
     
 
    
        Session
        api
        Connecting the Dots: API Design in a Distributed World
        Monday Mar 27 / 04:10PM BST
        
            
            As we’ve gone from building monoliths to building microservices, the number of APIs we’ve got to manage has gone from just the database and front end, to at least one per service. 
      
        
        	
		 
		
			Ben Gamble
			Adviser, Architect & Speaker About Interactive Technology, Startups & Event Driven Systems
		 
	 
 
        Connecting the Dots: API Design in a Distributed World
     
 
    
        Session
        
        Unconference: Building Modern Backends
        Monday Mar 27 / 01:40PM BST
        
            
            What is an unconference?
An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions.
      
        
        	
		 
		
			Shane Hastie
			Global Delivery Lead @SoftEd, Lead Editor for Culture & Methods @InfoQ
		 
	 
 
        Unconference: Building Modern Backends