Tutorial: Hands on with Apache Spark [Sold Out]
This tutorial is sold out.
Apache Spark is a new and exciting open source data processing engine and it is deemed as the next-generation successor of MapReduce. It was designed from the ground up to support streaming data processing, graph processing as well as complex iterative data processing. Apache Spark provides a nice abstraction of large data sets with the concept of Resilient Distributed Datasets (RDD) and elegant APIs to easily manipulate these large data sets.
This tutorial will cover the core concepts in Apache Spark and will include hands on exercises with using RDD APIs to solve common data processing problems. The exercises will be done using Apache Spark Scala APIs and therefore this tutorial will also cover the essential parts of Scala that are relevant to the exercises.
Here is what you can expect to learn from this tutorial:
- The basics of Scala
- Understand Apache Spark architecture, core concepts, programming model
- Using Spark shell for interactive data analysis
- Parallel programming with Spark RDD APIs
- Developing standalone Spark applications
- Developing Spark streaming applications
Target Audience
Architect and software engineers that are interested in big data processing
Hien Luu Elsewhere
Other Tutorials:
Tracks
Covering innovative topics
-
Architecture Improvements
Next gen architecture, Arch over the full lifecycle, Bleeding edge tech in legacy, Cognitive biases in architecture, Evolving Architecture.
-
Big Data Frameworks, Architectures, and Data Science
As big data tools and architectures continue to evolve, how do you architect and select technologies that work now but are also future-proof?
-
DevOps and Continuous Delivery: Code Beyond the Dev Team
As infrastructure becomes as malleable as code, a unified approach from reqs to ops is needed to deliver promised breakthroughs.
-
Engineering Culture
The best teams and companies talk about how to create amazing engineering cultures.
-
Java - Not Dead Yet
Java is evolving to meet developer and business needs, from lambdas in Java 8 to built-in support for money types rumoured for Java 9.
-
Mind Matters at Work
How theories from neuroscience and psychology can help us better understand IT professionals and discover what really motivates them.
-
Docker, containers and application portability
People building stuff for and with containers showing why application portability is important, and what can be done with expanding ecosystems.
-
Evolving agile
Reflecting on and learning from successes and failures in applying agile approaches since the creation of the Agile Manifesto and exploring ways of applying agile practices to increase business value.
-
HTML and JS Today
The state of the art in web technologies. What is important to know and why?
-
Internet of Things
What software devs need to know to design and build for instrumented environments and reactive things, what new issues and questions it raises.
-
Modern CS in the Real World
How modern CS helps you tackle today's problems.
-
Reactive Architecture
How to create reactive systems is more than simply learning a framework. Thinking in a reactive way helps you to design responsive architectures.
-
The Go Language
The Go Language - Concurrency, Performance, Systems Programming.
-
Architectures You've Always Wondered About
Get a rare look behind the scenes and get to see the architectures of the most well-known sites with the least known architectures.
-
Low latency trading
The 'race to zero' continues. Join us to learn about the latest tecniques being deployed to optimise order routing and execution.
-
Open source in finance
Financial services have changed from OS as cost-saving to a competitive weapon. See open source projects that are disrupting the finance industry.
-
Product Mastery
Come have fun with fellow PMs and BAs as you learn about Value Management. We'll even tell you dark tales of Snarks, Hippos and other obstacles.
-
Taming Microservices
Tackling the challenges of microservices in practice.
-
Taming Mobile
Mobile is no longer the Next Big Thing but a requirement for your business. Hear from those who have implemented successful mobile systems.