Learning Real Time processing with Spark Streaming + Code

Купить бумажную книгу и читать

Название: Learning Real Time processing with Spark Streaming + Code

Автор: Sumit Gupta

Издательство: Packt Publishing

Год: 2015

Страниц: 200

Язык: English

Формат: epub+code

Размер: 6 mb

Using practical examples with easy-to-follow steps, this book will teach you how to build real-time applications with Spark Streaming.

Starting with installing and setting the required environment, you will write and execute your first program for Spark Streaming. This will be followed by exploring the architecture and components of Spark Streaming along with an overview of libraries/functions exposed by Spark. Next you will be taught about various client APIs for coding in Spark by using the use-case of distributed log file processing. You will then apply various functions to transform and enrich streaming data. Next you will learn how to cache and persist datasets. Moving on you will integrate Apache Spark with various other libraries/components of Spark like Mlib, GraphX, and Spark SQL. Finally, you will learn about deploying your application and cover the different scenarios ranging from standalone mode to distributed mode using Mesos, Yarn, and private data centers or on cloud infrastructure.

What You Will Learn

Install and configure Spark and Spark Streaming to execute applications

Explore the architecture and components of Spark and Spark Streaming to use it as a base for other libraries

Process distributed log files in real-time to load data from distributed sources

Apply transformations on streaming data to use its functions

Integrate Apache Spark with the various advance libraries like MLib and GraphX

Apply production deployment scenarios to deploy your application