Apache Kafka - Real-time Stream Processing (Master Class)

Description

If you want to understand the concept of stream processing, this course is for you. Using Kafka, the course will help you get to grips with real-time stream processing and enable you to apply that knowledge to learn Kafka programming techniques. This course uses the Kafka Streams library available in Apache Kafka 2.x. All the source code and examples on Apache Kafka 2.3 open-source distribution have been tested. You'll understand and explore Confluent Platform functionalities such as Schema Registry and Avro Serdes using the Confluent Community Version. This course makes extensive use of IntelliJ IDEA and Apache Maven as the preferred development IDE. You'll leverage Log4J2 and JUnit5 for industry-standard log implementation in your application and implementing unit test cases, respectively. The code bundle is available at https://github.com/PacktPublishing/Apache-Kafka---Real-time-Stream-Processing-Master-Class

What You Will Learn

Learn Apache Kafka fundamentals and Kafka Architecture
Understand how to create streams using the Kafka Producer APIs
Design, develop, and test real-time stream processing applications using the Kafka Streams library
Get well-versed with the Kafka Streams architecture, Streams DSL, and the Processor API
Support microservice architecture and implement interactive queries in Kafka Streams
Explore serializing and deserializing and work on JSON and AVRO messages

Audience

The Kafka Streams - Real-time Stream Processing course is for software engineers looking to develop a stream processing application using the Kafka Streams library. This course will also help Java programmers who want to learn everything necessary to start implementing real-time streaming applications using Apache Kafka. Data architects and data engineers responsible for designing and building the organization's data-centric infrastructure will benefit from this course.

Approach

The course uses a progressive approach to teach a complex subject. It contains some fully example-driven sections to help you grasp key concepts easily.

Key Features

Design, develop, and test real-time stream processing applications using Kafka Streams * Explore the Kafka Streams architecture, Streams DSL, and exactly-once processing in Apache Kafka * Autogenerate Java Objects from JSON and AVRO Schema definition

Github Repo

https://github.com/PacktPublishing/Apache-Kafka---Real-time-Stream-Processing-Master-Class

About the Author

Prashant Kumar Pandey

Prashant Kumar Pandey is passionate about helping people learn and grow in their careers by bridging the gap between their existing and required skills. In his journey to fulfill this mission, he is authoring books, publishing technical articles, and creating training videos to help IT professionals and students succeed in the industry. He is also the founder, lead author, and chief editor of the Learning Journal portal that has been providing various skill development courses, training sessions, and technical articles since 2018.

Course Outline

1. Before you Start

2. Introduction to Real-time Streams

3. Enter the world of Apache Kafka

4. Creating Real-time Streams

5. Enter the Stream Processing

6. Foundation for Real Life Implementations

7. States and Stores

8. KTable - An Update Stream

9. Real-time Aggregates

10. Timestamps and Windows

11. Joining Streams and Tables

12. Testing Streams Application

13. Interactive Query and Micro-Service Responses

14. Appendix