Real-Time Data Stream Processing in Azure

Description

Delve into big data streaming with Azure using Event Hubs, Data Lake, and Azure Stream Analytics

A modern digital company captures a large amount of data every day. This data gets locked in data islands such as caches, queues, and logs, and extracting this data and making it useful poses a major challenge. Real-time data processing is the most effective alternative to traditional extract, transform, and load (ETL) processes. This course will help you to think of data as an ever-flowing stream of events instead of data as islands locked away in databases. This course employs live labs to get you up to speed with Azure Event Hubs and teach you how to create C# console applications for sending and receiving data from Event Hubs. As you advance, you'll learn how to capture and archive data from Azure Event Hubs to Azure Data Lake. The subsequent videos will show you how to provision Event Hubs, Data Lake, and SQL Server databases in Azure. Toward the end of the course, you'll write an analytics job to stream live data from an event hub to a SQL Server database. By the end of this course, you'll have developed a solid understanding of how to stream big data using Azure Stream Analytics. All the codes and supporting files for this course will be available at- https://github.com/PacktPublishing/Real-Time-Data-Stream-Processing-in-Azure

Gain a thorough understanding of Azure Stream Analytics
Discover how to ingest data using Azure Event Hubs
Find out how to archive data from Event Hubs to Azure Data Lake
Provision Event Hubs, Data Lake, and SQL Server in Azure
Listen to an event hub and stream the data to a SQL Server table
Communicate with event hubs for effortless data transfer
Discover how event hub groups work

This course is for Azure developers and big data engineers looking to change their approach to data processing. To take this course, you should have an Azure portal account. A free Azure trial account will also work.

This course makes use of live labs and engaging videos to offer an interesting learning experience.

Learn to think of data as an ever-flowing stream of events * Discover how to harness the power of data events using Azure Stream Analytics * Get up to speed with Azure Event Hubs

https://github.com/packtpublishing/real-time-data-stream-processing-in-azure

Hersh Bhasin is a published author and work as a Cloud Architect with J.P. Morgan Chase where he is part of the Enterprise Cloud Solutions Architecture team responsible for creating cloud architectural blueprints, guidance, Infrastructure as Code and best practices for fostering cloud adoption across the three public cloud providers (AWS, Azure and Google).

1. course-intro

2. understanding-eventhubs

3. Lab- Provisioning An Event Hub

4. Lab -Sending Events to an Event Hub

5. Lab-Receiving Events from an Event Hub

6. Lab-Event Hub Consumer Groups

7. Lab-Capturing Event Data to a Data Lake

8. Understanding Azure Stream Analytics

9. Lab-streaming