Microsoft Azure Data Lake Storage Service (Gen1 and Gen2)

Description

Azure Data Lake Storage Gen2 (ADLS) is a cloud-based repository for both structured and unstructured data. For example, you could use it to store everything, from documents to images to social media streams. This is one of the most effective ways to go for big data processing; that is, to store your data in ADLS and then process it using Spark, which is a faster version of Hadoop, on Azure Databricks. This is a comprehensive hands-on course for anyone who is interested in Azure's big data analytics services. You will learn hands-on with examples to import data into ADLS and then securely access it and analyze it using Azure Databricks and Azure HDInsight. You will also learn how to monitor and optimize your Data Lake storage. This course provides an end-to-end demonstration for one to have a noticeably clear understanding of Data Lake. By the end of this course, you will learn how to ingest, process, and export data using Databricks and HDInsight. You will have a solid understanding of Microsoft Azure Data Lake Storage Service (Gen1 and Gen2) and its features and properties, which will help you further in your professional endeavors. All the resources for this course are available at https://github.com/PacktPublishing/Microsoft-Azure-Data-Lake-Storage-Service-Gen1-and-Gen2-

What You Will Learn

Explore Data Lake optimization strategy
Learn to monitor the performance of your Data Lake
Explore different tools and scenarios to ingest data into Data Lake
Discover the five layers of security to protect Data Lake
Explore data security and configure them using the Azure portal
Learn to monitor Azure Storage Service through Metrics

Audience

This course is for anyone interested in Azure's big data analytics services. Also, Microsoft Azure data engineers, database and BI developers, database administrators, data analysts, or similar profiles can opt for this course.

Just a basic understanding of data warehouse and database, in general, will help you understand this course better.

Approach

This is a hands-on comprehensive course. The author walks through every aspect of the course in a step-by-step manner and provides a detailed description of all the concepts followed by demonstrating them with examples.

Key Features

Discover Microsoft Azure Data Lake * Learn to use Azure Databricks and HDInsight to process data in ADLS * Explore data lifecycle and architecture around Data Lake

Github Repo

https://github.com/PacktPublishing/Microsoft-Azure-Data-Lake-Storage-Service-Gen1-and-Gen2-

About the Author

Eshant Garg

Eshant Garg has 16 years of extensive professional experience with expertise in database and business intelligence solutions, advanced analytics, design and solution architecture, reporting, and cloud computing technologies (Azure and AWS). He loves to explain complicated things in a simple and effective way. As a developer and architect, he has worked closely with customers, users, and colleagues to support business solutions across a variety of industries including healthcare, insurance, finance, and government ranging from small companies to Fortune 500 companies. Outside of the technical world, he loves yoga and meditation. He is a student of the ancient yogic text, the Bhagavad Gita, and loves to discuss and practice philosophical teachings.

Course Outline

1. Course Introduction

2. Introduction to Azure Cloud Computing

3. Introduction to Azure Data Lake

4. Data Ingestion

5. Data flow around Data Lake

6. Azure Data Lake Processing through Databricks

7. Azure Data Lake Processing through HDInsight

8. Security Layers in Data Lake

9. Data Lake Monitoring and Optimization

10. Bonus