Learn your way! Get started

DP-203: Data Engineering in Microsoft Azure, Part 1 of 7: Azure Cloud and Data Engineer

with expert Eshant Garg


Watch trailer


Course at a glance

Included in these subscriptions:

  • Dev & IT Pro Video
  • Dev & IT Pro Power Pack

Release date 4/18/2022
Level Beginner
Runtime 6h 7m
Closed captioning N/A
Transcript N/A
eBooks / courseware N/A
Hands-on labs N/A
Sample code Included
Exams Included


Enterprise Solutions

Need reporting, custom learning tracks, or SCORM? Learn More



Course description

The DP-203 Exam is measured in Four domains: Design and implement data storage (40-45%), Design and develop data processing (25-30%), Design and implement data security (10-15%), and Monitor and optimize data storage and data processing (10-15%). This course covers an introduction to Data Engineering, as well as Data Storage with Non-Relational Data Stores.

Prerequisites

AZ-900 Azure Fundamentals is very helpful but not required. A Candidate for the exam must have strong knowledge of data processing languages such as SQL, Python, or Scala, and they need to understand parallel processing and data architecture patterns.

Meet the expert

Eshant Garg has 16 years of extensive professional experience with expertise in Database and Business Intelligence Solutions, Advanced Analytics, Design and Solution Architect, Reporting, and Cloud Computing Technologies (Azure & AWS). As a developer and architect, he has worked closely with customers, users, and colleagues to support business solutions across a variety of industries including healthcare, insurance, finance, and government ranging from small companies to fortune 500 companies.

Course outline



Module 1

Course Overview (11:32)
  • Introduction (00:08)
  • Course Introduction (02:56)
  • DP-203 Exam Info (03:32)
  • How to use Azure Portal for Free (04:46)
  • Summary (00:08)
Create Azure Free Subscription (28:03)
  • Introduction (00:08)
  • Create Azure Free Subscription (06:10)
  • Azure Portal Overview (14:42)
  • Delete Resources And Set Budget (06:54)
  • Summary (00:08)
What is a Data Engineer? (19:00)
  • Introduction (00:08)
  • How Did Data Engineer Profile Evolve (09:29)
  • Data Engineer Role And Responsibility (05:30)
  • Data Engineer Technologies (03:44)
  • Summary (00:08)

Module 2

Azure Storage Services Overview (14:12)
  • Introduction (00:08)
  • Learning Objectives (02:58)
  • Azure Storage Services Overview (05:55)
  • Demo: Provision Azure Storage Account (05:01)
  • Summary (00:08)
Data Redundancy Options (16:47)
  • Introduction (00:08)
  • Data Redundancy Options (05:53)
  • Blob Storage (06:00)
  • Access Tiers (04:36)
  • Summary (00:08)
Table Storage (25:08)
  • Introduction (00:08)
  • Table Storage (04:52)
  • Queue Storage (02:26)
  • File Share Storage (05:22)
  • Demo: File Share Storage (03:50)
  • Disk Storage And Demo (08:19)
  • Summary (00:08)
Cosmos DB (26:29)
  • Introduction (00:08)
  • How Cosmos Db Evolved (02:34)
  • Cosmos Db Features (11:21)
  • Cosmos Db Multi-Model APIs (12:17)
  • Summary (00:08)

Module 3

Provision Cosmos DB Account (24:30)
  • Introduction (00:08)
  • Provision Cosmosdb Account (10:34)
  • Database Containers And Items (04:26)
  • Throughput And Request Units (09:13)
  • Summary (00:08)
Horizontal Scalability (15:04)
  • Introduction (00:08)
  • Horizontally Scalable (02:45)
  • What Is Partitioning And Partition Key (06:10)
  • Dedicated Vs Shared Throughput (00:00)
  • Dedicated vs. Shared Throughput (05:52)
  • Summary (00:08)
Partitioning (32:41)
  • Introduction (00:08)
  • Avoiding Hot Partition (05:19)
  • Single Partition Vs Cross Partition (03:28)
  • Composite Key (03:12)
  • Partition Key Best Practice (07:46)
  • Demo: Insert And Query Data In Your Cosmos Db (12:39)
  • Summary (00:08)

Module 4

Time to Live (35:33)
  • Introduction (00:08)
  • Time To Live (05:45)
  • Globally Distribution (13:19)
  • Multi-Master (08:36)
  • Manual vs. Automatics Failover (00:00)
  • Manual Vs Automatics Failover (07:36)
  • Summary (00:08)
Manual vs. Automatic Failover (35:47)
  • Introduction (00:08)
  • Manual Vs Automatics Failover (00:00)
  • Manual vs. Automatics Failover (07:32)
  • 5 Consistent Level (14:13)
  • Azure Cli (06:58)
  • Pricing (06:46)
  • Summary (00:08)

Module 5

Cosmos DB Security (46:17)
  • Introduction (00:08)
  • Cosmos Db Security (11:27)
  • What Is Data Lake (03:52)
  • How Data Lake Gen 2 Evolved (05:14)
  • Blob Vs Lake (04:36)
  • Data Lake Security (20:49)
  • Summary (00:08)
High Availability and Disaster Recovery (36:17)
  • Introduction (00:08)
  • HA and DR (07:13)
  • Azure Storage - HA and DA Options (11:28)
  • Cosmos Db - HA and DA Options (17:19)
  • Summary (00:08)