DP-3012 Implementing a Data Analytics Solution with Azure Synapse Analytics

Introduction:

This is a single day Instructor Lead Course designed to give the learners instruction on the SQL dedicated and serverless Spark pools and providing instruction of data wrangling and the ELT process using Synapse Pipelines which is very similar to those familiar with Azure Data Factory (ADF) to move data into the Synapse dedicated pool database.

Objectives:

Course Outline:

1 – Introduction to Azure Synapse Analytics

What is Azure Synapse Analytics
How Azure Synapse Analytics works
When to use Azure Synapse Analytics

2 – Use Azure Synapse serverless SQL pool to query files in a data lake

Understand Azure Synapse serverless SQL pool capabilities and use cases
Query files using a serverless SQL pool
Create external database objects

3 – Analyze data with Apache Spark in Azure Synapse Analytics

Get to know Apache Spark
Use Spark in Azure Synapse Analytics
Analyze data with Spark
Visualize data with Spark

4 – Use Delta Lake in Azure Synapse Analytics

Understand Delta Lake
Create Delta Lake tables
Create catalog tables
Use Delta Lake with streaming data
Use Delta Lake in a SQL pool

5 – Analyze data in a relational data warehouse

Design a data warehouse schema
Create data warehouse tables
Load data warehouse tables
Query a data warehouse

6 – Build a data pipeline in Azure Synapse Analytics

Understand pipelines in Azure Synapse Analytics
Create a pipeline in Azure Synapse Studio
Define data flows
Run a pipeline

7 – Use Azure Synapse serverless SQL pool to query files in a data lake

Understand Azure Synapse serverless SQL pool capabilities and use cases
Query files using a serverless SQL pool
Create external database objects

8 – Use Azure Synapse serverless SQL pools to transform data in a data lake

Transform data files with the CREATE EXTERNAL TABLE AS SELECT statement
Encapsulate data transformations in a stored procedure
Include a data transformation stored procedure in a pipeline

9 – Create a lake database in Azure Synapse Analytics

Understand lake database concepts
Explore database templates
Create a lake database
Use a lake database

10 – Secure data and manage users in Azure Synapse serverless SQL pools

Choose an authentication method in Azure Synapse serverless SQL pools
Manage users in Azure Synapse serverless SQL pools
Manage user permissions in Azure Synapse serverless SQL pools

11 – Analyze data with Apache Spark in Azure Synapse Analytics

Get to know Apache Spark
Use Spark in Azure Synapse Analytics
Analyze data with Spark
Visualize data with Spark

12 – Transform data with Spark in Azure Synapse Analytics

Modify and save dataframes
Partition data files
Transform data with SQL

13 – Use Delta Lake in Azure Synapse Analytics

Understand Delta Lake
Create Delta Lake tables
Create catalog tables
Use Delta Lake with streaming data
Use Delta Lake in a SQL pool

14 – Analyze data in a relational data warehouse

Design a data warehouse schema
Create data warehouse tables
Load data warehouse tables
Query a data warehouse

15 – Load data into a relational data warehouse

Load staging tables
Load dimension tables
Load time dimension tables
Load slowly changing dimensions
Load fact tables
Perform post load optimization

16 – Manage and monitor data warehouse activities in Azure Synapse Analytics

Scale compute resources in Azure Synapse Analytics
Pause compute in Azure Synapse Analytics
Manage workloads in Azure Synapse Analytics
Use Azure Advisor to review recommendations
Use dynamic management views to identify and troubleshoot query performance

17 – Secure a data warehouse in Azure Synapse Analytics

Understand network security options for Azure Synapse Analytics
Configure Conditional Access
Configure authentication
Manage authorization through column and row level security
Manage sensitive data with Dynamic Data Masking
Implement encryption in Azure Synapse Analytics