DP-3012 Implementing a Data Analytics Solution with Azure Synapse Analytics

Introduction:

This is a single day Instructor Lead Course designed to give the learners instruction on the SQL dedicated and serverless Spark pools and providing instruction of data wrangling and the ELT process using Synapse Pipelines which is very similar to those familiar with Azure Data Factory (ADF) to move data into the Synapse dedicated pool database.

Objectives:

Course Outline:

1 – Introduction to Azure Synapse Analytics

  • What is Azure Synapse Analytics
  • How Azure Synapse Analytics works
  • When to use Azure Synapse Analytics

2 – Use Azure Synapse serverless SQL pool to query files in a data lake

  • Understand Azure Synapse serverless SQL pool capabilities and use cases
  • Query files using a serverless SQL pool
  • Create external database objects

3 – Analyze data with Apache Spark in Azure Synapse Analytics

  • Get to know Apache Spark
  • Use Spark in Azure Synapse Analytics
  • Analyze data with Spark
  • Visualize data with Spark

4 – Use Delta Lake in Azure Synapse Analytics

  • Understand Delta Lake
  • Create Delta Lake tables
  • Create catalog tables
  • Use Delta Lake with streaming data
  • Use Delta Lake in a SQL pool

5 – Analyze data in a relational data warehouse

  • Design a data warehouse schema
  • Create data warehouse tables
  • Load data warehouse tables
  • Query a data warehouse

6 – Build a data pipeline in Azure Synapse Analytics

  • Understand pipelines in Azure Synapse Analytics
  • Create a pipeline in Azure Synapse Studio
  • Define data flows
  • Run a pipeline

7 – Use Azure Synapse serverless SQL pool to query files in a data lake

  • Understand Azure Synapse serverless SQL pool capabilities and use cases
  • Query files using a serverless SQL pool
  • Create external database objects

8 – Use Azure Synapse serverless SQL pools to transform data in a data lake

  • Transform data files with the CREATE EXTERNAL TABLE AS SELECT statement
  • Encapsulate data transformations in a stored procedure
  • Include a data transformation stored procedure in a pipeline

9 – Create a lake database in Azure Synapse Analytics

  • Understand lake database concepts
  • Explore database templates
  • Create a lake database
  • Use a lake database

10 – Secure data and manage users in Azure Synapse serverless SQL pools

  • Choose an authentication method in Azure Synapse serverless SQL pools
  • Manage users in Azure Synapse serverless SQL pools
  • Manage user permissions in Azure Synapse serverless SQL pools

11 – Analyze data with Apache Spark in Azure Synapse Analytics

  • Get to know Apache Spark
  • Use Spark in Azure Synapse Analytics
  • Analyze data with Spark
  • Visualize data with Spark

12 – Transform data with Spark in Azure Synapse Analytics

  • Modify and save dataframes
  • Partition data files
  • Transform data with SQL

13 – Use Delta Lake in Azure Synapse Analytics

  • Understand Delta Lake
  • Create Delta Lake tables
  • Create catalog tables
  • Use Delta Lake with streaming data
  • Use Delta Lake in a SQL pool

14 – Analyze data in a relational data warehouse

  • Design a data warehouse schema
  • Create data warehouse tables
  • Load data warehouse tables
  • Query a data warehouse

15 – Load data into a relational data warehouse

  • Load staging tables
  • Load dimension tables
  • Load time dimension tables
  • Load slowly changing dimensions
  • Load fact tables
  • Perform post load optimization

16 – Manage and monitor data warehouse activities in Azure Synapse Analytics

  • Scale compute resources in Azure Synapse Analytics
  • Pause compute in Azure Synapse Analytics
  • Manage workloads in Azure Synapse Analytics
  • Use Azure Advisor to review recommendations
  • Use dynamic management views to identify and troubleshoot query performance

17 – Secure a data warehouse in Azure Synapse Analytics

  • Understand network security options for Azure Synapse Analytics
  • Configure Conditional Access
  • Configure authentication
  • Manage authorization through column and row level security
  • Manage sensitive data with Dynamic Data Masking
  • Implement encryption in Azure Synapse Analytics

18 – Build a data pipeline in Azure Synapse Analytics

  • Understand pipelines in Azure Synapse Analytics
  • Create a pipeline in Azure Synapse Studio
  • Define data flows
  • Run a pipeline

19 – Use Spark Notebooks in an Azure Synapse Pipeline

  • Understand Synapse Notebooks and Pipelines
  • Use a Synapse notebook activity in a pipeline
  • Use parameters in a notebook

Enroll in this course

$941.76

Need Help Finding The Right Training Solution?

Our training advisors are here for you.

CAD Canadian dollar