As more and more data get stored and evolved over the time, the problem is generally how do you use that data and how to churn meaningful data out. In this course you will learn about how to use Azure data factory to process, structure and streamline datasets and build a reliable end to end data pipeline. Azure Data Factory is a data-integration service based on the Cloud that allows us to create data-driven workflows in the cloud for orchestrating and automating data movement and data transformation. Data Factory is a perfect ETL (extract, transform, load) tool on Cloud. Data Factory is designed to deliver extraction, transformation, and loading processes within the cloud.
As you begin the course, you will get introduced to Azure Data Factory, followed by implementation and configuration of Azure Data Factory. You’ll also get to work with data factory wherein you’ll get to know about triggers and how to trigger data pipeline. Lastly, you’ll also find out how to work with datasets and configure CICD pipeline for spark jobs.
By the end of this course, you’ll have thorough understanding of Azure Data Factory.
