AZURE DATA FACTORY
ADF or Azure Data Factory is one of the most important ETL tools. To begin with Azure ADF first, we must have an ADF account. In the article let’s understand the complete end-to-end scenario to copy data from the SQL database to Azure data lake storage Gen2.
Before we create an account we must have a subscription to Azure.
Step 1:
Get an Azure subscription once it's ready then follow the next step.
Step 2:
Resource Group: Bundle or package of resources.
Create a resource group where all the resources will be mapped and placed as per the region.
Region: Region should be selected based on network latency.
Step 3:
Create an Azure storage account.
In azure subscription, we have two types of storage accounts.
(i) Azure Data Lake Storage: In azure data lake storage we have two different version Gen1 and Gen2.Gen1 is the oldest and unsupported version for many activities.Gen2 is the latest , updated version and supported by almost all the activities. We consider data lake storage where we need to…