COPY MULTIPLE FILES ADF (Azure Data Factory)
In this article, we will see how we can copy multiple files from the Azure Data Lake Gen2 input folder to the Azure Data Lake Gen2 output folder.
If you are new to Azure then follow my previous articles to learn about ADF and how we can create important components of the pipeline in ADF.
- Datasets
- Linked Services
Problem Statement: We have multiple files in ADF which is in .csv and .json format but we need to copy only files in .csv format.
Solution: Once set up the ADF is done the next step is to create the copy activity pipeline.
Step 1: We have 2 containers.Input container where we have all the format files and Output container where we will store files with.csv format only.
We have three files where .csv is 2 files and .json is 1 file. Here we need to copy only .csv files.
