Copy Data from Rest API to ADL using dynamic parameters at Dataset and Linked Service

In this article, we will see how to copy data from an API with specific files to an Azure data lake.

Step 1:

Create a folder raw where we will copy data in the data lake.

ADL folder to copy data

Create a file with .json format and add the configuration-related information.

In order to copy these data from HTTP requests we will have the following components from ADF.

1. Dataset -> At the source and destination.
2. Linked Service -> At the source and destination.

Step 2: Datasets

Dataset for the JSON file.

Dataset for the JSON file upload for the list of source file data

Dataset at the source.

Parameters at the source dataset