Azure Data Factory Triggers
This article is for sure going to help all the new learners who are new to Azure or want to switch to the Azure data engineering domain.
Azure Triggers is one of the favourite questions asked in all the data engineering interviews.
The task of the trigger is just to tell when the pipeline execution should start. This task can be manual or automated depending on the requirement.
Manual Triggers:
- Need to execute the pipeline manually.
- Not easy to handle pipeline execution manually so we have automated triggers.
Automated Triggers:
Automatically run the pipeline during a certain frequency, scheduled time, or when some specific event happened.
In Azure, we have 3 different types of automated triggers.
(i) Scheduled trigger
(ii) Tumbling window trigger
(iii) Storage/Event based trigger
Schedule Trigger:
- Recurring triggers based on a specified schedule.Specific time-based trigger.
- Executes on future date and time.
- Can set start and end date.
- Less reliable, retry capabilities are not supported.
- Trigger and Pipeline have a many-to-many relationship.
Tumbling Window Trigger:
- Execute at a periodic time interval from a…