ADF Custom Events for file watcher and pipeline chaining

Demonstration of using custom events in #Azure #DataFactory and #SynapseAnalytics pipelines. Create custom event topics in Event Grid and then subscribe to those in ADF triggers, to make interesting new trigger patterns with pipelines.

Here is the JSON message that I sent from the Web Activity to trigger the next pipeline:
@concat('[{"id":"',string(rand(1,5000000)),'","eventType":"pipelineCompleted","subject":"pipeline","eventTime":"2021-08-10T21:03:07+00:00","data":{"status":"complete"},"dataVersion":"1.0"}]')

I set that string with Set Variable, then used @json() to convert it to a JSON object:
@json(variables('myid')).

In this example, I made a custom event trigger that will listen for "pipelineCompleted".

[NeumsFor]

Mark, I understand the concept, but the one thing I wasn't clear on was in the Event grid topic there appeared to have been an Event Hub endpoint in there. Was that EH endpoint just a different topic subscription for illustrative purposes, or was that EH endpoint a mandatory part of this demo? I'm thinking the former, but I was not sure.

[hutchm]

The important part of this video is what's in the scope field? Please share.

[manjuappu]

Could you show us how to configure EventHub and EventGrid Topic?

[agasti]

Cool demo, but why do all this when an execute pipeline activity would do the same?

[LuigiZambetti]

Could you make a playlist on Azure Data Factory for absolute beginners?

[bananaboydan]

didnt show how to configure eventgrid at all wow