How to setup email alerts with Azure Log Analytics | Data Factory pipeline failures

This video will talk about how to setup alert in ADF so that you get an email notification when ADF pipelines failed.

Azure Monitor Kusto Query Language used during demo:

let pipelines = ADFPipelineRun
| where Status == 'Failed' and Category == "PipelineRuns";
let activities = ADFActivityRun
| where Category == "ActivityRuns" and Status == "Failed" and ActivityType != "ExecutePipeline" and ActivityType != "IfCondition" and ActivityType != "ForEach" ;
pipelines
| join kind = inner activities on $left.RunId == $right.PipelineRunId
|project DataFactory=substring(tostring(split(ResourceId, "/", 8)), 2, strlen(tostring(split(ResourceId, "/", 8)))-4), TimeGenerated, PipelineName, ActivityName, RunId, Hash=hash_sha256(strcat(PipelineName,Parameters)), Parameters, ErrorMessage, FailureType, Start , End , Status
|order by TimeGenerated desc

Useful links:

[sivas]

Simply Nice Explanation brother - All the best . Siva.

[pradeepkgp]

Hi its nice explanation can you make viedo for long running pipelines in adf by using log analytics

[AshokG]

we are trying to create servicenow ticket from log anlytics in case there is any failure. we want to send selected fields like error message. can we do that. either using logic app or through ITSM connector. i did not find any way to send query columns to any of the action groups.

[shubhampawade]

Thanks a lot for the video. I am trying to create alerts for a custom log table which we have created in the Log Analytics workspace. I want to dynamically select which user the alert should go to based on the Team's name. How do I achieve this? Any help is greatly appreciated

[virajdhokare]

Hi Riz,
Can we customize the email subject for alert rules fired through application insights/log analytics Kusto queries ?

[vlogwithdevesh]

Hi Riz,
Can u make a tutorial on how to run dynamic queries on Log Analytics via logic app or adf!!!
In my case...want logs of different storage accounts via same query i.e dynamic query!
It will be very helpful..

[surajviswakarma]

Is there any way to send the query result in a mail body ?

[jamieg]

someone destroyed my career, , old coworkers hacking my network illegally, i am going to authorities again today, hope they help, will file civil and criminal charges. I dont even work there 2 years now, They are harassing me and defamation of character . I cant even work in my field, have been blocked 2 years now, and i hope authorities help me soon