30. Get Error message of Failed activities in Pipeline in Azure Data Factory

In this video, I discussed about getting error message details of failed activities in pipeline in azure data factory
Please watch below video, before watching this

Link for Azure Synapse Analytics Playlist:

Link for Azure Databricks Play list:

Link for Azure Functions Play list:

Link for Azure Basics Play list:

Link for Azure Data factory Play list:

Link for Azure Data Factory Real time Scenarios

Link for Azure LogicApps playlist

#Azure #AzureDatafactory #DataFactory

[NeumsFor]

Ive always been disappointed at how this feature of the expression language is not advertised as much as it should be. I know the challenges of representing certain boundaries in ETL tools but MS is long past the time of doing better with task grouping, event handling WITHIN the tool, and setting of transaction boundaries.

Glad you brought this to life.

[annukumari]

You never fail to surprise your audience 😊 Thanks for amazing video again

[sarthaks]

Very good concept indeed. This will definitely help in designing good data flow in ADF

[volodymyrvintonyak]

Wow, that's exactly what I was looking for! Followed this part through the comments of p.29, which is also very helpful. Especially the hint with '?', didn't know that it can work like this.
The only question I have, do you know by any chance, can we somehow workaround the errors like 'Activity failed because an inner activity failed' to have the exact error of that inner activity? I mostly get it from the 'For each' activity. Looking forward to hearing from you.
Anyway, I very appreciate your work on this course.

[vijaybodkhe]

Thank you very much for sharing .You are covering really real time scenarios.

[TheDouglasDale]

Thank you sir. This really helped! Keep up the good work!

[MaheshReddyPeddaggari]

Wow, The? catch is very helpful, thanks for sharing your knowledge.

[prateekkhanna]

How to capture error msg in case of failure for Azure function Activity. When I am using set variable activity to capture, It is giving Error.message not present

[mehmetadalar]

Thanks for the video. Very well explained. One comment.. If we set on success relation between activities this will also make the pipeline fail on any failed activity. So alternatively a monitor alert would also do the same job that a web activity does in a pipeline. What do you think?

[dhruv]

Thank you for sharing. Just one question if any activity fails in pipeline and at the end on skip or fail we are handling/capturing error, then why overall pipeline status showing succeeded instead of fail ?

[ameyagodbole]

Thanks for the in detail explanation. How to get notified on email if any pipeline fails?
Pls guide me on this one

[shashikantbhadre]

Thanks a lot !!... one comment - I don't think pipe (|) is required for series execution.

[alpeshjain]

At 06:10, suppose rather than one two activities got failed, then it's capturing logs only for one variable not the other one.

[shashikantbhadre]

Thanks a lot !!... one comment - I don't think pipe (|) is required..

[NeumsFor]

?. is the "optional chaining" functionality of JavaScript. It is NOT unique to ADF.

[nanibabu]

Thanks for the video this is the one I requested in the previous video. . One more question if my source is api and it is having multiple nested array will it be possible to handle in the adf directly. . In copy activity we can able to select only one array only right but incase if you have nested arrays how we can solve this. . Highly appreciated your efforts

[dannyroy]

To extract the pipeline status for each stage or task in Azure DevOps and forward each pipeline stage status to Google Chat Hangouts by implementing this in a pipeline script - how can we do that ?

[pradeeppatil]

Hi, Can we use the same concept in logic apps as well? Suppose I have 10 actions ( set of activities) and want to capture the error for the same..?

[snehasiktachandra]

Thanks for the video; Suppose a pipeline is having execute pipeline activity, in the child pipeline there a notebook is running in loop. Is there any way I can get the error message of child pipeline - following the way in this video, I am getting the message that "execute pipeline failed because inner activity failed"; I need exact error message

[ssprb]

How to capture the error msg when we have both serial and parallel activities together in a pipeline