85. Databricks | Pyspark | Notebook Activity in Azure Data Factory with Input Parameter

Azure Databricks Learning: Execute Azure Databricks Notebook through Azure Data Factory with Input Paramters
================================================================================

How can we execute the Databricks notebook from Azure data factory with input parameters?

This tutorial explains the process of running databricks notebook through notebook activity in Azure Data Factory with Input parameters

To get through understanding of this concept, please watch this video

#DatabricksWidgets, #DatabricksInputWidgets,#DatabricksInputParameter, #NotebookActivity, #ADFNotebookActivity #NotebookActivityBaseParameter #DatabricksNotebookActivity, #ADFtoDatabricks, #NotebookViaADF, #DatabricksScheduling, #AzureDataFactory, #DatabricksIntegrationwithADF, #ADF,#PysparkTips, #DatabricksRealtime, #SparkRealTime, #DatabricksInterviewQuestion, #DatabricksInterview, #SparkInterviewQuestion, #SparkInterview, #PysparkInterviewQuestion, #PysparkInterview, #BigdataInterviewQuestion, #BigdataInterviewQuestion, #BigDataInterview, #PysparkPerformanceTuning, #PysparkPerformanceOptimization, #PysparkPerformance, #PysparkOptimization, #PysparkTuning, #DatabricksTutorial, #AzureDatabricks, #Databricks, #Pyspark, #Spark, #AzureDatabricks, #AzureADF, #Databricks, #LearnPyspark, #LearnDataBRicks, #DataBricksTutorial, #azuredatabricks, #notebook, #Databricksforbeginners

[chappasiva]

Hi Raja,
very crystal clear explanation.
thanks you raja.

[cmeidpt]

Hello Raja Sir, So the input parameter name (table) created in the ADF and the widget text box(table) name created in the databricks workspace should match right ? So that exact value will be retrieved in the widget, as we may pass multiple parameters from ADF.

[jobabroad-mwoh]

Hi Raja, but you have passed only one table manually in the trigger parameter name called as table_name. lets say i have 10 tables in a database then how can i pass all 10 tables into that parameter dynamically and scheduled that trigger which run every day ?

[surenderraja]

@rajasdataengineering7585, What is the max length of string that can be passed to azure databricks notebook, it seems it can accept only 2048 characters