Azure Databricks Tutorial # 24:-What are Managed table and external table in pyspark databricks

--------------------------------------------------------------------------------------------------------------------------------------------------------------
These videos serve both as a learning tool for myself and as a source of information for others interested in the role and responsibilities of an SDET. While I have done my best to ensure accuracy, I acknowledge that there may be inaccuracies in the information presented. If you notice any mistakes, please feel free to leave a comment and help me improve my understanding
--------------------------------------------------------------------------------------------------------------------------------------------------------------
#externalTable
#managedtable
#databricks_external_table
#databricks_managed_table
#databricks_interview_questions
#databricks_interview_questions_and_answers
#interview_questions
#ETL Testing
#databricks
#databrickstables
#databricks_tables
#ExecuteTestCases in ADO
#AzureTestPlan
#AzureDevOps
#Azure
#DevOps
#ADO
#TestCaseExecution
#TestPlan
#TestSuite
#BugLogging in AzureDevOps
#AzureDevOps
#SoftwareTesting
#ExecuteTestCases in ADO
#AzureTestPlan
#AzureDevOps
#Azure
#DevOps
#ADO
#TestCaseExecution
#TestPlan
#TestSuite
#BugLogging in AzureDevOps
#AzureRepos
#AzureDevOpsrepos
#LearnAzure
#AzureLearning
#AzureDevOpsBasics
#LearnAzureDevOps
#LearnDevOps
#AzureRepos
#AzureDevOpsrepos
#LearnAzure
#AzureLearning
#AzureDevOpsBasics
#LearnAzureDevOps
#Learn Azure DevOps
#Azure DevOps Pull changes
#Commit changes in Azure DevOps
#Staged changes in Azure DevOps
#Pull changes in Azure DevOps
#Push changes in Azure DevOps
#Approve changes in Azure DevOps
#Approve PR In Azure DevOps
#ApprovePRInAzureDevOps

[SqlMastery-fqrq]

Very well explained Sir, Thank you so much for sharing your knowledge.

[surenderraja]

What is difference between MANAGED delta table and EXTERNAL Delta table in azure databricks? Can we do insert, delete, update in both the types.

[monalisachatterjee]

can you please tell what is written inside the spn_access notebook

[ranjankumardas]

Hi,
can you create a video how we can validate data between 2 tables in pyspark

[richeshjena]

Hi I am Richesh, requesting for one help. I am facing one error while writing into a S3.

code = dimRegion.write.option("header", "true").option("Content-Type", "text/csv").option("Content-MD5",

configuration

sc.setSystemProperty("com.amazonaws.services.s3.enableV4", "true")

hadoop_conf.set("fs.s3a.impl",
hadoop_conf.set("com.amazonaws.services.s3.enableV4", "true")
hadoop_conf.set("fs.s3a.access.key", ACCESS_KEY)
hadoop_conf.set("fs.s3a.secret.key", SECRECT_ACCESS_KEY)
hadoop_conf.set("fs.s3a.connection.maximum",
hadoop_conf.set("fs.s3a.endpoint", "s3." + REGION + ".amazonaws.com")

Error :

Caused by: Status Code: 403, AWS Service: Amazon S3, AWS Request ID: CVWWH1EQ1PNCCNR0, AWS Error Code: SignatureDoesNotMatch, AWS Error Message: The request signature we calculated does not match the signature you provided. Check your key and signing method., S3 Extended Request ID:

If you help me resolve this issue, I will subscribe and press the bell icon.