Hands-On Intro to Apache Iceberg - 3 - Nessie Catalog Branching/Merging in Apache Spark

preview_player
Показать описание
In this video series Dremio Developer Advocate demonstrates how to work with Apache Icberg tables using Spark & Dremio with a Nessie catalog.

--- Get Started with Dremio for Free ---
--------------------------------------------------------------

See all Iceberg Resources at the Apache Iceberg 101 article (including videos from this series)

Repository with Environment for These Lessons

Apache Iceberg Documentation

Dremio Documentation

Nessie Documentation
  1. Dremio
Рекомендации по теме
Hands-On Intro to 0:11:57

Hands-On Intro to Apache Iceberg - 1- Setup and Overview

Hands-On Intro to 0:14:21

Hands-On Intro to Apache Iceberg - 2 - Ingest CSV Data Into Iceberg with Spark

Hands-On Intro to 0:12:46

Hands-On Intro to Apache Iceberg - 4 - Partitioning and CALL procedures in Apache Spark

Hands-On Intro to 0:11:29

Hands-On Intro to Apache Iceberg - 7 - Ingesting CSV into Iceberg with Dremio

Intro to Apache 0:11:02

Intro to Apache Iceberg! Apache Iceberg Explained for Beginners!

Hands-On Intro to 0:11:40

Hands-On Intro to Apache Iceberg - 5 - Connecting Nessie & Minio to Dremio to see Iceberg tables

Hands-on Intro to 0:09:34

Hands-on Intro to Apache Iceberg - 6 - Querying Iceberg Tables in Dremio

Getting Hands on 0:09:28

Getting Hands on with Apache Iceberg - Setting up local Spark/Notebook Environment for Evaluation

Ep1: Getting Started 0:49:23

Ep1: Getting Started with Apache Hudi - Understanding the Basics of the Table Format

Hands-On Intro to 0:07:15

Hands-On Intro to Apache Iceberg - 3 - Nessie Catalog Branching/Merging in Apache Spark

Introduction to Apache 0:09:31

Introduction to Apache Iceberg With Project Co-Creator Ryan Blue

Apache Iceberg 101: 0:19:59

Apache Iceberg 101: The Who, What and Why of Apache Iceberg

The top 3 0:02:16

The top 3 reasons to switch to Apache Iceberg

Apache Iceberg on 0:28:04

Apache Iceberg on AWS with S3 and Athena [FULL COURSE IN 30MIN]

Hands-On Intro to 0:04:47

Hands-On Intro to Apache Iceberg - 8 - Dremio's Iceberg backed Reflections

Apache Iceberg Fundamentals: 0:00:45

Apache Iceberg Fundamentals: Course #1 - Introduction

Hands-on with Apache 0:34:21

Hands-on with Apache Iceberg on Your Laptop: Deep Dive with Apache Spark, Nessie, Minio, Dremio...

Apache Iceberg Workshops 0:15:02

Apache Iceberg Workshops #1 - Running Iceberg & Spark in Docker (Single Image, No Docker Compose...

AWS re:Invent 2023 0:51:51

AWS re:Invent 2023 - Netflix’s journey to an Apache Iceberg–only data lake (NFX306)

Understanding Apache Iceberg 0:04:53

Understanding Apache Iceberg architecture | Starburst Academy

Intro to Apache 0:46:07

Intro to Apache Iceberg -- A Lakehouse Solution I Data Engineering Bootcamp I WeCloudData

Apache Iceberg Explained: 0:00:55

Apache Iceberg Explained: A Tutorial with Dremio #shorts

Apache Iceberg Tutorial: 0:23:13

Apache Iceberg Tutorial: Learn the Problem & Solution Behind Iceberg's Origin Story

Apache Iceberg Explained: 0:00:54

Apache Iceberg Explained: A Tutorial with Dremio #shorts

Комментарии
Автор

Hi Alex,

Really tankful to you for such nice explanation and handson.

I got stuck at 'CREATE BRANCH IF NOT EXISTS lesson2 IN nessie' . This keeps failing with error message "syntax error at or near 'BRANCH'". Am I missing something?

Kindly assist.

ZaidAlig
Автор

Thanks for the video. So branching is an Iceberg feature not a Nessie feature. Is that correct? If so, can we attain the same on any spark metastore like AWS Glue?

AkashGanguly-tf
Автор

How do we resolve merge conflicts
Ex :- main branch moved a head and added/deleted somedata
temp branch have some changes and i'm trying to merge temp to main branch
how does nessie handle this case do we need to manually resolve the merge conflict

KartheekNallamala