How To solve incremental or historical Load in Spark Interview Question June 2023

How To solve incremental or historical Load in Spark Interview Question June 2023

INSERT INTO target_table (id, name, ...)
SELECT id, name, ...
FROM staging_table
WHERE NOT EXISTS (
SELECT 1
FROM target_table
);