Back to Basics: Building an Event Driven Serverless ETL Pipeline on AWS

preview_player
Показать описание
To gain business insight, you and your data engineering team build and manage data pipelines to extract, transform, and load data. ETL provides the foundation for your data analytics and machine learning applications. You are able to apply business rules in ETL to clean and organize data to address business intelligence use cases such as monthly reporting. Join Lewis as he discusses modernizing ETL processes with an event-driven serverless data pipeline you can build on AWS. 

Check out more resources for architecting in the #AWS cloud:

#AWS #AmazonWebServices #CloudComputing #BacktoBasics #Serverless #ETL
  1. Amazon Web Services
  2. AWS
  3. Amazon Web Services
  4. Cloud
  5. AWS Cloud
  6. Cloud Computing
Рекомендации по теме
Back to Basics: 1:01:37

Back to Basics: The Structure of a Program - Bob Steagall - CppCon 2020

Spartan Alpine cabin 0:12:10

Spartan Alpine cabin conceals back-to-basics building tips

Back to Basics: 0:05:20

Back to Basics: Design Patterns for Building AWS Multi-Account Organization

Back to Basics: 0:18:40

Back to Basics: Your First Pedalboard Build

Back to Basics 0:00:24

Back to Basics

BACK TO THE 0:08:13

BACK TO THE BASICS - ULTIMATE GYM MOTIVATION 2023

BUILDING THE BOSS 0:05:11

BUILDING THE BOSS BOARD Episode 1: Back to Basics

Back to Basics: 1:01:03

Back to Basics: Designing Classes (part 1 of 2) - Klaus Iglberger - CppCon 2021

Back to Basics: 1:18:47

Back to Basics: Real-World Tips for Navigating Life with T1D

Back to basics: 0:00:21

Back to basics: The Mine crane! #minecraft

Back to Basics- 0:00:53

Back to Basics- Lay Out

Back to Basics: 1:03:19

Back to Basics: Compiling and Linking - Ben Saks - CppCon 2021

Beginner Sales Training 0:28:45

Beginner Sales Training eCourse: Back to Basics Part 1

How To Build 0:30:33

How To Build a PC in 2023 - Part 1: The Basics

Back to Basics: 0:04:40

Back to Basics: Running Serverless Websites

Back to Basics: 1:05:21

Back to Basics: Lambdas - Nicolai Josuttis - CppCon 2021

Closet Confessions: Back 0:08:55

Closet Confessions: Back To Basics, Part 1 | Fashion Haul | Trinny

Carpentry 101: Basics 0:17:03

Carpentry 101: Basics of Wood Framing with MattBangsWood [#1]

1 Month Solo 0:25:03

1 Month Solo on the Great Barrier Reef (Remote Australia)

#193: Back to 0:20:55

#193: Back to Basics: the differential amplifier, aka long-tailed pair, diff-pair

Back to Basics: 1:01:31

Back to Basics: Classic STL - Bob Steagall - CppCon 2021

Back to Basics! 0:10:47

Back to Basics!

Building & Surviving 0:12:47

Building & Surviving In Minecraft 1.0 | Part 4 (Back To Basics)

Ariel Atom: Back 0:03:54

Ariel Atom: Back To Basics - XCAR

Комментарии
Автор

Really like this pattern. Events created by s3 added to sqs followed by downstream processing by any/all subscribers. Lambda is great for push based processing of the sqs events, and can invoke large data processing jobs using the message metadata. For example the lambda can invoke an ecs fargate task using a custom docker image containing all run time dependencies needed

ahsin.shabbir