AWS Glue ETL with Python shell |Read data from S3 and insert Redshift

preview_player
Показать описание
AWS Glue ETL with Python shell
Read data from S3 and insert into Redshift using Python Shell script

AWS Glue is a fully managed ETL service that makes it easy for customers to prepare and load their data. it have two option we can create glue script using python as well as spark.

Using AWS Glue I have create Python script and store data into Redshift table.
library used :
boto3
pandas
psycopg2

AWS GLUE ETL AND REDSHIFT RELATED DATA ENGINEERING VIDEOS.

(Create Redshift Cluster and Load Data using Python)
(AWS Glue ETL with Python shell |Read data from S3 and insert Redshift)(Not using Pyspark with glue)
(AWS GLUE Complete ETL Project Demo| Load Data from AWS S3 to Amazon RedShift)(Data engineer Project)
(Redshift using Python| Load and insert and copy data into redshift using psycopg2 )
(Aws Redshift tutorial |Amazon Redshift Architecture | Data Warehouse Concept)
(Building ETL Pipeline using AWS Glue and Step Functions)
(AWS GLUE CRAWLER TUTORIAL with DEMO| Learn AWS GLUE)
(AWS GLUE CONCEPT|GLUE DATA CATALOG|GLUE TUTORIAL)

AWS ATHENA AND LAMBDA RELATED

In case of any query, you can contact us directly on WhatsApp 8800502668

Request you to subscribe my channel Techno Devs with Saurabh and Press Bell icon & get regular updates on videos.
Рекомендации по теме
Комментарии
Автор

can we practice glue in free tier or it will be chargable?

prabhatgupta
Автор

If possible, can you make a video on complex json file to be inserted into redshift via Glue/lambda?

paritoshec
Автор

i reiceve this error: No module named 'psycopg2'

realmatismo