AWS Tutorials - Introduction to AWS Glue Studio

The Glue Studio Workshop -

PySpark Transformation Workshops –

AWS Glue Studio is GUI based service to create, run, and monitor extract, transform, and load (ETL) jobs in AWS Glue. It helps in visually composing data transformation workflows and run them on AWS Glue’s Apache Spark-based serverless ETL engine. AWS Glue Studio supports both tabular and semi-structured data. AWS Glue Studio also offers tools to monitor ETL workflows and validate that they are operating as intended.
In this workshop, you create an ETL job using AWS Glue Studio which reads data from the data lake data catalog, performs transformation and writes to the S3 bucket.

[sachinamin]

One of the first AWS GLUE studio explanation which is very simple and can be followed - thank you for sharing

[NikMartin-I-am]

Very nice tutorial, easy to follow and understand, thank you!

[ubaddala]

A very clean and concise video! Keep up the good work

[prakashs]

Good content framed so nicely.. thanks !

[subhamaybhattacharyya]

Great tutorial!! Really very helpful for any AWS developer willing to learn Glue.

Can you please create a video on AWE Data Pipeline with comparisons between the two services?

[alokanand]

Hi all,

We are using AWS Glue + PySpark to perform ETL to a destination RDS PostgreSql DB. Destination tables have columns with primary & foreign keys with UUID data type. We are failing to populate these destination UUID type columns. How can we achieve this, please suggest.

[rkhadke]

Hi, I want to create glue studio connection with snowflake using any scripting language. It can be created using UI method, however want to create it using either terraform, cloudformation etc. Please help.

[Videos-rjek]

can you please make video on moving glue code to prod using CI CD

[grizzlylovegrizzlylove]

Very clear. Good job. Thks a lot

Maybe you can add some few steps to explain how the ouput data can be the consumes with Athena or/and with Quicksight.

[LDH]

Could you introduce about AWS Glue Spark UI with Job and Dev Endpoint (in Sagemaker) for monitoring Spark processes??? I want to know how to make Spark history server in AWS!

[sachinamin]

if you can pls share similar videos on Redshift, MySQL using GLUE studio

Nice tutorial!!, what about Spark SQL Transform ?

[krishnasanagavarapu]

awesome bro <3 .

can you please share any information about transferring this data to snowflake data warehouse ?

Also, how to manage scenarios when the source is not s3, it maybe sks data stream or some website from where data needs to be fetched etc..

[srinathpugalenthi]

Can we migrate informatica XML files to AWS glue studio?

[DineshKumar-cubg]

Is there a way we write the code and it crestes a workflow on editor?

[sachinamin]

is it possible to re-name target file name in S3 - right now it defaults it to

[amitannd]

Hi, I've two problems 1). when I run the crawler on an S3 bucket where i've put the data (CSV file with pipe '|' delimited), it doesn't put the name of the column in output schema neither it asks if the 1st row is header or not. So instead of actual column name it create col0, col1, .. and so on. how to tackle this problem? 2). if a folder contain multiple csv files and different kind of data the corwler creates only one table which appends all the csv files data into one. How to control these?