AWS: How to use AWS Glue ETL to convert CSV to Parquet - Tutorial

preview_player
Показать описание

Video: AWS Glue is a managed ETL platform, and can be used for storing your data Schemas, as well as ETL tasks in Python, or Java. A common ETL use case is to convert CSV files to the much more efficient Parquet files. Glue makes this easy, and can automatically handle this transition from your objects stored in S3.

Learning Objectives:
- Updating IAM policies to allow access to new prefixes in S3
- Creating a AWS Glue ETL job
- Configuring a AWS Glue ETL job to convert to Parquet Format
- Querying Parquet files using Amazon Athena

***
Full AWS Playlist:

Find out more about Firemind:

#AWS
  1. Firemind
  2. AWS
  3. Tutorial
  4. Glue
  5. ETL
  6. CSV to Parquet
Рекомендации по теме
AWS In 5 0:05:30

AWS In 5 Minutes | What Is AWS? | AWS Tutorial For Beginners | AWS Training | Simplilearn

AWS In 10 0:09:12

AWS In 10 Minutes | AWS Tutorial For Beginners | AWS Cloud Computing For Beginners | Simplilearn

What is AWS? 0:03:12

What is AWS? | Amazon Web Services

Top 50+ AWS 0:11:46

Top 50+ AWS Services Explained in 10 Minutes

Introduction to Amazon 0:04:02

Introduction to Amazon EC2 - Elastic Cloud Server & Hosting with AWS

you need to 0:07:38

you need to learn AWS RIGHT NOW!! (Amazon Web Services)

AWS EC2 Tutorial 0:22:17

AWS EC2 Tutorial For Beginners | What Is AWS EC2? | AWS EC2 Tutorial | AWS Training | Simplilearn

Getting Started With 0:23:54

Getting Started With AWS Cloud | Step-by-Step Guide

AWS Project: Build 0:26:09

AWS Project: Build a Serverless File Sharing Platform with AWS (Step-by-Step Tutorial) #AWSCommunity

AWS Tutorial For 9:28:40

AWS Tutorial For Beginners | AWS Full Course - Learn AWS In 10 Hours | AWS Training | Edureka

Introduction to AWS 0:38:54

Introduction to AWS Services

Deploying a Website 0:00:43

Deploying a Website to AWS in Under 1 Minute

What is AWS 0:10:46

What is AWS | AWS in 10 Minutes | AWS Tutorial for Beginners | AWS Training for Beginners | Edureka

Intro to AWS 0:50:07

Intro to AWS - The Most Important Services To Learn

What is Amazon 0:07:29

What is Amazon Web Services? AWS Explained | Tutorial & Resources

How to learn 0:06:04

How to learn AWS for Free (Resources Included)

Getting Started with 0:26:52

Getting Started with AWS | Amazon Web Services BASICS

AWS Management Console 0:13:23

AWS Management Console In 15 Minutes | AWS For Beginners | Cloud Computing | Great Learning

AWS SageMaker Tutorial 0:25:34

AWS SageMaker Tutorial | Introduction To AWS SageMaker | AWS Tutorial For Beginners | Simplilearn

AWS & Cloud 0:49:26

AWS & Cloud Computing for beginners | 50 Services in 50 Minutes

How to Build 0:12:04

How to Build a Simple Web App Using AWS

Introduction to AWS 0:03:02

Introduction to AWS Lambda - Serverless Compute on Amazon Web Services

How to Create 0:12:56

How to Create an EC2 Instance in AWS in 2023

AWS Certification Roadmap 0:06:54

AWS Certification Roadmap for Complete Beginners (2023)

Комментарии
Автор

Very Nice. Earlier, I was keep getting error but after watching your video its resolved. Thanks :)

puneetsharma
Автор

Thank but I want to convert multiple files CSV to parquet from the same folder target s3 output s3 pls help me out

AbhishekDubey-tdks
Автор

good video, short and to the point - quick question though, I noticed your timestamp fields were set to string datatypes - have you had any success converting them to timestamp? thank you

mattphb
Автор

👌 excelent sorry are you pre created crawler? Thanks!

MegaLobo