AWS Glue custom classifier | Grok | AWS Glue tutorial | p6

Welcome to part 6 of the new tutorial series on AWS Glue. In this video, I have covered the AWS Glue custom classifier and specifically, the grok custom classifier with hands-on.

---
Support my work:
---
Paytm | Gpay: 9023197426

---
Series Tutorial
---
---
Another channel:
---

---
Connect with me
---

00:00 Getting started with AWS Glue custom classifiers
01:24 Understaing role of classifiers
02:35 How crawler choose classifier
04:45 Types of classifiers
05:34 When to use custom classifier
06:04 Understanding Grok & its syntax
09:05 Parsing log file via grok pattern
13:16 Pasrsing apache error log via grok pattern
17:25 Notes | Limitations
18:14 Hands-On overview
18:48 Hands-On | Demo

[meenakshisharma]

The Best Tutorial, step by step explanation. Much appreciated. Thankyou so such a wonderful content.

[arghyakundu]

The Best Tutorial on AWS Glue. Covered all the Topics. Very helpful for Interview Preparation.
Best Thing is : - Detailed Hands-On helps to understand the Topics better.
Go for it..!!

Thanks to the Mentor who did a excellent Job.

[VinodGouda]

Gem💎 this channel is!

We need these kinds of realtime hands videos on advanced topics like this rather than the basic ones which others do.

[scottbraley]

This is fantastic stuff. Thank you so much for taking the time to create this series.

[sachinroge]

Tried creating custom classifier with the same you pattern that you shown.
Getting this error when creating custom classifier:
Unable to add classifier
{"message":"Grok pattern cannot be compiled.", "code":"InvalidInputException", "time":"2023-09-27T11:43:23.127Z", "requestId":"88d82666-be99-4c7c-9278-f0faa1236e11", "statusCode":400, "retryable":false}

Any solution will be appreciated. Thanks.

[TheRealTechExperience]

Thanks for making hands-on videos . Waiting for more such videos.

[AlbertSuwandhi]

Nice tutorial. Would you mind sharing the grok custom pattern note? Thank you.

[vinaypenta]

Please make more videos on other AWS sources sir.. Going through your videos really gave me a great exposure to AWS Glue.

[jananimurugan]

Very useful, Thank you for this type of examples.

[abhimanyukakde]

Hi,
Please make more videos on other AWS all sources in built-in ETL pipeline in RealTime.

[SashankYakkali]

what should i be doing if i want the data type to be DATETIME. As the primary key for the table im using is of the data type DATETIME

[Learning_Compass]

How can we use grok pattern to read multiline data?

[jyotiprakashnayak]

Please make a video on others there custom classifiers

[banarasi]

anyone who ran this code, please share the grok pattern, it is not working made by me

[udaynayak]

Thank you for sharing this information, if possible can you share a SCD-2 scenario in AWS glue with the help of DF/Spark.sql?

[bhargavk-ugeb]

can anyone please share the grok pattern

[road_to_sunshine]

can you also provide the data files ???