Amazon DynamoDB: The architecture that scales to 10 TRILLION requests daily

Amazon DynamoDB is a very popular NoSQL datastore used by over 1 millions customers at AWS.

In this video, we dive into its internal architecture to understand how it scales seamlessly, using insights from it's linked research papers.

00:00 Features
00:21 1. ~90 Million RPS
00:33 2. Easy Setup
00:41 3. NoSQL
01:00 4. Transactions
01:20 5. Strong Consistency
01:30 6. Low Latency Variance
02:14 High-Level Design
05:13 Data Consistency
07:45 AWESOME caching!
10:59 Data Schema
14:30 Capacity Booking
19:28 Thank you!

v=HaEPXoXVf2k

#Amazon #DynamoDB #ResearchPaper

[gkcs]

EDIT: Amazon supports 20 GSIs instead of the 4 mentioned in the video. Thanks to anand_ammathil who pointed this in the comments 😁

Glad to see you here again!


Cheers :D

[priyanshrawat]

I don't really understand most of the stuff you say because I am just an undergrad but all this stuff is so fascinating....I love the engineering involved in these big applications!

[kalpakHere]

Great to see you back in action.

Please follow it up with Spanner, Cosmos DB, Aurora, and the latest AWS' DSQL. It would be of immense help.

[chandrabhanurastogi]

I recently came across your small videos (reels). I am loving them. Apparently that's how much time and content one needs to start a conversation.

[harvendrasinghrathore]

DynamoDb also works on pay on demamd model which cost you for the RCUs and WCUs you made, I think which is great where i don't need to bother what capacity i had to choose and irregular traffic on system.

[Md_sadiq_Md]

10:55 💰💰
You're a good story teller besides an excellent system design teacher

[NikhilKumar-oymx]

Wow 😮, i used this every day in a project and fetched saved consistently but today i understood the depth 😢
Thanks a lot sirji ❤

Its a gem of a channel

[maxivy]

This guy is the future of teaching SWE online imo, very robust against AI swarming everything

[pawanrajypr]

The way you walkthrough makes it easier ❤

[harvendrasinghrathore]

I think a single table can allow more than 4 GSIs, beacuse i had used 6 in one of application which works on single table design.
Thanks for this great content @Gaurav ❤

[archiliusfowl]

Thanks for this. It would also be interesting to see how other competing NoSQL datastores are architected.

[NoName-lzbc]

10:57 at this point why to keep a cache at all?

[Abhigyan_Bafna]

Hey GKCS, I'm a newbie to sys designs and usually things just bounce off my head or I need to watch them multiple times to gain some sort of assumed sense but the data scheme part of this video was great! I understood almost everything and was enjoying it a lot.

I dunno if you did anything different for that section or it was just the visuals, but maybe try doing whatever you did more?

[parassharma]

Great video as always, currently I'm reading a book "Design data intensive applications " I found it really interesting. Can you suggest some more Programing books for distributed systems and backend engineering

[suyashnigam]

Hey Gaurav, i got confused in caching strategy, you meant when requests rate go down cache will make sure to keep on querying the db so that when there is again increase in traffic it will be ready to handle that much load through cache only ?

[NikhilKumar-oymx]

Why does almost every service has some sort of usage of s3

[imerence]

How is this compared to google spanner ?

[B-Billy]

@Gaurav sir, someone recently said in his video "People talk about consistenct hashing, and say we can create a Ring and blah blah blah, but nobody knows how to implement one, or how it has already been implemented".
Can you please please please make a video on this topic and request you to cover any curently availabe impelementation.

[simarpreetsingh]

Hey Gaurav, can you share where can someone find Research Papers related to Designing Systems

[Tanmay-mi]

bro i didn't understand anything due to my poor fundamental knowledge so can you please tell me what all things i need to learn to make my fundamentals strong and to become a better engineer. I really want to understand these things so that in future i can also come up with smart ideas.