Database Sharting Explained

How do large apps grow their databases to millions of users? In this quick video we explain the difference between horizontal and vertical database scaling techniques.

#programming #database #shorts

[PaulHosler]

Boss man: what's that leaking out of the server?
dbAdmin: the database sharted

[PitersChannel]

I hate when my databases start sharting.

[fatbirb]

"Sharting"
I see you're trying to increase engagement. Well, it's working.

[botcontador]

Ok, you tricked me into watching this in a loop without realizing it.

[elco]

SQL databases can be scaled horizontally as well, not just noSQL.

[ammptoskatharos]

"I'M SHHHAARRTTIINNGG HERE"
"In the server?"
"NO, IN REAL LIFE!"

[joergsonnenberger]

Two things to keep in mind for the new guys:

First, hardware has come so fast over the last twenty years, that a normal 2000USD server gets you a very long way with a reasonable database like Postgres. Forget about Twitter and the like, they have a load most web applications will never see.

Second, NoSQL databases generally take a number of short cuts. They often don't provide ACID, so don't trust them with valuable data. They often require you as the programmer to do the heavy lifting of aggregating data from different sources, or worse. The whole map/reduce mantra for example is often a cheap man's query optimizer.

Sharding can be done with traditional databases as well. You lose some of the functionality, of course, but not all of them. Let's take the Discord example: nothing stops you from distributing the set of Discord "servers" across different databases on different database servers, so that within one Discord "server" you can still operate with a normal relational database. This works well and nice as long as your largest "shards" fit unto a single machine and see point one again.

[deldarel]

Aah, like distributing the stain over multiple briefs

[boooooooky]

Thank you for explaining Database Sharting!

[sawanstor]

SQL databases can also scale horizontally (Google Cloud Spanner)

[NathanHedglin]

They also use Sharding with SQL databases. NoSQL only works well with flat no relational data.

[gravestoner]

I havent gone to the comments section this fast since jan 6th

[EvanBoldt]

Nobody:
Replica DB: Who just shart my pants?

[Muzzino]

Finally someone who spells it the right way

[BrandonAaskov]

Hahahahaha despite the title the punch line still got me. 😂😂😂

[chefaku]

How does a db search for an index on multiple machines?
split the indexes for each machine, like:
machine 1: a to l
machine 2: l to z

Or instead search by index on each machine?
machine 1: a to z
machine 2: a to z

[apolloapostolos]

The production on this was fun to watch. Awesome. 🎉 how you do it??

[ciach_]

Discord doesn't use cassandra anymore because it didn't fit the needs, they switched to Scylla Enterprise Database

[Zaph_Kiel]

nosql doesnt inherently scale horizontally, they are for key/value pairs with no referential integrity. You can scale an sql db horizontally with mircoservices or logical division.

[lashlarue]

😂😂😂❤❤❤ the most wonderful accident in the English language is that both "sharding" and "sharting" are absolutely PERFECT at describing the underlying meaning ❤❤❤😂😂😂