System Design: Live Streaming Events like ESPN and Hotstar

Use the "HELLOWORLD" coupon to get 20% off.

This lesson talks about workflows that can handle video uploading and transformation in real-time. Such systems are necessary for live streaming systems like Disney Hotstar and ESPN.

You can watch the remaining videos from this design on the InterviewReady website.

You can follow me on:

#SystemDesign #InterviewReady #LiveStreaming

[deniz-ofnz]

you are so charming while explaining smtg. im not on the system design stuffs but watching your videos and started to learn smtg about. thanks a lot:))))

[Srimudit]

can't thank you enough for your videos and the amount of information the contains.

[asashish]

Gaurav mentioned backpressure without actually mentioning backpressure. Noice!😎

[the-sporting-record-book]

Let me know if my understanding is correct

Live video recording
|
Stream to backend servers via RTMP (A protocol written to on TCP)
|
Video transformation service (decided 8k videos of size say 500 MB (since it is streaming video in small portions))
|
Push a message in queue with chunk and what resolution to convert
|
Worker nodes (adjust the resolution and bitrate )
|
Upload to dfs and push another message to queue with modified quality video chunk
|
Chunk distribution workers (distributes the chunks over cdn)
|
Viewers will get the video from nearest edge cdn servers with low latency, and adaptive video quality with a smooth experience

[Nithin_Coorg]

We had stream outage in ipl finals 2022! Well explained! 👏 processing at transformer service will make delay isn't? So we see a delay as opposed to satellite ?

[dhruvilshah]

Love your content! Keep it up. If possible make videos in LLD

[MohammadHabib-izqf]

This is an old video but I must say that it's a terrible idea to include any sort of file storage or queues in the live publishing path. What Gaurav's done here is taken a simplistic "design youtube video upload" architecture and labeled it as live streaming. Generally, with live video, you'd want to minimize end to end latency, and you'd want to re-stream transcoded frames to multiple replicas. File storage, queues, and async transcoder tasks are all antithetical to minimizing latency. As for protocol, UDP would be a great choice streaming the video to users (no need to maintain thousands of TCP connections). You can deal with out of order packets and packet drop in a live setting. When learning system design from these videos, we should always be skeptical of what's being said. No one person is an expert in all domains, or has ideas that are 100% good.

[slickliverpool]

This video is above me, but I enjoy these technical videos just to get an idea on what's going on via the backend.

[shimamadadi]

Gaurav has some ideas and maybe good for practice for like interviews but in real world there are a lot of complexities to deliver such service in a scalable matter.

also Guarav rushed to publish this I think, he could have added some points on CDN, error handling, different codecs, latency, and others issues related to live streaming, anyway go take a look at people working in streaming company tech presentations and you learn a lot and also try to implement it yourselve.

[AvaSession]

Hey Gaurav, great video again! Thank you. Do you think you'll ever do a video on System Integration? How do you get System A to talk to System B? Or how would you migrate a database from one system into another? These are common occurrences in mergers and acquisitions. I'd love to hear your thoughts on it. Thank you for the consideration.

[tanimhbk]

recently found your content. very well versed! keep up the good work!

[PremkumarD]

Hey, I want that load balancer hoodie. where do i get it ? BTW big fan of yours

[RahulJainDeveloperLite]

Hey Gaurav, just a suggestion- please try to avoid zoom in, zoom out in videos, gets a bit frustrating at times. Very good content though, thanks a lot!!

[failist]

Hi! Can you make a video on live streaming using RTMP vs HLS?

[piyushtekchandani]

How to scale queue and configure partition in this case?
We cannot predetermine how much live streams will happen on platform and accordingly make partitions.
Can you highlight this?

[YogeshRawat]

for each stream or match, do we have a different queue ? I guess by adding queue we are introducing the delay .

[shivam]

Thank you for all the great contents Gaurav. I've learnt a lot from your videos. I have a question, instead of using a queue, can't the stream of video be ingested in some streaming platform like AWS Firehose transformation done there and the transformed data be pushed to say S3 bucket to be ingested by the intended app.

[অকপট০০৭]

I need a suggestion from you. Do u know how can i get the subscription package for streaming for website?

[divyangshah]

Question is how will subscribers like tablet, mobiles read from the queue ? kafka wont be running on these or any other messaging queues, correct ? will it be a websocket call ?webhooks or httpstreaming ?

[ferringxor]

Hey Gaurav I want to buy out your course but I don't see any where over portal also coverage of code and practical Implementation . Can you or your team will help me on that part?