AWS Serverless Lambda Supports Response Streaming

Lambda now supports Response payload streaming, now you can flush changes to the network socket as soon as it is available and it will be written to the client socket. I think this is a game changing feature

0:00 Intro
1:00 Traditional Lambda
3:00 Server Sent Events & Chunk-Encoding
5:00 What happens to clients?
6:00 Supported Regions
7:00 My thoughts

Fundamentals of Backend Engineering Design patterns udemy course (link redirects to udemy with coupon)

Fundamentals of Networking for Effective Backends udemy course (link redirects to udemy with coupon)

Fundamentals of Database Engineering udemy course (link redirects to udemy with coupon)

Follow me on Medium

Introduction to NGINX (link redirects to udemy with coupon)

Python on the Backend (link redirects to udemy with coupon)

Become a Member on YouTube

Buy me a coffee if you liked this

Arabic Software Engineering Channel

🔥 Members Only Content


🏭 Backend Engineering Videos in Order

💾 Database Engineering Videos

🎙️Listen to the Backend Engineering Podcast

Gears and tools used on the Channel (affiliates)

🖼️ Slides and Thumbnail Design
Canva


Stay Awesome,
Hussein

[MaulikParmar]

This announcement is because the base project that powers lambda called "Amazon Firecracker" released 1.3.0 on march 2 which added this line in releases.

"Improved TCP throughput by between 5% and 15% (depending on CPU) by using
scatter-gather I/O in the net device's TX path."

Essentially, it allows the sheer scale of the platform to take that extra TCP overhead and remove restrictions without waiting for application to write to buffer and pass it down, instead it can pass small chunks and OS will take care of stitching written data.

[coekush]

Thanks for the quick intro to the new AWS Lambda response streaming feature. Your content was insightful and easy to understand. Appreciate it!

[penry]

This is pretty cool, can actually self host next13 server components now! Did you see vercel's write up on how that were mocking streaming responses? Pretty interesting stuff

[ChristianProetti]

Cloudflare Workers has had this for like 3 years.

[Kyu]

Interesting, would like to see these in action soon, to test out the limits and constraints of this feature..

[FauzulChowdhury]

I did host pages before in serverless and works fine. Yes it had cold start issues but hey, it worked great for dev / qa environments without costing almost anything.

[ctmithun]

Are there any updates from AWS on expanding this feature to other programming languages?

[pritomb]

I think this feature will be helpful for delivering the API responses which are very long and need a lot of time to calculate. So, if it can stream the list of data sequentially as a stream of data, then the frontend app can start populating the data and Don't have to wait for the entire batch processing. I am not sure I haven't read the feature docs yet. If this is the case then it's really a game changer I think. But I have to read the docs in detail.

[catcatcatcatcatcatcatcatcatca]

Doesn’t removing the return size cap open a lot more doors than just better responsiveness? Cost is the only cap on how long and complex you want your return to be. If you wanted to create an application that returns an animation that zooms into the mandelbros set diagram, or any other endless task, can’t you now do any such task?

In one sense it makes a lot of sense if you can. AWS would obviously prefer you to use their service as much as possible. Most likely any such application would in practice be better done with some other amazon service.

But it still would be a very fundamental change, allowing not just tasks dependant on response time and much longer tasks that would have been limited not by response time but by the cap on data returned.

[shahriajamankhan]

Please make a video on Firebase (backend as a service).

[mikestaub]

This is the biggest feature since they accounted lamba.

[ZeeshanAli-nkxk]

jazakAllah u khair for the video. How is your Ramadan going on?

[joelamoako]

I think you should start a podcast on apple podcasts

[e.b.]

Can you make a Video on GPT? I just cant stop being sad.

[thenelson_o]

12 mins video and you couldn't write any code? Just talks?
This is not helpful for us developers