Deep .NET: Let's Build Our Own ArrayPool with Stephen Toub and Scott Hanselman

Stephen is back with Scott going DEEP with .NET! This time they are building their own ArrayPool from scratch explaining how it actually works. Then they go deeper into the built in ArrayPool of .NET and why you need it in your life!

Chapters:
00:00:00 Intro
00:00:05 Impact and Functionality of Array Pool in .NET Development
00:03:57 Understanding the Importance and Application of Pooling in Web Services
00:06:55 Understanding Object pooling and Optimization in Programming
00:13:10 Complexities and Mechanisms of Array Pools in Programming
00:17:54 Concept and Implementation of Array Pools in Programming
00:23:32 Array Length Optimization and Waterfall Strategy
00:26:09 Array Pool Implementation and concurrent Queue Operations
00:31:24 Memory Pressure Management and Thread Management in Computer Systems
00:32:58 Understanding the Complexities and Trade-offs in Core Efficiency and Performance
00:37:04 Async Methods and Task Allocation in Programming
00:39:51 Understanding the Generational Collection and Array Pooling in Computer Memory Management
00:45:53 Understanding Array Pool and Stack Allocation in Programming
00:51:59 Array Pool Optimization and Memory Usage Patterns
00:58:32 Strategies for Overcoming Analysis Paralysis in Software Development
01:01:33 Implementation and Challenges of Keyword Search in .NET 9

Resources:

Connect with .NET:

#dotnet

[CuriouslyContent]

What I love about this series is that you have an expert who could, if asked to do so, completely overwhelm most regular developers with technical detail and advanced topics, but you also have a seasoned non-expert (in this area anyway) sitting in to ask questions and explore the knowledge space in a way that is comfortable for most mere mortals.

[mranthonymills]

I'm really loving these "let's make a simple version of X so you understand it" videos!

[JasonBock]

I love this series. I really enjoy hearing Toub talk about these deep concepts.

One request: get Toub a better mic :). Occasionally his voice got really quiet and it was hard to hear what he was saying.

[Rob_III]

Over an hour of two legends! I'm a simple man, I click, I watch!

[justgame]

Locking content next could be really interesting. ConcurrentDictionary, lock, Semaphore, SemaphoreSlim etc. I think most developers (me included) use and take these for granted without really knowing what they’re doing behind the scenes

[flygonfiasco]

Would love to see a similar video going in depth about the GC. Love this duo!

[yohanneskifle]

This is fast becoming my favorite series of your channel, and I really loved this episode

[egreg]

Great series, clear explanations. Maybe a future episode on how System.Threading.Channels are implemented(comparison with other producer consumer collections) or some concurrent collections internal implementations.

[nokkeli]

That doggo looks sooo relaxed sleeping on the couch <3

[chrisanders]

This is so great. Everytime I watch Stephen I'll learn something new

Great episode. Suggestion for topics could be some math stuff like using optimized vectors SIMD etc. I think Tanner Gooding focuses on that area? Or various synchronization mechanisms in .NET System.Threading.Lock.

[juanbautista]

Just started and already know this gonna be a banger of a video

[talwald]

Great, as always! Please schedule these so we know they are coming!
Also, I would love a deep dive on Kestral internals and all the great work put into that over the last few years.

[barionlp]

can you make a deep dive on how to correctly measure performance? it seems trivial at first but I feel like there are so many things people do wrong when measuring

[ahupond]

So cool to get insights on how the framework actually works, and how it is expected to be used. The internet was definitely lacking content of that level of expertise, and I hope deep dotnet will continue for a long time. So excited to hear there'll be more guests, although I could be listening to Stephen for hours. He did set the standard at quite the level!

[henrikstornblom]

These videos are so great and interesting. Thanks.

[GuildOfCalamity]

Love these roll-your-own videos, keep em coming plz!
Small request: Can you use a dark theme? My eyeballs are burning after that.

[MatteoGariglio]

Thanks for bringing up this topic! It's very interesting and instructive. I really like the 'Deep Dot Net' video series—there's always so much more to learn and ideas to draw inspiration from. Thanks for organizing it, and special thanks to Stephen for sharing his valuable knowledge!

[RJiiFin]

Really like these deep dives! Thank you

[ollhax]

Love this series! It's very interesting (and useful!) to get a glimpse of the inner workings and tradeoffs you talk about. As a game developer I tend to use _a lot_ of pooling, accepting the increased memory use and the sometimes reduced linear performance over having the GC kick in and cause frame drops that are very noticeable for the player. I hope this is a use case that is considered as well :)