Residual Networks and Skip Connections (DL 15)

Davidson CSC 381: Deep Learning, Fall 2022

[GisleGaren]

I can't remember the last time I commented on a youtube video as it was much too long ago, but I just had to because your videos on deeplearning are CRIMINALLY underrated. I have yet to find another resource that explains ResNet so intuitively as you break down each concepts to laymen terms and you take your time explaining them. You have an amazing way of explaining concepts and I sincerely hope your videos get all the recognition they deserve!

[tinymints]

that was UNBELIEVABLY clear and understandable. THANK YOU

[ashishbhong]

i have seen a lot of online lectures but you are the best for two reasons, the way you speak is not monotonous which give time to comprehend and process what your are explaining, and the second is the effort put in video editing to speed up when writing things down on board which doesn't break the flow of the lecture. Liked your video. Thanks🙂!

[alexei.domorev]

ResNets are tricky to conceptualise as there are many nuances to consider. Dr Bryce, you have done a great job here offering such a brilliant explanation that is both logical and easy to follow. You definitely have a gift of explaining complex ideas. Thank you!

[khaliliskarous]

Best explanation I've seen for skip connections. Thanks!

[AdityaSingh-qkqe]

This is the clearest video that I've ever seen which explains the resnet for a layman, while at the same time conveying all the very important and relevant information related to resnet - I couldn't understand the paper - but with this video finally understood it - thanks a lot Professor Bryce - hope you create more such videos on deep learning

[anirudhsarma]

very very very good explanation. almost all explanations on this forget about the influence of random weights on the forward propagation and focus solely on the backward gradient multiplication. which is why i never understood why you needed to feed forward the input. thanks a lot

[BartDriessen]

Thank you so much for putting this out there, this is incredibly well-explained!

[priyanshpal]

Thank you professor. The best explanation, he includes influence of random weights on forward propagation.

[lallama]

Love your explanation, very easy to understand the concept and the flow of the ResNet in 17 mins! Really appreciate it <3
Thanks for explaining the small details and visualize it for us beginner to understand in a visual form !

[vernonmascarenhas]

I am writing a thesis on content-based image retrieval and I had to understand the ResNet architecture in-depth and by far this is the most transparent explanation ever!!

[Engrbrain]

I am going to complete the entire playlist. Thanks, Bryce, you are a life saver

[giordano_vitale]

Every single second of this video conveys an invaluable amount of information to properly understand these topics. Thanks a lot!

[garydalley]

Awesome explanation. Got me through a learning hurdle that several others could not.

[subramanianiyer]

Thank you Prof. Bruce for explaining this thing with minimal complicated technicality

[zhen_zhong]

This tutorial is so clear that I can follow along as a non-native English speaker. Thanks a lot!

[alissabrave]

Brilliant explanation! Thank you so much, Professor Bryce!

[ali]

Thank you very much for putting the time and effort. This is one of the best explanations I've seen (including US uni. professors)

[shobhitsrivastava]

Until now, this is the best Residual Network tutorial I have found. As constructive feedback, I would like you to dive more deeply into how shape mismatches are handled because that part is not at par with the rest of the highly intuitive explanations of various things happening in a ResNet.

[rishabhagarwal]

Brilliant explanation, the 3D diagrams were excellent and I could understand some tricky concepts, thank you so much!