C4W2L05 Network In Network

Follow us:

[lennonli]

isnt it just a regular filter with 1by1 dimension that is not used for edge detection but change filter dimension or add non linearity?

[JagtarSingh-pvmn]

Is there information sharing happening across the channels in this case?

[nikilragav]

If I didn't already know what was going on, I'd be supremely confused by this explanation 3:31...
The channel @AnimatedAI has a great explanation on 1x1 convolutions.

The way I think about it is you've made a previous layer with a bunch of filters. So maybe you have one filter detecting vertical edges, another doing horizontal edges, another doing angled edges, another detecting red to black transitions, another for yellow colors, etc etc. Now you've got a stack of those images, and you want to go thru each pixel and combine the results of those filters with some weights. So if you want to get complete edge detections, you might add the horizontal edge channel + vertical edge channel + diagonal edge channel (and not include the yellow channel results or the red to black channel). That's what the 1x1 convolution is doing. Mixing the results of the various filters.

Maybe you have a second 1x1 filter channel that is trying to isolate yellow objects next to red objects (like mustard bottles next to ketchup bottles, idk). Then the second filter channel might heavily weight the yellow channel pixels and the red-black channel pixels but ignore the other channels.

You inherently need mixing like this if you want to eventually get to "detect a dog's face".

[siddhantvats]

Curious if we use filters any some other dim but less channel, won't it reduce the resulting channel?

[sadenb]

Can a siamese network be done upon 1x1 convolutions if we have precomputed 1-D features ?

[nikhilrana]

When we multiply 1*1*32 filter with 6*6*32 then no. after multiplied we get for all the 32 channels, we have to take the sum and then apply the relu function to it. Is I am right??

[MeAndCola]

Is this also the case for normal sized filters too? Filters aren't applied over 2D'ally, for each channel, but rather 3D'ally, over the entire channels?

[urarakono]

Does the yellow block of size 1*1*32 have the same numbers over 32 voxels?

[subhamjha]

In what situations is it useful? Can you please provide some case study/example.

[btobin]

I'm not quite sure what he means when he says the output is the # of filters. Doesn't the output of one of those 1 x 1 x 32 (in this case) filters just a single real number?