Machine Intelligence - Lecture 13 (Convolutional Neural Networks, CNNs)

preview_player
Показать описание
SYDE 522 – Machine Intelligence (Winter 2019, University of Waterloo)

Target Audience: Senior Undergraduate Engineering Students


Course Outline - The objective of this course is to introduce the students to the main concepts of machine intelligence as parts of a broader framework of “artificial intelligence”. An overview of different learning, inference and optimization schemes will be provided, including Principal Component Analysis, Support Vector Machines, Self-Organizing Maps, Decision Trees, Backpropagation Networks, Autoencoders, Convolutional Networks, Fuzzy Inferencing, Bayesian Inferencing, Evolutionary algorithms, and Ant Colonies.

Lecture 13 - Convolutional Neural Networks, CNNs
Рекомендации по теме
Комментарии
Автор

Discrete convolutions, weighted sums and many fast transforms are dot products. Max pooling is switching. ReLU is a switch 🤔 f(x)=x connect, f(x)=0 disconnect. A light switch in your house is binary on off yet connects and disconnects a continuously variable AC voltage signal. A ReLU net then is a switched composition of dot products. The dot product of a number of dot products is still a dot product. Then you can see that when all the switch states in a ReLU net become known it collapses to a simple matrix, with various things you can look at.
You can swap what is adjusted in a neural network. You can have fixed dot products (enacted with fast transforms) and adjustable (parametric) activation functions like fi(x)=ai.x x<0, fi(x)=bi.x x>=0, i=0 to m. The fast Walsh Hadamard transform can be viewed as a system of dot products where the cost per dot product is a very low log2(n) add subtracts. Such a Fast Transform fixed filter bank neural network then is: transform, functions, transform, To stop the first transform from taking the spectrum of the input data (which is a bit unhelpful) you can apply a fixed randomly chosen (or sub-random) pattern of sign flips to the input to the net. Such a net likewise collapses to a simple matrix for a particular input. There is a theme here😀

hoaxuan
Автор

0:00 - 0:04 who's that cute boy on the bottom left 😍😍

silverrapth