Math for Intelligence

YouTube search...

• Animated Math | Grant Sanderson @ 3blue1brown.com
• Introduction to Matrices and Matrix Arithmetic for Machine Learning | Jason Brownlee
• Brilliant.org
• Varient: Limits
• Probability Cheatsheet

3blue1brown

• Animated Math | Grant Sanderson @ 3blue1brown.com
  • Essence of linear algebra
  • Essence of calculus

Explained

Dot Product

• http://en.wikipedia.org/wiki/Dot_product Dot Product | Wikipedia]

Dot Product =

• Algebraically, the dot product is the sum of the products of the corresponding entries of the two sequences of numbers.
• Geometrically, it is the product of the Euclidean magnitudes of the two vectors and the cosine of the angle between them.

Take a moment to understand how the computation above is being done. We slide the orange matrix over our original image (green) by 1 pixel (also called ‘stride’) and for every position, we compute element wise multiplication (between the two matrices) and add the multiplication outputs to get the final integer which forms a single element of the output matrix (pink). Note that the 3×3 matrix “sees” only a part of the input image in each stride. In CNN terminology, the 3×3 matrix is called a ‘filter‘ or ‘kernel’ or ‘feature detector’ and the matrix formed by sliding the filter over the image and computing the dot product is called the ‘Convolved Feature’ or ‘Activation Map’ or the ‘Feature Map‘. It is important to note that filters acts as feature detectors from the original input image. | ujjwalkarn

Josh Starmer - StatQuest

• StatQuest