Dot Product

YouTube search... ...Google search

• Causation vs. Correlation
• Kernel Trick
• Math for Intelligence
• Dot Product | Wikipedia

Dot Product =

• Algebraically, the dot product is the sum of the products of the corresponding entries of the two sequences of numbers.
• Geometrically, it is the product of the Euclidean magnitudes of the two vectors and the cosine of the angle between them.

Take a moment to understand how the computation above is being done. We slide the orange matrix over our original image (green) by 1 pixel (also called ‘stride’) and for every position, we compute element wise multiplication (between the two matrices) and add the multiplication outputs to get the final integer which forms a single element of the output matrix (pink). Note that the 3×3 matrix “sees” only a part of the input image in each stride. In CNN terminology, the 3×3 matrix is called a ‘filter‘ or ‘kernel’ or ‘feature detector’ and the matrix formed by sliding the filter over the image and computing the dot product is called the ‘Convolved Feature’ or ‘Activation Map’ or the ‘Feature Map‘. It is important to note that filters acts as feature detectors from the original input image. | ujjwalkarn