Computer Perception Extended

WEEK 02

* * *

Main repo

1. Students intro

Status Quo?

2. Inner Working of a NN

diagram

2.1 Forward Propagation

View reference

Neuron

diagram

Layers

diagram

Weights

diagram

Activation & Weights

diagram

Activation & Weights

diagram

Sigmoid

diagram

Bias

diagram

Learning

diagram

Matrix operations

diagram

Matrix operations

diagram

Neuron is a function

diagram

NN is a function

diagram

Sigmoid VS ReLU

diagram
diagram

2.2 Gradient Descent

View reference

Cost Function

diagram

High Cost

diagram

Low Cost

diagram

Average Cost

diagram

NN Function Parameters

diagram

Cost Function Parameters

diagram

1D Cost Function

diagram

2D Cost Function

diagram

Gradient Descent

Find the shortest path to walk down a hill

One step after another...

diagram

2.3 Back Propagation

View reference

Different importance of components

diagram

Propagating Backward

diagram

Summary - Looking back at 'our three figures'

Forward Propagation

diagram

Gradient Descent

diagram

back Propagation

diagram

Machine Learning Project Checklist

  • 1. Frame the problem and look at the big picture.
  • 2. Get the data.
  • 3. Explore the data to gain insights.
  • 4. Prepare the data to better expose the underlying data patterns to Machine Learning algorithms.
  • 5. Explore many different models and short-list the best ones.
  • 6. Fine-tune your models and combine them into a great solution.
  • 7. Present your solution.
  • 8. Launch, monitor, and maintain your system.