Topics Covered in the Course, with Number of Lectures on Each Topic (assume 15-week instruction and one-hour lectures) |
Week | Lecture | Topics Covered |
Week 1 |
1 |
History of Computer Vision, Top Research in the area, Introduction to Machine Learning, Learning algorithms |
|
2 |
Introduction to deep learning, Types of Machine Learning, Problems Classification vs Regression, Linear Regression |
Week 2 |
3 |
What is a Neural Network , House Price Prediction example using Linear Regression, Loss Function |
|
4 |
Training a Neural Network, Logistic Regression (Binary Classification), Sigmoid Activation Function, Logistic Regression Cost Function, Log Based Loss Function, Computational Graph |
Week 3 |
5 |
Gradient Descent mathematical derivation, Neural Network with one hidden layer, Computing output of the neural network, |
|
6 |
Vectorization for programming NN, Gradient Descent on 'm' examples, Different Type of activation function in NN |
Week 4 |
7 |
Propagation in Neural Networks, Forward propagation , Backward Propagation |
|
8 |
Step by Step example for forward and backward propagation for neural network with one hidden layer (XOR Example) |
Week 5 |
9 |
Neural Network Implementation in python (XOR Example), Techniques for Improving Neural Networks : hyper-parameter Tuning, Dataset Splits |
|
10 |
Bias and Variance Trade-off, regularization, dropout Regularization, |
Week 6 |
11 |
Improving Neural Networks, hyperparameters, Dataset splits, Bias and Variance , Mismatched Train/Test Distributions, Data Augmentation Techniques, |
|
12 |
Early Stopping Technique, Orthogonalization in Machine Learning, Normalizing Inputs, Vanishing and exploding gradients, |
Week 7 |
13 |
Weight Initialization ,Batch Vs. Mini batch gradient descent, |
|
14 |
Training with mini-batch Gradient Descent , Multiclass classification |
Week 8 |
1 hours |
Mid Term |
Week 9 |
15 |
SoftMax Function, Training a neural network with softmax function |
|
16 |
Edge Detection Examples , Convolutions, Convolutional Masks |
Week 10 |
17 |
Padding ,Strided Convolutions, Convolutions Over Volumes |
|
18 |
One Layer of a Convolutional Net, Simple Convolutional Network Example, |
Week 11 |
19 |
Pooling Layers ,CNN Example ,Why Convolution, Why look at case studies |
|
20 |
Classic CNN Based Networks, ResNets , Why ResNets Work |
Week 12 |
21 |
Network In Network, Inception Network Motivation , Object Localization |
|
22 |
Landmark Detection, Object Detection , Convolutional Implementation Sliding Windows |
Week 13 |
23 |
Intersection Over Union, Non-max Suppression, Anchor Boxes |
|
24 |
CVPR-RESEARCH ARTICLE -1 (YOLO Algorithm) |
Week 14 |
25 |
What is face recognition, Face Verification, One Shot Learning |
|
26 |
Siamese Network, Triplet loss, CVPR-RESEACH PAPER 2 |
Week 15 |
27 |
What is neural style transfer, What are deep CNs learning, Cost Functions |
|
28 |
1D and 3D Generalizations, RESEACH PAPER 3 |
Week 16 |
29 |
Group Presentations -1 |
|
30 |
Group Presentations-2 |
Week 17 |
2 hours |
Final Term |
|