[Course Home]   [Syllabus]   [Announcements]   [Calendar]   [Handouts]   [Solutions]    

Weekly Calendar

[Week 1]   [Week 2]   [Week 3]   [Week 4]   [Week 5]  
[Week 6]   [Week 7]   [Week 8]   [Week 9]  [Week 10]
[Week 11]  [Week 12]  [Week 13]  [Week 14]  [Week 15] 

Assignment code


Week 1

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Motivations
Organizational Issues

General Introduction
to Deep and Reinforcement Learning
Deep: Chapter 1; RL: Chapter 1  General Introduction  Syllabus  
Thursday Machine Learning Fundamentals
Deep: Chapter 5 Machine Learnining Basics   Deep Learning Review
by Yann LeCun,
Yoshua Bengio
& Geoffrey Hinton  
Homework #1
(Due Jan. 23, 2020)   

Week 2

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Machine Learning Basics (cont)
Neural Networks
Deep: Chapters 5 and 6 Machine Learnining Basics (updated)
Gradient Derivation
for Skip-gram Model
 
 
Thursday Introduction to Neural Networks Deep: Chapters 5 and 6 Neural Network Overview     

Week 3

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Introduction to Neural Networks
(Continued)
Deep: Chapter 6   Neural Network Overview
(Updated)  
   
Thursday Activation functions
Training protocols
Representation learning
Deep: Chapter 6 Neural Network Overview
(Same as last time)
  Homework #2
(Due 2/6/2020)

Softmax layer weights and biases
A sample  

Week 4

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Regularization Techniques
for Deep Learning
Deep: 7.1 - 7.4   Regularization Techniques - Part I
   
Thursday Regularization Techniques
(Continued)
Deep: Chapter 7 Regularization Techniques - Part II    

Week 5

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Optimization techniques
Chapter 8 Optimization techniques    
Thursday Optimization techniques
(Continued)
Chapter 8     Programming Assignment I
(Due March 5, 2020)

USPS ZIP dataset
USPS ZIP training set
USPS ZIP test set
(Description)
(Also available at here named ZIP code)

Week 6

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Optimization Techniques
(Continued)
Chapter 8 Same As Last Time    
Thursday ConvNets Chapter 10 ConvNets   Homework #3
(Due: March 12, 2020)  

Week 7

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Optimization techniques
(Continued)

Convolutional Neural Networks
Chapter 9      
Thursday ConvNets
(Continued)
Chapter 10   Homework #3
(Due: March 12, 2020)  
 

Week 8

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday ConvNets Chapter 9 Same as last time    
Thursday Recurrent neural networks Chapter 10 RNN  RNN Gradient Calculation Notes  Homework #4
(Due March 26, 2020)  

Week 9

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Deep learning case studies Chapter 12 Case Studies    
Thursday Reinforcement Learning - Introduction   Reinforcement Learning     Programming Assignment II
(Due April 16, 2020)

Protein sequence dataset
PDB Sequence Dataset
Brief Description of the dataset.

Term Project
(Brief proposal due: March 26, 2020
Full report due: 5:00pm, Friday, May 1, 2020)  

Week 10

`
DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Reinforcement Learning - Tabular Approaches

Reinforcement Learning - Case Studies for Approximation Approaches
RL: Chapters 3-8 Reinforcement Learning - Tabular Approaches

RL Case Studies - Approximation Approaches  
   
Thursday Reinforcement Learning
(Continued)
Papers from the literature
(see slides for details)  
    H: Optinal Homework #5
(Due 4/23/2020)

Optinal Homework #6
(Due 4/23/2020)  

Week 11

DateTopicsLecture Notes ReadingHandoutAssignments
Spring Break Week Stay SAFE         

Week 12

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Midterm exam review
Deep: Chapters 5, 6, 7, 8, 9, 10
RL: Chapters 2, 3, 4, 5, and 6
Midterm Review  
Study guide
for the midterm exam
 
 
Thursday Formal Tabular Methods
Reinforcement Learning
Chapter 13
Papers (see the slides for details}
Policy Gradient Methods and NAS    

Week 13

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday
(3/31/2020)
Question-answering

Neural Architecture Search
(continued)
 
     
Thursday
(4/2/2020)
Midterm exam        

Week 14

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Midterm exam summary

Neural Architecture Search
(Continued)

AutoML
Papers (See slides for details)   AutoML     
Thursday AutoML
(Continued)
       

Week 15

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Representation Learning
Generative Adversarial Networks
Deep: Chapters 13-15,20   Representation Learning      
Thursday Deep Learning Case Studies - AlphaFlod   Deep Learning Case Studies 

Other protein folding methods
RL: Chapters 6-8, 16   


Week 16

DateTopicsReadingLecture Notes HandoutAssignments
Tuesday Deep Learning Case Studies  
Same as last time    
Thursday Deep Learning Case Studies
(Continued)

Summary and Deep Learning Future
  Summary and Future    


Final Exam Week

DateTopicsReadingLecture Notes HandoutAssignments
Friday Final Project  
 
  Due: 5:00pm, May 1, 2020 

[Course Home]   [Syllabus]   [Announcements]   [Calendar]   [Handouts]   [Solutions]    

Last modified on August. 25, 2017