[Course Home] [Syllabus] [Announcements] [Calendar] [Handouts] [Solutions]

Weekly Calendar

[Week 1] [Week 2] [Week 3] [Week 4] [Week 5]
[Week 6] [Week 7] [Week 8] [Week 9] [Week 10]
[Week 11] [Week 12] [Week 13] [Week 14] [Week 15]

Assignment code

E - Exercise (do not need to turn in).
H - Homework (need to turn in hardcopy).
P - Programming projects.
D - Specified assignments are due in class today.
M - Midterm.
F - Final.
S - Self study.

Week 1

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Wednesday	Motivations Organizational Issues General Introduction to Deep and Reinforcement Learning	Deep: Chapter 1; RL: Chapter 1	General Introduction	Syllabus

Week 2

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Machine Learning Fundamentals	Deep: Chapters 5 and 6	Machine Learnining Basics	Gradient Derivation for Skip-gram Model	Homework #1 (Due Jan. 24, 2022)
Wednesday	Introduction to Neural Networks	Deep: Chapters 5 and 6	Neural Network Overview

Week 3

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Introduction to Neural Networks (Continued)	Deep: Chapter 6	Neural Network Overview (Updated)
Wednesday	Activation functions Training protocols Representation learning	Deep: Chapter 6	Neural Network Overview (Same as last time)		Homework #2 (Due 2/14/2022) Softmax layer weights and biases A sample

Week 4

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Regularization Techniques for Deep Learning	Deep: 7.1 - 7.4	Regularization Techniques - Part I
Wednesday	Regularization Techniques (Continued)	Deep: Chapter 7	Regularization Techniques - Part II

Week 5

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Optimization techniques	Chapter 8	Optimization techniques
Wednesday	Optimization techniques (Continued)	Chapter 8			Programming Assignment I (Due March 9, 2022) USPS ZIP dataset USPS ZIP training set USPS ZIP test set (Description) (Also available at here named ZIP code)

Week 6

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Optimization Techniques (Continued)	Chapter 8	Same As Last Time
Wednesday	ConvNets	Chapter 10	ConvNets	Homework #3 (Due: March 21, 2022)

Week 7

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Optimization techniques (Continued) Convolutional Neural Networks	Chapter 9
Wednesday	ConvNets (Continued)	Chapter 10

Week 8

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	ConvNets	Chapter 9	Same as last time
Wednesday	Recurrent neural networks	Chapter 10	RNN	RNN Gradient Calculation Notes	Homework #4 (Due April 6, 2022)

Week 9

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Deep learning case studies	Chapter 12	Case Studies
Wednesday	Reinforcement Learning - Introduction		Reinforcement Learning		Programming Assignment II (Due April 13, 2022) Protein sequence dataset PDB Sequence Dataset Brief Description of the dataset. Term Project (Brief proposal due: April 4, 2022 Full report due: 5:00pm, Friday, April 29, 2022)

Week 10

`

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Reinforcement Learning - Tabular Approaches Reinforcement Learning - Case Studies for Approximation Approaches	RL: Chapters 3-8	Reinforcement Learning - Tabular Approaches RL Case Studies - Approximation Approaches
Wednesday	Reinforcement Learning (Continued)	Papers from the literature (see slides for details)			H: Homework #5 (Due 4/20/2022) Homework #6 (Due 4/20/2022)

Week 11

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Midterm exam review	Deep: Chapters 5, 6, 7, 8, 9, 10 RL: Chapters 2, 3, 4, 5, and 6	Midterm Review	Study guide for the midterm exam
Wednesday	Formal Tabular Methods Reinforcement Learning	Chapter 13 Papers (see the slides for details}	Policy Gradient Methods and NAS

Week 12

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday (3/22/2022)	Question-answering Neural Architecture Search (continued)
Wednesday (3/24/2022)	Midterm exam

Week 13

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Midterm exam summary Neural Architecture Search (Continued) AutoML	Papers (See slides for details)	AutoML
Wednesday	AutoML (Continued)

Week 14

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Representation Learning Generative Adversarial Networks	Deep: Chapters 13-15,20	Representation Learning
Wednesday	Deep Learning Case Studies - AlphaFlod		Deep Learning Case Studies Other protein folding methods	RL: Chapters 6-8, 16

Week 15

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Monday	Deep Learning Case Studies		Same as last time
Wednesday	Deep Learning Case Studies (Continued) Summary and Deep Learning Future		Summary and Future

Final Exam Week

Date	Topics	Reading	Lecture Notes	Handout	Assignments
Friday	Final Project				Due: 5:00pm, April 29, 2022

[Course Home] [Syllabus] [Announcements] [Calendar] [Handouts] [Solutions]

Last modified on August. 25, 2017