Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Wednesday |
Motivations Organizational Issues General Introduction to Pattern Recognition |
Chapter 1 | Introduction |
Syllabus | |
Friday |
Pattern Recognition Systems Terminology Bayesian decision theory |
2.1-2.4 Append A.4 2.8.3 2.3.1 and 2.3.2 will NOT be on the exam |
Bayesian Decision Theory |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday |
Bayesian decision theory (Continued) |
Homework #1
( Word format) (Due Noon, 1/25/2012 ) |
|||
Wednesday |
Bayesian decision theory (Continued) Numerical Examples |
Numerical Examples |
|||
Friday |
Bayesian decision theory for normal density Classification of real datasets Naive Bayesian classifier Advanced topics |
2.5, 2.6 2.9 (Self-reading) 2.7, 2.8.1, and 2.8.2 will NOT be on the exam |
Bayesian Classification for Normal Density |
Example Matlab programs Wine Ocr Naive Bayesian classifier analysis paper (Not required) Spam filtering (From http://www.paulgraham.com/spam.html) (Proceedings of the first conference on North American chapter of the Association for Computational Linguistics, pp. 63-69, 2002.) |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday | Holiday; no class | ||||
Wednesday | NSF panel reviewing; no class | ||||
Friday |
Bayesian decision theory for normal density Naive Bayesian classifier Advanced topics (Continued) |
(Same as last time) |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday |
Naive Bayesian Classifier Advanced topics (Continued) Maximum-likelihood estimation | 3.1-3.2 | Parameter Estimation |
Homework #2
( Word format) (Due noon, 2/6/2012) |
|
Wednesday |
Maximum-likelihood estimation (Continued) Bayesian estimation | 3.3 | |||
Friday |
Parametric Methods (Continued) Nonparametric Techniques - Parzen Windows |
4.1-4.3 | Parzen Windows |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday |
Parametric methods (Continued) Nonparametric Techniques Parzen Windows | 4.1-4.3 | Parzen Windows |
||
Wednesday | Nonparametric Techniques (Continued) |
4.4, 4.5, 4.6.1
4.6.2,4.8 (Not required for exams) |
Nearest-Neighbor Estimation | ||
Friday | Nonparametric Techniques (Continued) |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday |
K-nearest neighbor rule (continued) Tangent distance (not required for exams) Reduced Coulomb Enegery Networks (not required for exams) | 4.6, 4.8 |
Same as last time | Homework #3 ( Word format) 02/17/2012) |
|
Wednesday | K-nearest neighbor rule (continued) Linear discriminant functions |
5.1-5.2 5.4-5.7 5.12.1-5.12.2 | Linear Discriminant Functions |
Lab #1
( Word format) (Due 12:00noon, February 29, 2012) Iris dataset Iris training set Iris test set (Description) UCI wine dataset UCI wine training set UCI wine test set (Description) USPS ZIP dataset USPS ZIP training set USPS ZIP test set (USPS ZIP test set - small) (Description) |
|
Friday | Approximate Nearest Neighbor Search Algorithms in High Dimensional Space By Jiangbo Yuan (Will not be on exams) |
ANN Slides |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday | K-nearest-neighbor rules Linear Discriminant Function |
|
Same as last Wed. | ||
Monday | Linear Discriminant Function | |
|||
Friday | Linear discriminant functions
(continued) Generalized linear discriminant functions Kernel trick Support vector machines |
5.12.1-5.12.2 |
Kernel Trick and SVM |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday |
Generalized linear discriminant functions Kernel trick Support vector machines Boosting & Component Analysis |
5.12.1-5.12.2 9.5.2 3.8 |
Boosting & Component Analysis | Small SVM Example in Matlab | |
Wednesday |
Component analysis (Continued)
Multilayer neural networks |
3.8.1-3.8.3 6.1-6.5 | Neural Networks |
||
Friday | Multilayer neural networks | 6.8, 6.9 (Not on exam) |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday | Same as last week | ||||
Wednesday | Same as last week | ||||
Friday | Same as last week |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday | Spring break | No class | |||
Wendesday | Spring break | No class | |||
Friday | Spring break | No class |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday | Multilayer neural networks | 6.1-6.5 | Neural Networks |
Term Project
( Word format) (Brief proposal due: March 30, 2012 Full report due: 5:00pm, April 27, 2012) Homework #4 ( Word format) (Due 3/26/2012) |
|
Wednesday | Multilayer neural networks (Continued) |
6.8, 6.9 (Not on exam) |
Neural Networks (Updated) |
||
Friday | Neural Network Examples | Neural Network Examples |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday | Neural Network Examples (continued) | `
Lab #2
( Word format) (Due April 16, 2012) |
|||
Wednesday | Neural Network Examples (continued) Decision Trees | `
8.2-8.4 | Decision Trees | ||
Friday | Decision Trees (Continued) |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday | Decision tree (Continued) |
Same as last time | |||
Wednesday | Midterm exam review |
Chapters 1-6, 8.2-8.4, and 9.5.2 (Some sections are excluded, see the slides for detail) |
Midterm Review |
||
Friday | Midterm exam review (Continued) |
Date | Topics | Reading | Lecture Notes | Handout | Assignments | Monday | Questions and answers Algorithm-Independent Machine Learning | Chapter 9 (Not on the exam) |
Algorithm-Independent Learning |
---|---|---|---|---|---|
Wednesday (April 4) |
Midterm | Midterm Spring 2012 | Due 9:05AM, April 9, 2012 | Friday | No class | Time to work on the midterm exam |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday | Algorithm-Independent Machine Learning | Chapter 9 | Algorithm-Independent Learning | ||
Wednesday | Unsupervised learning | Chapter 10 |
Unsupervised Learning | ||
Friday | Syntactic Pattern Recognition | 8.5-8.8 | Syntactic Pattern Recognition |
Date | Topics | Reading | Lecture Notes | Handout | Assignments |
---|---|---|---|---|---|
Monday |
Midterm exam discussion |
||||
Wednesday |
Syntactic Pattern Recognition (Continued) |
Same as last time | |||
Friday | Case Studies and Summary | Summary |
Last modified on April. 17, 2012