CS281: Advanced Machine Learning

Prof. Ryan Adams
TF: James Zou
TF: Hossein Azari
Time: Tuesday and Thursday, 1:00-2:30pm
Location: 60 Oxford Street, Room 330 (NOTE NEW LOCATION)
Section: Friday 10:00-11:00am and 11:00-12:00pm in MD223
Office Hours: Monday, 3:00-4:00pm MD233
Contact: (course number) + (hyphen) + (the word "staff") + "seas.harvard.edu"

syllabus | schedule | piazza discussion site | assignments | final project [pdf] | grading | scribing | jester data | references

Announcements


Schedule

Th 1 Sep 2011

Lecture 1: Introduction to Inference and Learning

Maximum Likelihood Basics

Tu 6 Sep 2011

Lecture 2: The Gaussian Distribution and Linear Regression [ | cs281_submit.m | wine-train.csv | wine-test.csv ]


Th 8 Sep 2011

Lecture 3: Linear Models for Classification


Tu 13 Sep 2011

Lecture 4: K-Means and Mixture Models [ quantize.m | interesting man ]

Bayesian Inference

Th 15 Sep 2011

Lecture 5: Bayes' Rule and Optimal Decisions [ flips.m | gaussest.m ]


Tu 20 Sep 2011

Lecture 6: Exponential Family Models [ flips_beta.m ]


Th 22 Sep 2011

Lecture 7: Graphical Models


Tu 27 Sep 2011

Lecture 8: Belief Propagation


Th 29 Sep 2011

Lecture 9: Monte Carlo Basics


Tu 4 Oct 2011

Lecture 10: Advanced Markov Chain Monte Carlo


Th 6 Oct 2011

Lecture 11: Variational Inference and Deterministic Approximation

Latent Factor Models

Tu 11 Oct 2011

Lecture 12: Principal Components Analysis and Friends


Th 13 Oct 2011

Lecture 13: Topic Models and Admixtures


Tu 18 Oct 2011

Lecture 14: Probabilistic Matrix Factorization for Relational Data

Th 20 Oct 2011

Midterm: Covers Lectures 1-13

Time Series and Sequences

Tu 25 Oct 2011

Lecture 15: Models for Time Series and Sequential Data


Th 27 Oct 2011

Lecture 16: Inference for Time Series and Sequential Data

Bayesian Nonparametrics

Tu 1 Nov 2011

Lecture 17: Gaussian Process I


Th 3 Nov 2011

Lecture 18: Gaussian Process II


Tu 8 Nov 2011

Lecture 19: Dirichlet Process I


Th 10 Nov 2011

Lecture 20: Dirichlet Process II


Tu 15 Nov 2011

Lecture 21: Indian Buffet Process

Other Important Topics

Th 17 Nov 2011

Lecture 22: Nonlinear Dimensionality Reduction


Tu 22 Nov 2011

Lecture 23: Support Vector Machines and Kernel Methods


Tu 29 Nov 2011

Lecture 24: Undirected Graphical Models


Th 1 Dec 2011

Lecture 25: Deep Belief Networks

Project Wrap-Up

Tu 6 Dec 2011

Special: Project Presentation


Fri 9 Dec 2011

Projects Due


Assignments


Final Project

See document
here for details.

Grading


Scribing

Sign up on the
spreadsheet. Use the scribing LaTeX template: 281-template.tex. An example is provided in scribe-example.tex.

Jester Data

These data are approximately 1.7 million ratings in the range [-10,10] of 150 jokes from 63,974 users. These data are from the
Eigentaste Project at Berkeley. I have munged the data somewhat, so use the local copies here: The correct reference for these data is Goldberg et al. (2001).

References