Here’s a tentative schedule that will be updated to reflect reality as the quarter progresses. Lecture materials, assignments, and other materials will also be posted here.
In-class code lives in the course’s public repo. Filled-in tablet notes are here. Blank copies of the tablet notes are available here.
| # | Date | Unit | Topics | Projects | Problems | Relevant readings |
|---|---|---|---|---|---|---|
| 1 | Mon 12/01 |
Projection | Course Intro Discussion questions Pinhole camera model |
hw1 out | RS 1, 2.1 TIF 5, 38, 39 |
|
| 2 | Tue 12/02 |
Perspective projection Camera and Image coordinates Projection equations |
RS 2.1 TIF 5, 38, 39 |
|||
| 3 | Thu 12/04 |
Homogeneous coordinates World coordinates Intrisics and extrinsics |
RS 2.1, 3.6 TIF 38, 39 |
|||
| 4 | Fri 12/05 |
Camera model demo Extrinsics continued 3D rotations |
||||
| 5 | Mon 12/08 |
Triangulation Resectioning |
hw1 due [soln] | RS 11.1 - 11.2 TIF 44 |
||
| 6 | Tue 12/09 |
sfmLab work time | sfmLab out | hw2 out | ||
| 7 | Thu 12/11 |
Two-view geometry Structure from Motion Bundle adjustment |
RS 11.3 - 11.4 TIF 44 |
|||
| 8 | Fri 12/12 |
Filters and Features | Photometric
transformations Convolutions |
RS 3.1 - 3.2 TIF 15 |
||
| 9 | Mon 12/15 |
Gradients and edges Upsampling and downsampling |
sfmLab due | hw2 due [soln] hw3 out |
RS 3.2, 3.5 TIF 18, 21, 23 |
|
| 10 | Tue 12/16 |
Feature detection Harris corners |
RS 7.1 | |||
| 11 | Thu 12/18 |
Feature description MOPS descriptors |
RS 7.1 | |||
| 12 | Fri 12/19 |
Feature matching Ratio test |
RS 7.1 | |||
| 12/22 - 01/02 |
NO CLASS | |||||
| 13 | Mon 01/05 |
Alignment | Geometric image
transformations: translation, rotation, similarity, homography |
hw3 due [soln] hw4 out |
RS 2.1, 3.6.1 TIF 38, 41 Web demo |
|
| 14 | Tue 01/06 |
Least squares review Alignment: translation and affine |
RS 8.1.1 TIF 41 |
|||
| 15 | Thu 01/08 |
Alignment: homography DLT algorithm |
autostitch out | RS 8.1.3 TIF 41 |
||
| 16 | Fri 01/09 |
Homography Fitting, part 2 Autostitch project demo |
RS 8.1.3 | |||
| 17 | Mon 01/12 |
RANSAC Robust model fitting |
hw4 due [soln] | RS 8.1.4 | ||
| 18 | Tue 01/13 |
Image Stitching | Image warping | RS 8.2, 3.6.2 | ||
| 19 | Thu 01/15 |
Interpolation Blending and Feathering |
RS 8.2.4 | |||
| 20 | Fri 01/16 |
autostitch work time | ||||
| Mon 01/19 |
NO CLASS | |||||
| 21 | Tue 01/20 |
Deep Learning | Machine learning fundamentals | autostitch due Wed. 1/21 | RS 5.1 - 5.2 TIF 9, 10, 11 |
|
| 22 | Thu 01/22 |
Training/Validation/Testing | RS 5.3 TIF 12, 14 |
|||
| 23 | Fri 01/23 |
Neural networks Layers and activations |
RS 5.4 TIF 24 |
|||
| 24 | Mon 01/26 |
Virtual day / snow storm CNN layers, architectures, and training |
depth1 out | Stanford lecture | ||
| 25 | Tue 01/27 |
Loss functions for vision Depth project Q&A |
RS 5.3 TIF 43 |
|||
| 26 | Thu 01/29 |
What makes CNNs work? Depth project work time |
GoogLeNet viz | |||
| 27 | Fri 01/30 |
Depth & Stereo | Possible improvements: U-net, skip connections |
depth1 checkpoint due (extensions available on request) | ||
| 28 | Mon 02/02 |
depth project work time | ||||
| 29 | Tue 02/03 |
Stereo vision Disparity and depth Photometric losses |
RS 12.1 - 12.3 TIF 40 |
|||
| 30 | Thu 02/05 |
depth project work time | depth1 due depth2 out |
|||
| 31 | Fri 02/06 |
Final project proposal clinic | finalProject out | |||
| 32 | Mon 02/09 |
Advanced Topics | 3D Gaussian Splatting Neural scene representations |
|||
| 33 | Tue 02/10 |
Transformers in vision ViT, attention mechanisms |
||||
| 34 | Thu 02/12 |
Generative models Diffusion models for vision |
depth2 due | RS 5.5 TIF 32, 34 |
||
| 35 | Fri 02/13 |
catch-up day / Research frontiers in CV |
||||
| 36 | Mon 02/16 |
Final Project | Final project work time | |||
| 37 | Tue 02/17 |
Final project work time | ||||
| 38 | Thu 02/19 |
Final project presentations Day 1 |
||||
| 39 | Fri 02/20 |
Final project presentations Day 2 |
finalProject due next week |