Deep Learning for Visual Computing
Link to the lab part of the course (projects): [github]
Link to the schedule of the current semester: [google docs]
Course Content
Lecture: Syllabus
Syllabus: [Slides]
Lecture: Introduction
Introduction: [Slides] - [youtube] 43 min
Lecture: Linear Algebra Review
Review Linear Algebra: [Slides] - [youtube] 1:17 min
Lecture: Image Classification Problem
Image Classification Problem: [Slides] - [youtube] 28 min
Lecture: Data Structures
Data Structures: [Slides] - [youtube] 25 min
Lecture: Fully Connected Neural Networks
Fully Connected Neural Networks: [Slides] - [youtube] 58 min
Notebook - Fully Connected and Convolutional Layers: [colab]
Demo - Experimenting with Tensorflow: [youtube] 10 min
Lecture: Loss Functions
Loss Functions: [Slides] - [youtube] 47 min
Lecture: Convolution
Convolution: [Slides] - [youtube] 1:12 min
Lecture: Activation Functions
Activation Functions: [Slides] - [youtube] 54 min
Lecture: Network Normalization
Network Normalization: [Slides] - [youtube] 56 min
Lecture: Backpropagation
Backpropagation: [Slides] -
[youtube] Part 1: 51 min -
[youtube] Part 2: 1:04 min -
[youtube] Part 3: 33 min
Lecture: Data Normalization
Data Normalization: [Slides] - [youtube] 25 min
Lecture: Network Initialization
Network Initialization: [Slides] - [youtube] 51 min
Lecture: Network Regularization
Network Regularization: [Slides] - [youtube] 40 min
Notebook - Dropout: [colab]
Lecture: Data Augmentation
Data Augmentation: [Slides] - [youtube] 44 min
Notebook - Data Augmentation: [colab]
Lecture: Optimization
Optimization: [Slides] -
[youtube] Part 1: 17 min -
[youtube] Part 2: 1:14 min -
[youtube] Part 3: 43 min
Lecture: Classification Architectures
Classification Architectures: [Slides] -
[youtube] Part 1 1:07 min -
[youtube] Part 2 1:45 min
Notebook - Print Classification Architecture: [colab]
Lecture: Training Neural Networks
Training Neural Networks (Justin Johnson): [Slides] - [youtube] 1:19 min
Lecture: Texture Synthesis and Style Transfer
Texture Synthesis: [Slides] - [youtube] 50 min
Style Transfer: [Slides] - [youtube] 1:14 min
Lecture: Visualization
Visualization: [Slides] - [youtube] 1:04 min
Notebook - Wandb: [colab] link on the top right
3D Network Visualization (Denis Dmitriev): [youtube] 2 min
Deep Visualization Toolbox (Yason Yosinski): [youtube] 3 min
Network Analysis: [Slides] -
[youtube] Part 1 19 min -
[youtube] Part 2 16 min -
[youtube] Part 3 27 min
Lecture: Attention
Attention (Justin Johnson): [Slides] - [youtube] 1:11 min
Lecture: Object Detection and Segmentation
Object Detection (Justin Johnson): [Slides]
Object Detectors (Justin Johnson): [Slides]
Image Segmentation (Justin Johnson): [Slides]
Object Detection (Justin Johnson 2019): [youtube] 1:21 min
Object Detection and Segmentation (Justin Johnson 2019): [youtube] 1:10 min
Notebook - Upsampling Functions: [colab]
Lecture: GANs
GANs: [Slides] -
[youtube] Part 1 20 min
[youtube] Part 2 24 min
[youtube] Part 3 24 min
[youtube] Part 4 33 min
[youtube] Part 5 43 min
Lecture: Transformer Examples in Computer Vision
BERT (Shusen Wang): [youtube] 15 min
Vision Transformer (Shusen Wang): [youtube] 14 min
DETR (Yannic Kilcher): [youtube]
Vision Transformer (Justin Johnson): [Slides]
Lecture: Point Clouds
Point Clouds: [Slides] -
[youtube] Part 1 17 min
[youtube] Part 2 27 min
[youtube] Part 3 50 min
[youtube] Part 3 21 min
Lecture: Neural Architecture Search
Neural Architecture Search: [Slides] - [youtube] 37 min
Lecture: Information Theory Review
Information Theory Review: [Slides]
Lecture: Recurrent Neural Networks
Recurrent Neural Networks / LSTM (Justin Johnson): [Slides]
Recurrent Neural Networks / LSTM (Justin Johnson): [youtube] 1:13 min
Lecture: Videos
Videos (Justin Johnson): [Slides]
Lecture: Self-Supervised Learning
Self-Supervised Learning (Justin Johnson): [Slides]
Lecture: 3D Vision
3D Vision (Justin Johnson): [Slides]
Lecture: Diffusion
Diffusion: [Tutorial] Includes Slides
[youtube] 3:46 min
Lecture: Career Advice
There is some overlap
Building a career in machine learning (Andrew Ng): [youtube] 1h
Career advice / reading papers (Andrew Ng): [youtube] 1:04 min
Lecture: TBD
XXX: [Slides]