EECE 576L: Advanced Topics in Deep Learning

Futuristic brain-shaped neural network with orange, gold, green, teal, and magenta nodes and connections on white

Overview

EECE 576L examines geometric and probabilistic deep learning and deep reinforcement learning through lectures, student paper presentations, and a research project.


Course Information

Instructor Renjie Liao
Term 2026/27 Winter Session, Term 1 (Fall 2026)
TA Yuanpei Gao · yuanpeig@student.ubc.ca
Class Tuesday, 4:00 p.m. – 7:00 p.m. · UBCV · MCLD 2012 (Hector J. MacLeod Building, Floor 2)
Piazza Course forum
Office hour Tuesday, 1:00 p.m. – 2:00 p.m. · KAIS 3047 (Ohm)
Email renjie.liao@ubc.ca

Use Piazza for questions and Canvas for submissions, grades, deadlines, and changes.

Announcements: First class: Sep. 15. No class Sep. 8 (the classroom may be used for Imagine UBC orientation activities) or Nov. 10 (midterm break).

Project proposal due: Oct. 13, 2026. See the proposal guideline and submit on Canvas.

Detailed overview · Course project · Course policies · Resources


Schedule

Tuesdays, 4:00 p.m. – 7:00 p.m., MCLD 2012. Dates follow the UBC Vancouver calendar; classes do not meet on UBC holidays or during the midterm break. This course does not meet on Sep. 8 or Nov. 10; the first meeting is Sep. 15 and the last is Dec. 1.

The tentative schedule has 20 papers across four presentation sessions, with a 30-minute slot per paper, including questions. Depending on enrollment, some papers will have two presenters sharing the same slot. Eight papers (40%) are new relative to the previous offering, marked New. See the presentation guideline.

Lectures Date (Tuesday) Topic and papers Slides Suggested readings
1 Sep. 15 Introduction Lecture 1 Chapter 13, 14 of PML1 book & DL book
2 Sep. 22 Invariance, equivariance, sets and sequences Lecture 2 DeepSets & Transformers & PreNorm & VisionTransformers & SwinTransformers & Chapter 15 of PML1 book
3 Sep. 29 Graph neural networks: message passing and graph convolutions Lecture 3
Lecture Note 3
Part II of GRL book & Chapter 23 of PML1 book & Chapter 4 of GNN book & GNNs & GGNNs & GAT & Graphormer & GPS & GCNs & ChebyNet & LanczosNet & SignNet & Specformer
4 Oct. 6 & 13 Group-Equivariant Deep Learning
Proposal due: Oct. 13
Part 5 is optional.
Slides 1 · Note 1
Slides 2 · Note 2
Slides 3 · Note 3
Slides 4 · Note 4
Slides 5 · Note 5
UvAGEDL
5 Oct. 20 LLMs and diffusion models
Autoregressive models, policy gradients, diffusion and flow
— BERT & GPT3 & T5 & Scaling Laws & LoRA
Score-based Models & ScoreSDE & DDPM & DDIM & DPM++
Flow Matching & Rectified Flow & Stochastic Interpolants
6 Oct. 27 Paper presentations 1–5
1. Point Transformer V3
2. Mamba
3. Tensor Field Networks
4. SE(3)-Transformers
5. E(n) Equivariant GNNs
— —
7 Nov. 3 Paper presentations 6–10
6. Vision Transformers Need Registers
7. VGGT New
8. DPO
9. Does RL Really Incentivize Reasoning Beyond the Base Model?
10. DeepSeek-V3.2 New
— —
— Nov. 10 No class — UBC midterm break — —
8 Nov. 17 Paper presentations 11–15
11. UMA New
12. Visual Autoregressive Modeling (VAR)
13. Rectified Flow
14. π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilities New
15. World Action Models are Zero-shot Policies (DreamZero) New
— —
9 Nov. 24 Paper presentations 16–20
16. OT-CFM
17. MDLM
18. LLaDA New
19. MeanFlow New
20. GLASS Flows New
— —
10 Dec. 1 Project presentations — —

FAQ

Can I audit or sit in?

UBC students, staff, and faculty may email the instructor to request permission to audit. Registered students receive priority if classroom space is limited.

Where can I find textbooks, paper lists, and sample projects?

See Course Resources. There is no required textbook.

Previous Version