EECE 576L: Advanced Topics in Deep Learning

Overview
EECE 576L examines geometric and probabilistic deep learning and deep reinforcement learning through lectures, student paper presentations, and a research project.
Course Information
| Instructor | Renjie Liao |
|---|---|
| Term | 2026/27 Winter Session, Term 1 (Fall 2026) |
| TA | Yuanpei Gao · yuanpeig@student.ubc.ca |
| Class | Tuesday, 4:00 p.m. – 7:00 p.m. · UBCV · MCLD 2012 (Hector J. MacLeod Building, Floor 2) |
| Piazza | Course forum |
| Office hour | Tuesday, 1:00 p.m. – 2:00 p.m. · KAIS 3047 (Ohm) |
| renjie.liao@ubc.ca |
Use Piazza for questions and Canvas for submissions, grades, deadlines, and changes.
Announcements: First class: Sep. 15. No class Sep. 8 (the classroom may be used for Imagine UBC orientation activities) or Nov. 10 (midterm break).
Project proposal due: Oct. 13, 2026. See the proposal guideline and submit on Canvas.
Detailed overview · Course project · Course policies · Resources
Schedule
Tuesdays, 4:00 p.m. – 7:00 p.m., MCLD 2012. Dates follow the UBC Vancouver calendar; classes do not meet on UBC holidays or during the midterm break. This course does not meet on Sep. 8 or Nov. 10; the first meeting is Sep. 15 and the last is Dec. 1.
The tentative schedule has 20 papers across four presentation sessions, with a 30-minute slot per paper, including questions. Depending on enrollment, some papers will have two presenters sharing the same slot. Eight papers (40%) are new relative to the previous offering, marked New. See the presentation guideline.
| Lectures | Date (Tuesday) | Topic and papers | Slides | Suggested readings |
|---|---|---|---|---|
| 1 | Sep. 15 | Introduction | Lecture 1 | Chapter 13, 14 of PML1 book & DL book |
| 2 | Sep. 22 | Invariance, equivariance, sets and sequences | Lecture 2 | DeepSets & Transformers & PreNorm & VisionTransformers & SwinTransformers & Chapter 15 of PML1 book |
| 3 | Sep. 29 | Graph neural networks: message passing and graph convolutions | Lecture 3 Lecture Note 3 |
Part II of GRL book & Chapter 23 of PML1 book & Chapter 4 of GNN book & GNNs & GGNNs & GAT & Graphormer & GPS & GCNs & ChebyNet & LanczosNet & SignNet & Specformer |
| 4 | Oct. 6 & 13 | Group-Equivariant Deep Learning Proposal due: Oct. 13 Part 5 is optional. |
Slides 1 · Note 1 Slides 2 · Note 2 Slides 3 · Note 3 Slides 4 · Note 4 Slides 5 · Note 5 |
UvAGEDL |
| 5 | Oct. 20 | LLMs and diffusion models Autoregressive models, policy gradients, diffusion and flow |
— | BERT & GPT3 & T5 & Scaling Laws & LoRA Score-based Models & ScoreSDE & DDPM & DDIM & DPM++ Flow Matching & Rectified Flow & Stochastic Interpolants |
| 6 | Oct. 27 | Paper presentations 1–5 1. Point Transformer V3 2. Mamba 3. Tensor Field Networks 4. SE(3)-Transformers 5. E(n) Equivariant GNNs |
— | — |
| 7 | Nov. 3 | Paper presentations 6–10 6. Vision Transformers Need Registers 7. VGGT New 8. DPO 9. Does RL Really Incentivize Reasoning Beyond the Base Model? 10. DeepSeek-V3.2 New |
— | — |
| — | Nov. 10 | No class — UBC midterm break | — | — |
| 8 | Nov. 17 | Paper presentations 11–15 11. UMA New 12. Visual Autoregressive Modeling (VAR) 13. Rectified Flow 14. π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilities New 15. World Action Models are Zero-shot Policies (DreamZero) New |
— | — |
| 9 | Nov. 24 | Paper presentations 16–20 16. OT-CFM 17. MDLM 18. LLaDA New 19. MeanFlow New 20. GLASS Flows New |
— | — |
| 10 | Dec. 1 | Project presentations | — | — |
FAQ
Can I audit or sit in?
UBC students, staff, and faculty may email the instructor to request permission to audit. Registered students receive priority if classroom space is limited.
Where can I find textbooks, paper lists, and sample projects?
See Course Resources. There is no required textbook.