70010/97111 Deep Learning
Overview:
Note that this course will be held as a combination of pre-recorded lectures, weekly lectures and recap and Q&A sessions, tutorials in class and on Teams and individual coding projects.
Lectures and tutorials have been timetabled for 2 hours per week:
Fridays 09-10 Huxley 308 and MS Teams
Fridays 10-11 Huxley 308 and MS Teams Lab queue
However, not all timetabled slots will be used every week so please check the timetable below for more information. All notes, tutorials and coursework (including coursework hand-out/in dates) can be found below, on Scientia. Revision notes on essential machine learning can be found here based on Tom Eccles’ original notes. Coursework submission will be done via Scientia/LabTS. General questions can be discussed on EdStem.
Timetable
| Week 2 (starting 12th January) | ||||
| 308 Friday 14-15 | 01 Logistics and setup 02 Motivation, the curse of dimensionality and basic CNN building blocks (YouTube) watch 02 before the lecture please, we will spend a lot of time on logistics | Lecture | Kainz | |
| papers to read and notes | N01 Admin Notes N02 Lecture Notes N02a Lecture slides | |||
| Friday 15-16 | MS Teams Lab queue /HXL 308 | MS Teams/308 1. Introduction to PyTorch I (YouTube) 2. jupyter notebook I 3. Introduction to PyTorch II (YouTube) 4. jupyter notebook II | Pace/GTAs | |
| Week 3 (starting 19th January) | ||||
| 308 Friday 14-15 | pre-recorded + lecture + MS Teams | 02 Motivation, the curse of dimensionality and basic CNN building blocks (YouTube) watch 02 before the lecture please | Lecture | Kainz |
| papers to read and notes | N02 Lecture Notes N02a Lecture slides | |||
| Friday 15-16 | MS Teams Lab queue /HXL 308 | MS Teams/308 T01 Signals T02 Padding and strides | Tutorial | team |
| deadline: 30 Jan, 19:00 | Coursework Task 1 | assessed | please submit this via LabTS | |
| Week 4 (starting 26th January) | ||||
| 308 Friday 14-15 | pre-recorded + lecture + MS Teams | 03 Activation functions and Loss functions (YouTube) 04 Popular Network architectures (and BatchNorm) (YouTube) (start) | Lecture | Kainz |
| papers to read and notes | N03 Lecture Notes N03a Lecture Slides | |||
| Friday 15-16 | MS Teams Lab queue | MS Teams/308 T03 CNNs | Tutorial | team |
| deadline: 30 Jan, 19:00 | Coursework Task 1 | assessed | please submit this via LabTS | |
| Quiz | test your knowlege here | |||
| Week 5 (starting 02nd February) | ||||
| 308 Friday 14-15 | pre-recorded + lecture + MS Teams | 05 The U-Net architecture for image segmentation (YouTube) Data Augmentation (YouTube) and case study (YouTube) 06 Generative models I | Lecture | Bose/Kainz |
| papers to read | LeNet AlexNet VGG BatchNorm ResNet Squeeze-and-Excite U-Net Mask-RCNN YOLO TransUNet OOD, FPI N04 Lecture Notes N04a Lecture Slides N05 Lecture Slides | |||
| Friday 15-16 | MS Teams Lab queue | MS Teams | Tutorial | team |
| deadline: 30 Jan, 19:00 | Coursework Task 1 | assessed | please submit this via LabTS | |
| Week 6 (starting 9th February) | ||||
| 308 Friday 14-15 | pre-recorded + lecture + MS Teams | 07 Generative models II 08 VAEs 09 GANs 10 Generative Models: Advances | Lecture | Li |
| papers to read | VAEs GANs N07 intro — slides N08 VAEs — slides N09 GANs — slides N10 GANs advances — slides | |||
| Friday 15-16 | MS Teams Lab queue/HXL 311 | MS Teams T05 VAEs, GANs | Tutorial | team |
| deadline: 27 Feb, 19:00 | Coursework Task 2 | assessed | team | |
| Quiz | will be released in this week | |||
| Week 7 (starting 16th February) | ||||
| 308 Friday 14-15 | pre-recorded + lecture + MS Teams | 11 Diffusion models 12 RNN basics 13 RNN applications 14 Attention & Transformer basics 15 Transformer applications & advanced | Lecture | Li |
| papers to read | N11 RNNs — slides N12 RNN applications N13 Transformer & Attention — slides N14 Attention advanced — slides | |||
| 308 Friday 14-15 | MS Teams Lab queue/HXL 308 | MS Teams recording | Q&A | Li |
| Friday 15-16 | MS Teams Lab queue/HXL 308 | MS Teams T06 recurrent networks | Tutorial | team |
| deadline: 28 Feb, 19:00 | Coursework Task 2 | assessed | please submit this via LabTS | |
| Quiz | will be released in this week | |||
| Week 8 (starting 23th February) | ||||
| 308 Friday 14-15 | MS Teams + live | 16 Advanced attention and Transformers MS Teams Quiz will be released in this week | Coppock | |
| papers to read | ||||
| Friday 15-16 | T07 attention | Coppock | ||
| Friday 15-16 | MS Teams Lab queue | team | ||
| deadline: 28 Feb, 19:00 | Coursework Task 2 | assessed | team | |
| Quiz | ||||
| Week 9 (starting 02nd March) | ||||
| 308 Friday 14-15 | 17 Foundation models: tokenisation, evaluation and scaling | Lecture | Coppock | |
| papers to read | ||||
| Friday 15-16 | MS Teams Lab queue | MS Teams Q&A | Lab queue | |
| – | – | assessed | team | |
| Week 10 (starting 9th March) | ||||
| online Friday 14-15 | MS Teams Lab queue | exam revision | – | Li/Coppock/Kainz |
Exam
Examinable material from lectures 01-07 is highlighted with exclamation marks. Note, lectures from the second part and the foundation model part are also examinable in full! The exam will count towards 50% of your final mark.
Coursework
There will be two practical coursework tasks; all of them are assessed. Assessment results count 50% of the final mark. Tasks must be implemented individually and submitted via LabTS. Resulting jupyter notebook files and model weights need to be submitted via LabTS.
We recommend using Google CoLab Paperspace.com the extended DoC GPU cluster with GPU support for develeopment and testing.
The tasks are embedded into Jupyter notebooks, which also contain the task description.