The field of tabular data has recently been exploding with advances through foundation models. In this seminar, we want to dive deep into these very recent advances to understand tabular foundation models!
| Course type: | Seminar |
| Time | - Kick-off Session: April 25th 10-12 (Zoom) - Presentation Session 1: May 13th 10-12 - Presentation Session 2: May 20th 10-12 - Presentation Session 3: May 27th 10-12 - Presentation Session 4: June 3rd 10-12 - Presentation Session 5: June 10th 10-12 - Add-On Poster Session: August 5th 10-12 |
| Location | In-Person; TBD |
| Organizers | Jake Robertson and Lennart Purucker and Steven Adriaensen and Frank Hutter |
| Registration | - 20 Students - Registration via HisInOne (Priority 1 / Preferred): Tabular Foundation Models | 11LE13S-7356-M - Pre-registration form: Google Form Link |
| Language | English |
Prerequisites
We require that you have taken lectures on or are familiar with the following:
- Machine Learning
- Deep Learning
Organization
- 20 Students
- Registration via HisInOne: (TBD)
- Registration form: (TBD)
- Presentations in pairs
- Add-on of your choice
Grading
- Presentation (70%)
- Add-On of your choice (30%)
Papers
- AVICI: https://arxiv.org/abs/2205.12934
- TabPFNv1: https://arxiv.org/abs/2207.01848
__________________ - CARTE: https://arxiv.org/abs/2402.16785
- TabuLa: https://arxiv.org/abs/2310.12746 / TabLLM: https://arxiv.org/abs/2210.10723
__________________ - GAMFormer: https://arxiv.org/abs/2410.04560
- Mothernet: https://arxiv.org/abs/2312.08598
__________________ - Drift-Reslient TabPFN: https://arxiv.org/abs/2411.10634
- FairPFN: https://arxiv.org/pdf/2407.05732
__________________ - TabDPT: https://arxiv.org/abs/2410.18164 / TabICL: https://arxiv.org/abs/2502.05564
- TabPFNv2: https://www.nature.com/articles/s41586-024-08328-6