Menu

PhD Student

Arbër Zela

Postal address
Institut für Informatik
Albert-Ludwigs-Universität Freiburg
Sekretariat Hutter/Maschinelles Lernen
Georges-Köhler-Allee 074
79110 Freiburg, Germany
Fax
+49 761 203-74217
Office
Building 74, Room 00-010
GoogleScholar

About

Since March 2019 I am a PhD student at the Machine Learning Group under the supervision of Frank Hutter. Before that I did my master degree in computer science at the University of Freiburg.

Research Interests

I am interested in all facets of deep learning. More precisely my research areas include:

  • Neural Architecture Search
  • Automated Hyperparameter Optimization
  • Transfer Learning and Meta Learning

Publications

2023

White, Colin; Safari, Mahmoud; Sukthanker, Rhea; Ru, Binxin; Elsken, Thomas; Zela, Arber; Dey, Debadeepta; Hutter, Frank

Neural Architecture Search: Insights from 1000 Papers Online

2023, visited: 20.01.2023.

2022

Bansal, Archit; Stoll, Danny; Janowski, Maciej; Zela, Arber; Hutter, Frank

JAHS-Bench-201: A Foundation For Research On Joint Architecture And Hyperparameter Search Inproceedings

In: Thirty-sixth Conference on Neural Information Processing Systems, 2022, (Featured Paper - top 7.5% of accepted papers).

Krishnakumar, Arjun; White, Colin; Zela, Arber; Tu, Renbo; Safari, Mahmoud; Hutter, Frank

NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxies Inproceedings

In: Thirty-sixth Conference on Neural Information Processing Systems, 2022.

Mehta*, Yash; White*, Colin; Zela, Arber; Krishnakumar, Arjun; Zabergja, Guri; Moradian, Shakiba; Safari, Mahmoud; Yu, Kaicheng; Hutter, Frank

NAS-Bench-Suite: NAS Evaluation is (Now) Surprisingly Easy Inproceedings

In: International Conference on Learning Representations (ICLR) 2022, 2022.

Zela, Arber; Siems, Julien; Zimmer, Lucas; Lukasik, Jovita; Keuper, Margret; Hutter, Frank

Surrogate NAS Benchmarks: Going Beyond the Limited Search Spaces of Tabular NAS Benchmarks Inproceedings

In: International Conference on Learning Representations (ICLR), 2022.

2021

Narayanan, Ashwin Raaghav; Zela, Arber; Saikia, Tonmoy; Brox, Thomas; Hutter, Frank

Multi-headed Neural Ensemble Search Inproceedings

In: Workshop on Uncertainty and Robustness in Deep Learning (UDL@ICML`21), 2021.

Elsken, Thomas; Staffler, Benedikt; Zela, Arber; Metzen, Jan Hendrik; Hutter, Frank

Bag of Tricks for Neural Architecture Search Journal Article

In: Proceedings of the CVPR 2021 Workshop on Neural Architecture Search (CVPR-NAS '21), 2021.

Chatzimichailidis, Avraam; Zela, Arber; Shalini, Shalini; Labus, Peter; Keuper, Janis; Hutter, Frank; Yang, Yang

Group Sparsity: A Unified Framework for Network Pruning and Neural Architecture Search Journal Article

In: Proceedings of the CVPR 2021 Workshop on Neural Architecture Search (CVPR-NAS '21), 2021.

Zaidi, Sheheryar; Zela, Arber; Elsken, Thomas; Holmes, Christopher C.; Hutter, Frank; Teh, Yee Whye

Neural Ensemble Search for Uncertainty Estimation and Dataset Shift Inproceedings

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

White, Colin; Zela, Arber; Ru, Binxin; Liu, Yang; Hutter, Frank

How Powerful are Performance Predictors in Neural Architecture Search? Inproceedings

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

2020

Lukasik, Jovita; Friede, David; Zela, Arber; Stuckenschmidt, Heiner; Hutter, Frank; Keuper, Margret

Smooth Variational Graph Embeddings for Efficient Neural Architecture Search Journal Article

In: arXiv:2010.04683 [cs.LG], 2020.

Siems, Julien; Zimmer, Lucas; Zela, Arber; Lukasik, Jovita; Keuper, Margret; Hutter, Frank

NAS-Bench-301 and the Case for Surrogate Benchmarks for Neural Architecture Search Journal Article

In: NeurIPS 4th Workshop on Meta-Learning, 2020.

Liu, Zhengying; Pavao, Adrien; Xu, Zhen; Escalera, Sergio; Ferreira, Fabio; Guyon, Isabelle; Hong, Sirui; Hutter, Frank; Ji, Rongrong; Junior, Julio C S Jacques; Li, Ge; Lindauer, Marius; Luo, Zhipeng; Madadi, Meysam; Nierhoff, Thomas; Niu, Kangning; Pan, Chunguang; Stoll, Danny; Treguer, Sebastien; Wang, Jin; Wang, Peng; Wu, Chenglin; Xiong, Youcheng; Zela, Arber; Zhang, Yang

Winning Solutions and Post-Challenge Analyses of the ChaLearn AutoDL Challenge 2019 Journal Article

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 9, pp. 3108-3125, 2020.

Zaidi, Sheheryar; Zela, Arber; Elsken, Thomas; Holmes, Chris; Hutter, Frank; Teh, Yee Whye

Neural Ensemble Search for Performant and Calibrated Predictions Journal Article

In: Workshop on Uncertainty and Robustness in Deep Learning (UDL@ICML`20), 2020, (Oral Presentation).

Zela, Arber; Siems, Julien; Hutter, Frank

NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Inproceedings

In: International Conference on Learning Representations, 2020.

Zela, Arber; Elsken, Thomas; Saikia, Tonmoy; Marrakchi, Yassine; Brox, Thomas; Hutter, Frank

Understanding and Robustifying Differentiable Architecture Search Inproceedings

In: International Conference on Learning Representations, 2020, (Oral Presentation (Top 7%)).

2019

Saikia, T; Marrakchi, Y; Zela, A; Hutter, F; Brox, T

AutoDispNet: Improving Disparity Estimation With AutoML Inproceedings

In: IEEE International Conference on Computer Vision (ICCV), 2019.

2018

Zela, Arber; Klein, Aaron; Falkner, Stefan; Hutter, Frank

Towards Automated Deep Learning: Efficient Joint Neural Architecture and Hyperparameter Search Inproceedings

In: ICML 2018 AutoML Workshop, 2018.