Menu

Professor

Frank Hutter

Postal address
Institut für Informatik
Albert-Ludwigs-Universität Freiburg
Sekretariat Hutter/Maschinelles Lernen
Georges-Köhler-Allee 074
79110 Freiburg, Germany
Fax
+49 761 203-74217
Office
Building 74, Room 00-017
+49 761 203-67741 (secretary)
Publications
TwitterGoogleScholarMarker

I'm the Head of the Machine Learning Lab. I'm lucky enough to have an amazing team; all my team members are linked in the menu on the top.

I'm currently holding an ERC Consolidator Grant on Deep Learning 2.0 and previously held ERC Starting and ERC PoC grants, as well as an Emmy Noether fellowship.

Information for students interested in projects, theses, or Hiwi positions

With machine learning being one of the hottest topic around, our small group is flooded with requests.
To make the process efficient, please do not email me directly, but follow the instructions posted under “working with us”.

Research focus

I focus on Automated Machine Learning (AutoML), an area in which I am proud to have a world leading group and to be amongst the most cited researchers worldwide. This includes research in the following areas, with some examples:

For more information on AutoML, please see our AutoML book (the first book on AutoML) or our NeurIPS 2018 tutorial (which had over 3000 attendees).

 

Along the way, I've become a deep learner, with additional interests in

 

Affiliations

I'm a member of the Department of Computer Science at the Faculty of Engineering of the University of Freiburg, and head of the ELLIS unit Freiburg. I hold an ERC Consolidator Grant and held an ERC Starting Grant and an ERC PoC Grant from the European Research Council, as well as an Emmy Noether Grant from the German Research Foundation (DFG). I'm a former member of the Computer Science Department of the University of British Columbia (UBC), specifically of the Laboratory for Computational Intelligence (LCI) and the Bioinformatics and Empirical & Theoretical Algorithmics Laboratory (BETA). In addition to my full-time role at the University of Freiburg, I also consulted for the Bosch Center for AI (BCAI) as their Chief Expert for AutoML (2019-2023). I also was a machine learning consultant for Zynga Inc and am a co-founder of Meta-Algorithmic Technologies. I earned my PhD at UBC in 2009 and my Diplom (eq. MSc) at Darmstadt University in 2004.

I am general chair of the AutoML conference 2023 and was already general chair of the inaugural AutoML conference 2022. I was program co-chair of ECML-PKDD 2020. I co-founded and co-organized the ICML workshop series on AutoML every year 2014 – 2020 (after which we turned it into the AutoML conference), the NeurIPS workshop series on meta-learning, and the Neural Architecture Search workshop at ICLR. I also co-founded and regularly co-organized the NeurIPS workshop series on Bayesian optimization. Please see http://automl.org/workshops for an up-to-date list of workshops I'm co-organizing.

Short bio

Frank Hutter is a Full Professor for Machine Learning at the University of Freiburg (Germany). He holds a PhD from the University of British Columbia (UBC, 2009) and a Diplom (eq. MSc) from TU Darmstadt (2004). He received the 2010 CAIAC doctoral dissertation award for the best thesis in AI in Canada, and with his coauthors, several best paper awards and prizes in international competitions on machine learning, SAT solving, and AI planning. He is a Fellow of EurAI and ELLIS, the director of the ELLIS unit Freiburg and the recipient of 3 ERC grants. Frank is best known for his research on automated machine learning (AutoML), including neural architecture search and efficient hyperparameter optimization. He co-authored the first book on AutoML and the prominent AutoML tools Auto-WEKA, Auto-sklearn and Auto-PyTorch, won the first two AutoML challenges with his team, co-organized the ICML workshop series on AutoML every year 2014-2021, has been the general chair of the inaugural AutoML conference 2022 and is general chair again in 2023.

Publications

2024

Patil, Sharat; Runge, Frederic; Franke, Jörg K. H.; Hutter, Frank

Towards Generative RNA Design with Tertiary Interactions Workshop

The Generative and Experimental perspectives in bioMolecular design (GEM) workshop (ICLR 2024), 2024, (Oral Presentation).

Matus, Dominika; Runge, Frederic; Franke, Jörg K. H.; Gerne, Lars; Uhl, Michael; Hutter, Frank; Backofen, Rolf

RNA-Protein Interaction Prediction via Sequence Embeddings Workshop

The Generative and Experimental perspectives in bioMolecular design (GEM) workshop (ICLR 2024), 2024.

Kohli, Ravin; Feurer, Matthias; Eggensperger, Katharina; Bischl, Bernd; Hutter, Frank

Towards Quantifying the Effect of Datasets for Benchmarking: A Look at Tabular Machine Learning Inproceedings

In: Data-centric Machine Learning Research (DMLR) Workshop (ICLR 2024), 2024.

Franke, Jörg; Hefenbrock, Michael; Hutter, Frank

Preserving Principal Subspaces to Reduce Catastrophic Forgetting in Fine-tuning Inproceedings

In: Mathematical and Empirical Understanding of Foundation Models (ME-FoMo) Workshop, 2024.

Grazzi, Riccardo; Siems, Julien; Schrodi, Simon; Brox, Thomas; Hutter, Frank

Is Mamba Capable of In-Context Learning? Inproceedings

In: Mathematical and Empirical Understanding of Foundation Models (ME-FoMo) Workshop, 2024.

Hvarfner, Carl; Hutter, Frank; Nardi, Luigi

A General Framework for User-Guided Bayesian Optimization Inproceedings

In: The Twelfth International Conference on Learning Representations, 2024.

Arango, Sebastian Pineda; Ferreira, Fabio; Kadra, Arlind; Hutter, Frank; Grabocka, Josif

Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Inproceedings

In: The Twelfth International Conference on Learning Representations, 2024, (Oral Presentation).

2023

Runge, Frederic; Franke, Jörg K. H.; Fertmann, Daniel; Hutter, Frank

Rethinking Performance Measures of RNA Secondary Structure Problems Workshop

Machine Learning for Structural Biology Workshop, (NeruIPS 2023), 2023.

Franke, Jörg K. H.; Hefenbrock, Michael; Koehler, Gregor; Hutter, Frank

New Horizons in Parameter Regularization: A Constraint Approach Inproceedings

In: OPT2023: 15th Annual Workshop on Optimization for Machine Learning, (NeurIPS 2023), 2023.

Franke, Jörg K. H.; Hefenbrock, Michael; Koehler, Gregor; Hutter, Frank

Constrained Parameter Regularization Unpublished

Preprint, arXiv:2311.09058, 2023.

Hvarfner, Carl; Hellsten, Erik Orm; Hutter, Frank; Nardi, Luigi

Self-Correcting Bayesian Optimization through Bayesian Active Learning Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), 2023.

Mallik, Neeratyoy; Bergman, Eddie; Hvarfner, Carl; Stoll, Danny; Janowski, Maciej; Lindauer, Marius; Nardi, Luigi; Hutter, Frank

PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), 2023.

Hollmann, Noah; Müller, Samuel; Hutter, Frank

Large Language Models for Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineering Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), 2023.

Schrodi, Simon; Stoll, Danny; Ru, Binxin; Sukthanker, Rhea Sanjay; Brox, Thomas; Hutter, Frank

Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), 2023.

Dooley*, Samuel; Sukthanker*, Rhea Sanjay; Dickerson, John P; White, Colin; Hutter, Frank; Goldblum, Micah

Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), 2023, (Oral Paper - top 2% of accepted papers).

Adriaensen, Steven; Rakotoarison, Herilalaina; Müller, Samuel; Hutter, Frank

Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networks Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), 2023.

Ferreira, Fabio; Rapant, Ivo; Hutter, Frank

Hard View Selection for Contrastive Learning Conference Forthcoming

Forthcoming.

Watanabe, Shuhei; Hutter, Frank

c-TPE: Tree-Structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimization Inproceedings

In: Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI'23), ijcai.org, 2023.

Watanabe, Shuhei; Awad, Noor; Onishi, Masaki; Hutter, Frank

Speeding Up Multi-Objective Hyperparameter Optimization by Task Similarity-Based Meta-Learning for the Tree-Structured Parzen Estimator Inproceedings

In: Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI'23), 2023.

Watanabe, Shuhei; Bansal, Archit; Hutter, Frank

PED-ANOVA: Efficiently Quantifying Hyperparameter Importance in Arbitrary Subspaces Inproceedings

In: Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI'23), 2023.

Runge, Frederic; Franke, Jörg K. H.; Hutter, Frank

Towards Automated Design of Riboswitches Workshop

The 2023 ICML Workshop on Computational Biology, 2023.

Müller, Samuel; Feurer, Matthias; Hollmann, Noah; Hutter, Frank

PFNs4BO: In-Context Learning for Bayesian Optimization Inproceedings

In: ICML 23, 2023.

Rajan, Raghu; Diaz, Jessica Lizeth Borja; Guttikonda, Suresh; Ferreira, Fabio; Biedenkapp, André; von Hartz, Jan Ole; Hutter, Frank

MDP Playground: An Analysis and Debug Testbed for Reinforcement Learning Journal Article

In: Journal of Artificial Intelligence Research (JAIR), vol. 77, pp. 821-890, 2023.

Arango, Sebastian Pineda; Ferreira, Fabio; Kadra, Arlind; Hutter, Frank; Grabocka, Josif

Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Conference Forthcoming

Forthcoming.

Benjamins, Carolin; Eimer, Theresa; Schubert, Frederik; Mohan, Aditya; Döhler, Sebastian; Biedenkapp, André; Rosenhan, Bodo; Hutter, Frank; Lindauer, Marius

Contextualize Me - The Case for Context in Reinforcement Learning Journal Article

In: Transactions on Machine Learning Research, 2023, ISBN: 2835-8856.

Awad, Noor; Sharma, Ayushi; Müller, Philipp; Thomas, Janek; Hutter, Frank

MO-DEHB: Evolutionary-based Hyperband for Multi-Objective Optimization Online

2023, visited: 09.05.2023.

Shala, Gresa; Elsken, Thomas; Hutter, Frank; Grabocka, Josif

Transfer NAS with Meta-learned Bayesian Surrogates Inproceedings

In: The Eleventh International Conference on Learning Representations, 2023, (top 5% of accepted papers).

Hollmann, Noah; Müller, Samuel; Eggensperger, Katharina; Hutter, Frank

TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second Inproceedings

In: The Eleventh International Conference on Learning Representations, 2023, ( top-25% of accepted papers ).

Shala, Gresa; Biedenkapp, André; Hutter, Frank; Grabocka, Josif

Gray-Box Gaussian Processes for Automated Reinforcement Learning Inproceedings

In: Eleventh International Conference on Learning Representations (ICLR'23), 2023.

Hvarfner, Carl; Hellsten, Erik; Hutter, Frank; Nardi, Luigi

Self-Correcting Bayesian Optimization through Bayesian Active Learning Miscellaneous

2023.

Feurer, Matthias; Eggensperger, Katharina; Bergman, Edward; Pfisterer, Florian; Bischl, Bernd; Hutter, Frank

Mind the Gap: Measuring Generalization Performance Across Multiple Objectives Inproceedings

In: Crémilleux, Bruno; Hess, Sibylle; Nijssen, Siegfried (Ed.): Advances in Intelligent Data Analysis XXI. IDA 2023., pp. 130-142, Springer, Cham, 2023.

Weerts, Hilde; Pfisterer, Florian; Feurer, Matthias; Eggensperger, Katharina; Bergman, Edward; Awad, Noor; Vanschoren, Joaquin; Pechenizkiy, Mykola; Bischl, Bernd; Hutter, Frank

Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML Journal Article

In: arXiv:2303.08485 [cs.AI], 2023.

White, Colin; Safari, Mahmoud; Sukthanker, Rhea; Ru, Binxin; Elsken, Thomas; Zela, Arber; Dey, Debadeepta; Hutter, Frank

Neural Architecture Search: Insights from 1000 Papers Online

2023, visited: 20.01.2023.

Schrodi, Simon; Stoll, Danny; Ru, Binxin; Sukthanker, Rhea; Brox, Thomas; Hutter, Frank

Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars Miscellaneous

2023.

Hollmann, Noah; Müller, Samuel; Hutter, Frank

LLMs for Semi-Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineering Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023.

2022

Adriaensen, Steven; Biedenkapp, André; Shala, Gresa; Awad, Noor; Eimer, Theresa; Lindauer, Marius; Hutter, Frank

Automated Dynamic Algorithm Configuration Journal Article

In: Journal of Artificial Intelligence Research (JAIR), vol. 75, pp. 1633-1699, 2022.

Shala, Gresa; Biedenkapp, André; Hutter, Frank; Grabocka, Josif

Gray-Box Gaussian Processes for Automated Reinforcement Learning Inproceedings

In: Workshop on Meta-Learning (MetaLearn@NeurIPS'22), 2022.

Shala, Gresa; Arango, Sebastian Pineda; Biedenkapp, André; Hutter, Frank; Grabocka, Josif

AutoRL-Bench 1.0 Inproceedings

In: Workshop on Meta-Learning (MetaLearn@NeurIPS'22), 2022.

Franke, Jörg; Runge, Frederic; Hutter, Frank

Probabilistic Transformer: Modelling Ambiguities and Distributions for RNA Folding and Molecule Design Inproceedings

In: Oh, Alice H.; Agarwal, Alekh; Belgrave, Danielle; Cho, Kyunghyun (Ed.): Advances in Neural Information Processing Systems (NeurIPS 2022), 2022.

Hvarfner, Carl; Hutter, Frank; Nardi, Luigi

Joint Entropy Search For Maximally-Informed Bayesian Optimization Inproceedings

In: Oh, Alice H.; Agarwal, Alekh; Belgrave, Danielle; Cho, Kyunghyun (Ed.): Advances in Neural Information Processing Systems (NeurIPS 2022), 2022.

Bansal, Archit; Stoll, Danny; Janowski, Maciej; Zela, Arber; Hutter, Frank

JAHS-Bench-201: A Foundation For Research On Joint Architecture And Hyperparameter Search Inproceedings

In: Thirty-sixth Conference on Neural Information Processing Systems, 2022, (Featured Paper - top 7.5% of accepted papers).

Krishnakumar, Arjun; White, Colin; Zela, Arber; Tu, Renbo; Safari, Mahmoud; Hutter, Frank

NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxies Inproceedings

In: Thirty-sixth Conference on Neural Information Processing Systems, 2022.

Feurer, Matthias; Eggensperger, Katharina; Falkner, Stefan; Lindauer, Marius; Hutter, Frank

Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learning Journal Article

In: Journal of Machine Learning Research, vol. 23, no. 261, pp. 1-61, 2022.

Hvarfner, Carl; Hutter, Frank; Nardi, Luigi

Joint Entropy Search For Maximally-Informed Bayesian Optimization Inproceedings

In: Workshop on Adaptive Experimental Design and Active Learning in the Real World (ReALML@ICML'22), 2022.

Sass, René; Bergman, Eddie; Biedenkapp, André; Hutter, Frank; Lindauer, Marius

DeepCAVE: An Interactive Analysis Tool for Automated Machine Learning Inproceedings

In: Workshop on Adaptive Experimental Design and Active Learning in the Real World (ReALML@ICML'22), 2022.

Biedenkapp, André; Dang, Nguyen; Krejca, Martin S.; Hutter, Frank; Doerr, Carola

Theory-inspired Parameter Control Benchmarks for Dynamic Algorithm Configuration Inproceedings

In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'22), 2022, (Won the best paper award in the GECH track).

Biedenkapp, André; Speck, David; Sievers, Silvan; Hutter, Frank; Lindauer, Marius; Seipp, Jendrik

Learning Domain-Independent Policies for Open List Selection Inproceedings

In: Workshop on Bridging the Gap Between AI Planning and Reinforcement Learning (PRL @ ICAPS'22), 2022.

Wagner, Diane; Ferreira, Fabio; Stoll, Danny; Schirrmeister, Robin Tibor; Müller, Samuel; Hutter, Frank

On the Importance of Hyperparameters and Data Augmentation for Self-Supervised Learning Workshop

ICML Pre-training Workshop, 2022.

Öztürk*, Ekrem; Ferreira*, Fabio; Jomaa*, Hadi S.; Schmidt-Thieme, Lars; Grabocka, Josif; Hutter, Frank

Zero-shot AutoML with Pretrained Models Inproceedings

In: International Conference on Machine Learning (ICML), 2022.

Parker-Holder, Jack; Rajan, Raghu; Song, Xingyou; Biedenkapp, André; Miao, Yingjie; Eimer, Theresa; Zhang, Baohe; Nguyen, Vu; Calandra, Roberto; Faust, Aleksandra; Hutter, Frank; Lindauer, Marius

Automated Reinforcement Learning (AutoRL): A Survey and Open Problems Journal Article

In: Journal of Artificial Intelligence Research (JAIR), vol. 74, pp. 517-568, 2022.

Mehta*, Yash; White*, Colin; Zela, Arber; Krishnakumar, Arjun; Zabergja, Guri; Moradian, Shakiba; Safari, Mahmoud; Yu, Kaicheng; Hutter, Frank

NAS-Bench-Suite: NAS Evaluation is (Now) Surprisingly Easy Inproceedings

In: International Conference on Learning Representations (ICLR) 2022, 2022.

Müller, Samuel; Hollmann, Noah; Arango, Sebastian Pineda; Grabocka, Josif; Hutter, Frank

Transformers Can Do Bayesian Inference Inproceedings

In: 10th International Conference on Learning Representations, ICLR 2022, 2022.

Zela, Arber; Siems, Julien; Zimmer, Lucas; Lukasik, Jovita; Keuper, Margret; Hutter, Frank

Surrogate NAS Benchmarks: Going Beyond the Limited Search Spaces of Tabular NAS Benchmarks Inproceedings

In: International Conference on Learning Representations (ICLR), 2022.

Hvarfner, Carl; Stoll, Danny; Souza, Artur; Lindauer, Marius; Hutter, Frank; Nardi, Luigi

πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimization Inproceedings

In: 10th International Conference on Learning Representations, ICLR 2022, OpenReview.net, 2022.

Benjamins, Carolin; Eimer, Theresa; Schubert, Frederik; Mohan, Aditya; Biedenkapp, André; Rosenhan, Bodo; Hutter, Frank; Lindauer, Marius

Contextualize Me – The Case for Context in Reinforcement Learning Journal Article

In: arXiv:2202.04500, 2022.

Ferreira, Fabio; Nierhoff, Thomas; Sälinger, Andreas; Hutter, Frank

Learning Synthetic Environments and Reward Networks for Reinforcement Learning Inproceedings

In: 10th International Conference on Learning Representations (ICLR), OpenReview.net, 2022.

Lindauer, Marius; Eggensperger, Katharina; Feurer, Matthias; Biedenkapp, André; Deng, Difan; Benjamins, Carolin; Ruhkopf, Tim; Sass, René; Hutter, Frank

SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization Journal Article

In: Journal of Machine Learning Research (JMLR) -- MLOSS, vol. 23, no. 54, pp. 1-9, 2022.

Feurer, Matthias; Letham, Benjamin; Hutter, Frank; Bakshy, Eytan

Practical Transfer Learning for Bayesian Optimization Journal Article

In: arXiv:1802:02219v3 [stat.ML], 2022.

Müller, Samuel; Arango, Sebastian Pineda; Feurer, Matthias; Grabocka, Josif; Hutter, Frank

Bayesian Optimization with a Neural Network Meta-learned on Synthetic Data Only Workshop

Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Watanabe, Shuhei; Hutter, Frank

c-TPE: Generalizing Tree-structured Parzen Estimator with Inequality Constraints for Continuous and Categorical Hyperparameter Optimization Inproceedings

In: NeurIPS Workshop on Gaussian Processes, Spatiotemporal Modeling, and Decision-making Systems, 2022.

Adriaensen, Steven; Rakotoarison, Herilalaina; Müller, Samuel; Hutter, Frank

Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networks Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Sukthanker, Rhea Sanjay; Krishnakumar, Arjun; Patil, Sharat; Hutter, Frank

GraViT-E: Gradient-based Vision Transformer Search with Entangled Weights Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Watanabe, Shuhei; Awad, Noor; Onishi, Masaki; Hutter, Frank

Multi-objective Tree-structured Parzen Estimator Meets Meta-learning Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Dooley, Samuel; Sukthanker, Rhea Sanjay; Dickerson, John P; White, Colin; Hutter, Frank; Goldblum, Micah

On the Importance of Architectures and Hyperparameters for Fairness in Face Recognition Inproceedings

In: Workshop on Trustworthy and Socially Responsible Machine Learning, NeurIPS 2022, 2022.

Dooley, Samuel; Sukthanker, Rhea Sanjay; Dickerson, John P; White, Colin; Hutter, Frank; Goldblum, Micah

On the Importance of Architectures and Hyperparameters for Fairness in Face Recognition Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Mallik, Neeratyoy; Hvarfner, Carl; Stoll, Danny; Janowski, Maciej; Bergman, Eddie; Lindauer, Marius; Nardi, Luigi; Hutter, Frank

PriorBand: HyperBand + Human Expert Knowledge Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Hollmann, Noah; Müller, Samuel; Eggensperger, Katharina; Hutter, Frank

TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second Inproceedings

In: NeurIPS 2022 First Table Representation Workshop, 2022.

Shala, Gresa; Elsken, Thomas; Hutter, Frank; Grabocka, Josif

Transfer NAS with Meta-learned Bayesian Surrogates Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Schrodi, Simon; Stoll, Danny; Ru, Binxin; Sukthanker, Rhea Sanjay; Brox, Thomas; Hutter, Frank

Towards Discovering Neural Architectures from Scratch Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

2021

Bischl, Bernd; Casalicchio, Giuseppe; Feurer, Matthias; Gijsbers, Pieter; Hutter, Frank; Lang, Michel; Mantovani, Rafael G; van Rijn, Jan N; Vanschoren, Joaquin

OpenML Benchmarking Suites Inproceedings

In: Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, 2021.

Benjamins, Carolin; Eimer, Theresa; Schubert, Frederik; Biedenkapp, André; Rosenhan, Bodo; Hutter, Frank; Lindauer, Marius

CARL: A Benchmark for Contextual and Adaptive Reinforcement Learning Inproceedings

In: Workshop on Ecological Theory of Reinforcement Learning (EcoRL@NeurIPS'21), 2021.

Eggensperger, Katharina; Müller, Philipp; Mallik, Neeratyoy; Feurer, Matthias; Sass, René; Klein, Aaron; Awad, Noor; Lindauer, Marius; Hutter, Frank

HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO Inproceedings

In: Vanschoren, J.; Yeung, S. (Ed.): Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, 2021.

Eimer, Theresa; Biedenkapp, André; Reimer, Maximilian; Adriaensen, Steven; Hutter, Frank; Lindauer, Marius

DACBench: A Benchmark Library for Dynamic Algorithm Configuration Inproceedings

In: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (IJCAI'21), ijcai.org, 2021.

Speck, David; Biedenkapp, André; Hutter, Frank; Mattmüller, Robert; Lindauer, Marius

Learning Heuristic Selection with Dynamic Algorithm Configuration Inproceedings

In: Proceedings of the 31st International Conference on Automated Planning and Scheduling (ICAPS'21), 2021.

Awad, Noor; Mallik, Neeratyoy; Hutter, Frank

DEHB: Evolutionary Hyberband for Scalable, Robust and Efficient Hyperparameter Optimization Inproceedings

In: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (IJCAI'21), ijcai.org, 2021.

Narayanan, Ashwin Raaghav; Zela, Arber; Saikia, Tonmoy; Brox, Thomas; Hutter, Frank

Multi-headed Neural Ensemble Search Inproceedings

In: Workshop on Uncertainty and Robustness in Deep Learning (UDL@ICML`21), 2021.

Eimer, Theresa; Biedenkapp, André; Hutter, Frank; Lindauer, Marius

Self-Paced Context Evaluations for Contextual Reinforcement Learning Inproceedings

In: Proceedings of the 38th International Conference on Machine Learning (ICML 2021), 2021.

Izquierdo, Sergio; Guerrero-Viu, Julia; Hauns, Sven; Miotto, Guilherme; Schrodi, Simon; Biedenkapp, André; Elsken, Thomas; Deng, Difan; Lindauer, Marius; Hutter, Frank

Bag of Baselines for Multi-objective Joint Neural Architecture Search and Hyperparameter Optimization Inproceedings

In: Workshop on Automated Machine Learning (AutoML@ICML'21), 2021.

Biedenkapp, André; Rajan, Raghu; Hutter, Frank; Lindauer, Marius

TempoRL: Learning When to Act Inproceedings

In: Proceedings of the 38th International Conference on Machine Learning (ICML 2021), 2021.

Rajan, Raghu; Diaz, Jessica Lizeth Borja; Guttikonda, Suresh; Ferreira, Fabio; Biedenkapp, André; von Hartz, Jan Ole; Hutter, Frank

MDP Playground: A Design and Debug Testbed for Reinforcement Learning Inproceedings

In: arXiv:1909.07750, 2021.

Colin White Shen Yan, Yash Savani; Hutter, Frank

NAS-Bench-x11 and the Power of Learning Curves Inproceedings

In: Proceedings of the CVPR 2021 Workshop on Neural Architecture Search (CVPR-NAS '21), 2021.

Elsken, Thomas; Staffler, Benedikt; Zela, Arber; Metzen, Jan Hendrik; Hutter, Frank

Bag of Tricks for Neural Architecture Search Journal Article

In: Proceedings of the CVPR 2021 Workshop on Neural Architecture Search (CVPR-NAS '21), 2021.

Chatzimichailidis, Avraam; Zela, Arber; Shalini, Shalini; Labus, Peter; Keuper, Janis; Hutter, Frank; Yang, Yang

Group Sparsity: A Unified Framework for Network Pruning and Neural Architecture Search Journal Article

In: Proceedings of the CVPR 2021 Workshop on Neural Architecture Search (CVPR-NAS '21), 2021.

Kadra, Arlind; Lindauer, Marius; Hutter, Frank; Grabocka, Josif

Well-tuned Simple Nets Excel on Tabular Datasets Inproceedings

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

Zaidi, Sheheryar; Zela, Arber; Elsken, Thomas; Holmes, Christopher C.; Hutter, Frank; Teh, Yee Whye

Neural Ensemble Search for Uncertainty Estimation and Dataset Shift Inproceedings

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

Yan, Shen; White, Colin; Savani, Yash; Hutter, Frank

NAS-Bench-x11 and the Power of Learning Curves Inproceedings

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

White, Colin; Zela, Arber; Ru, Binxin; Liu, Yang; Hutter, Frank

How Powerful are Performance Predictors in Neural Architecture Search? Inproceedings

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

Franke, Jörg K H; Köhler, Gregor; Biedenkapp, André; Hutter, Frank

Sample-Efficient Automated Deep Reinforcement Learning Journal Article

In: International Conference on Learning Representations (ICLR) 2021, 2021.

Zhang, Baohe; Rajan, Raghu; Pineda, Luis; Lambert, Nathan; Biedenkapp, André; Chua, Kurtland; Hutter, Frank; Calandra, Roberto

On the Importance of Hyperparameter Optimization for Model-based Reinforcement Learning Inproceedings

In: Proceedings of the 24th International Conference on Artificial Intelligence and Statistics (AISTATS)'21, 2021.

Müller, Samuel; Hutter, Frank

TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentation Inproceedings

In: ICCV, 2021, (Oral Presentation (Top 3%)).

Ferreira, Fabio; Nierhoff, Thomas; Hutter, Frank

Learning Synthetic Environments for Reinforcement Learning with Evolution Strategies Journal Article

In: AAAI workshop on Meta-Learning Challenges, 2021.

Müller, Samuel; Biedenkapp, André; Hutter, Frank

In-Loop Meta-Learning with Gradient-Alignment Reward Inproceedings

In: AAAI workshop on Meta-Learning Challenges, 2021.

Souza, Artur; Nardi, Luigi; Oliveira, Leonardo; Olukotun, Kunle; Lindauer, Marius; Hutter, Frank

Bayesian Optimization with a Prior for the Optimum Inproceedings

In: Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD), 2021.

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-Pytorch: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Journal Article

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-1, 2021.

Feurer, Matthias; van Rijn, Jan N; Kadra, Arlind; Gijsbers, Pieter; Mallik, Neeratyoy; Ravi, Sahithya; Müller, Andreas; Vanschoren, Joaquin; Hutter, Frank

OpenML-Python: an extensible Python API for OpenML Journal Article

In: Journal of Machine Learning Research, vol. 22, no. 100, pp. 1-5, 2021.

2020

Awad, Noor; Shala, Gresa; Deng, Difan; Mallik, Neeratyoy; Feurer, Matthias; Eggensperger, Katharina; Biedenkapp, André; Vermetten, Diederick; Wang, Hao; Doerr, Carola; Lindauer, Marius; Hutter, Frank

Squirrel: A Switching Hyperparameter Optimizer Description of the entry by AutoML.org & IOHprofiler to the NeurIPS 2020 BBO challenge Journal Article

In: arXiv:2012.08180 [cs.LG], 2020, (Optimizer description for the NeurIPS 2020 BBO competition. Squirrel won the competition´s warm-starting friendly leaderboard.).

Lindauer, Marius; Hutter, Frank

Best Practices for Scientific Research on Neural Architecture Search Journal Article

In: Journal of Machine Learning Research, vol. 21, no. 243, pp. 1-18, 2020.

Lukasik, Jovita; Friede, David; Zela, Arber; Stuckenschmidt, Heiner; Hutter, Frank; Keuper, Margret

Smooth Variational Graph Embeddings for Efficient Neural Architecture Search Journal Article

In: arXiv:2010.04683 [cs.LG], 2020.

Siems, Julien; Zimmer, Lucas; Zela, Arber; Lukasik, Jovita; Keuper, Margret; Hutter, Frank

NAS-Bench-301 and the Case for Surrogate Benchmarks for Neural Architecture Search Journal Article

In: NeurIPS 4th Workshop on Meta-Learning, 2020.

Souza, Artur; Nardi, Luigi; Oliveira, Leonardo B; Olukotun, Kunle; Lindauer, Marius; Hutter, Frank

Prior-guided Bayesian Optimization Journal Article

In: NeurIPS 4th Workshop on Meta-Learning, 2020.

Speck, David; Biedenkapp, André; Hutter, Frank; Mattmüller, Robert; Lindauer, Marius

Learning Heuristic Selection with Dynamic Algorithm Configuration Inproceedings

In: Workshop on Bridging the Gap Between AI Planning and Reinforcement Learning (PRL@ICAPS'20), 2020.

Stoll, Danny; Franke, Jörg K H; Wagner, Diane; Selg, Simon; Hutter, Frank

Hyperparameter Transfer Across Developer Adjustments Journal Article

In: NeurIPS 4th Workshop on Meta-Learning, 2020.

Liu, Zhengying; Pavao, Adrien; Xu, Zhen; Escalera, Sergio; Ferreira, Fabio; Guyon, Isabelle; Hong, Sirui; Hutter, Frank; Ji, Rongrong; Junior, Julio C S Jacques; Li, Ge; Lindauer, Marius; Luo, Zhipeng; Madadi, Meysam; Nierhoff, Thomas; Niu, Kangning; Pan, Chunguang; Stoll, Danny; Treguer, Sebastien; Wang, Jin; Wang, Peng; Wu, Chenglin; Xiong, Youcheng; Zela, Arber; Zhang, Yang

Winning Solutions and Post-Challenge Analyses of the ChaLearn AutoDL Challenge 2019 Journal Article

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 9, pp. 3108-3125, 2020.

Shala, Gresa; Biedenkapp, André; Awad, Noor; Adriaensen, Steven; Lindauer, Marius; Hutter, Frank

Learning Step-Size Adaptation in CMA-ES Inproceedings

In: Proceedings of the Sixteenth International Conference on Parallel Problem Solving from Nature (PPSN'20), 2020.

Eggensperger, Katharina; Haase, Kai; Müller, Philipp; Lindauer, Marius; Hutter, Frank

Neural Model-based Optimization with Right-Censored Observations Journal Article

In: arXiv:2009:13828 [cs.AI], 2020.

Biedenkapp, André; Rajan, Raghu; Hutter, Frank; Lindauer, Marius

Towards TempoRL: Learning When to Act Inproceedings

In: Workshop on Inductive Biases, Invariances and Generalization in RL (BIG@ICML'20), 2020.

Eimer, Theresa; Biedenkapp, André; Hutter, Frank; Lindauer, Marius

Towards Self-Paced Context Evaluations for Contextual Reinforcement Learning Inproceedings

In: Workshop on Inductive Biases, Invariances and Generalization in RL (BIG@ICML'20), 2020.

Biedenkapp, André; Bozkurt, Furkan H; Eimer, Theresa; Hutter, Frank; Lindauer, Marius

Dynamic Algorithm Configuration: Foundation of a New Meta-Algorithmic Framework Inproceedings

In: Proceedings of the Twenty-fourth European Conference on Artificial Intelligence (ECAI'20), 2020.

Zaidi, Sheheryar; Zela, Arber; Elsken, Thomas; Holmes, Chris; Hutter, Frank; Teh, Yee Whye

Neural Ensemble Search for Performant and Calibrated Predictions Journal Article

In: Workshop on Uncertainty and Robustness in Deep Learning (UDL@ICML`20), 2020, (Oral Presentation).

Elsken, Thomas; Staffler, Benedikt; Metzen, Jan Hendrik; Hutter, Frank

Meta-Learning of Neural Architectures for Few-Shot Learning Inproceedings

In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, (Oral Presentation (Top 6%)).

Gargiani, Matilde; Zanelli, Andrea; Diehl, Moritz; Hutter, Frank

On the Promise of the Stochastic Generalized Gauss-Newton Method for Training DNNs Journal Article

In: arXiv:2006.02409 [cs.LG], 2020.

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Journal Article

In: arXiv:2006.13799 [cs.LG], 2020.

Lehman, J; Clune, J; Misevic, D; Adami, C; Beaulieu, J; Bentley, P J; Bernard, S; Beslon, G; Bryson, D M; Chrabaszcz, P; Cheney, N; Cully, A; Doncieux, S; Dyer, F C; Ellefsen, K O; Feldt, R; Fischer, S; Forrest, S; Frénoy, A; Gagné, C; Goff, Le L K; Grabowski, L M; Hodjat, B; Hutter, F; Keller, L; Knibbe, C; Krcah, P; Lenski, R E; Lipson, H; MacCurdy, R; Maestre, C; Miikkulainen, R; Mitri, S; Moriarty, D E; Mouret, J -B; Nguyen, A; Ofria, C; Parizeau, M; Parsons, D P; Pennock, R T; Punch, W F; Ray, T S; Schoenauer, M; Shulte, E; Sims, K; Stanley, K O; Taddei, F; Tarapore, D; Thibault, S; Weimer, W; Watson, R; Yosinksi, J

The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities Journal Article

In: Artificial Life, vol. 26, no. 2, pp. 274-306, 2020.

Awad, N; Mallik, N; Hutter, F

Differential Evolution for Neural Architecture Search Inproceedings

In: Proceedings of the 1st workshop on neural architecture search(@ICLR'20), 2020.

Tomašev, Nenad; Cornebise, Julien; Hutter, Frank; Mohamed, Shakir; Khan, Mohammad Emtiyaz; Winne, Ruben De; Schaul, Tom; Clopath, Claudia

AI for social good: unlocking the opportunity for positive impact Journal Article

In: Nature Communications, vol. 11, no. 1, 2020.

Volpp, Michael; Fröhlich, Lukas P; Fischer, Kirsten; Doerr, Andreas; Falkner, Stefan; Hutter, Frank; Daniel, Christian

Meta-Learning Acquisition Functions for Transfer Learning in Bayesian Optimization Inproceedings

In: International Conference on Learning Representations, 2020.

Zela, Arber; Siems, Julien; Hutter, Frank

NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Inproceedings

In: International Conference on Learning Representations, 2020.

Zela, Arber; Elsken, Thomas; Saikia, Tonmoy; Marrakchi, Yassine; Brox, Thomas; Hutter, Frank

Understanding and Robustifying Differentiable Architecture Search Inproceedings

In: International Conference on Learning Representations, 2020, (Oral Presentation (Top 7%)).

Gargiani, Matilde; Zanelli, Andrea; Tran-Dinh, Quoc; Diehl, Moritz; Hutter, Frank

Transferring Optimally Across Data Distrutions via Homotopy Methods Inproceedings

In: International Conference on Learning Representations, 2020.

2019

Rajan, Raghu; Hutter, Frank

MDP Playground: Meta-Features in Reinforcement Learning Inproceedings

In: NeurIPS 2019 Deep RL Workshop, 2019.

Bischl, Bernd; Casalicchio, Giuseppe; Feurer, Matthias; Hutter, Frank; Lang, Michel; Mantovani, Rafael G; van Rijn, Jan N; Vanschoren, Joaquin

OpenML Benchmarking Suites Journal Article

In: arXiv, vol. 1708.0373v2, pp. 1-6, 2019.

Lindauer, Marius; Eggensperger, Katharina; Feurer, Matthias; Biedenkapp, André; Marben, Joshua; Müller, Philipp; Hutter, Frank

BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters Journal Article

In: arXiv:1908.06756 [cs.LG], 2019.

Lindauer, Marius; Feurer, Matthias; Eggensperger, Katharina; Biedenkapp, André; Hutter, Frank

Towards Assessing the Impact of Bayesian Optimization's Own Hyperparameters Inproceedings

In: IJCAI 2019 DSO Workshop, 2019.

Biedenkapp, André; Bozkurt, Furkan H; Hutter, Frank; Lindauer, Marius

Towards White-box Benchmarks for Algorithm Control Inproceedings

In: IJCAI 2019 DSO Workshop, 2019.

Fuks, L; Awad, N; Hutter, F; Lindauer, M

An Evolution Strategy with Progressive Episode Lengths for Playing Games Inproceedings

In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’19), 2019.

Gargiani, M; Klein, A; Falkner, S; Hutter, F

Probabilistic Rollouts for Learning Curve Extrapolation Across Hyperparameter Settings Inproceedings

In: 6th ICML Workshop on Automated Machine Learning, 2019.

Feurer, Matthias; Hutter, Frank

Hyperparameter Optimization Incollection

In: Hutter, Frank; Kotthoff, Lars; Vanschoren, Joaquin (Ed.): AutoML: Methods, Sytems, Challenges, pp. 3–33, Springer, 2019.

Feurer, Matthias; Klein, Aaron; Eggensperger, Katharina; Springenberg, Jost; Blum, Manuel; Hutter, Frank

Auto-sklearn: Efficient and Robust Automated Machine Learning Incollection

In: Hutter, Frank; Kotthoff, Lars; Vanschoren, Joaquin (Ed.): AutoML: Methods, Systems, Challenges, pp. 113–134, Springer, 2019.

Mendoza, Hector; Klein, Aaron; Feurer, Matthias; Springenberg, Jost Tobias; Urban, Matthias; Burkart, Michael; Dippel, Max; Lindauer, Marius; Hutter, Frank

Towards Automatically-Tuned Deep Neural Networks Incollection

In: Hutter, Frank; Kotthoff, Lars; Vanschoren, Joaquin (Ed.): AutoML: Methods, Sytems, Challenges, pp. 135–149, Springer, 2019.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Neural Architecture Search: A Survey Journal Article

In: Journal of Machine Learning Research, vol. 20, no. 55, pp. 1-21, 2019.

Eggensperger, Katharina; Lindauer, Marius; Hutter, Frank

Pitfalls and Best Practices in Algorithm Configuration Journal Article

In: Journal of Artificial Intelligence Research (JAIR), vol. 64, pp. 861–893, 2019.

Klein, Aaron; Dai, Zhenwen; Hutter, Frank; Lawrence, Neil; Gonzalez, Javier

Meta-Surrogate Benchmarking for Hyperparameter Optimization Incollection

In: Wallach, H; Larochelle, H; Beygelzimer, A; d' Alché-Buc, F; Fox, E; Garnett, R (Ed.): Advances in Neural Information Processing Systems 32, pp. 6270–6280, Curran Associates, Inc., 2019.

Franke, Jörg KH; Köhler, Gregor; Awad, Noor; Hutter, Frank

Neural Architecture Evolution in Deep Reinforcement Learning for Continuous Control Journal Article

In: NeurIPS 2019 Workshop on Meta-Learning, 2019.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Efficient Multi-Objective Neural Architecture Search via Lamarckian Evolution Inproceedings

In: International Conference on Learning Representations, 2019.

Hutter, Frank; Kotthoff, Lars; Vanschoren, Joaquin (Ed.)

Automated Machine Learning - Methods, Systems, Challenges Book

Springer, 2019.

Runge, Frederic; Stoll, Danny; Falkner, Stefan; Hutter, Frank

Learning to Design RNA Inproceedings

In: International Conference on Learning Representations, 2019.

Loshchilov, Ilya; Hutter, Frank

Decoupled Weight Decay Regularization Inproceedings

In: International Conference on Learning Representations, 2019.

Ying, Chris; Klein, Aaron; Real, Esteban; Christiansen, Eric; Murphy, Kevin; Hutter, Frank

Nas-bench-101: Towards reproducible neural architecture search Inproceedings

In: Thirty-sixth International Conference on Machine Learning, 2019.

Saikia, T; Marrakchi, Y; Zela, A; Hutter, F; Brox, T

AutoDispNet: Improving Disparity Estimation With AutoML Inproceedings

In: IEEE International Conference on Computer Vision (ICCV), 2019.

2018

Eggensperger, Katharina; Lindauer, Marius; Hutter, Frank

Neural Networks for Predicting Algorithm Runtime Distributions Inproceedings

In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’18), pp. 1442-1448, 2018.

Zela, Arber; Klein, Aaron; Falkner, Stefan; Hutter, Frank

Towards Automated Deep Learning: Efficient Joint Neural Architecture and Hyperparameter Search Inproceedings

In: ICML 2018 AutoML Workshop, 2018.

Chrabąszcz, Patryk; Loshchilov, Ilya; Hutter, Frank

Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari Inproceedings

In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI-18, pp. 1419–1426, International Joint Conferences on Artificial Intelligence Organization, 2018.

Falkner, Stefan; Klein, Aaron; Hutter, Frank

BOHB: Robust and Efficient Hyperparameter Optimization at Scale Inproceedings

In: Proceedings of the 35th International Conference on Machine Learning (ICML 2018), pp. 1436–1445, 2018.

Feurer, Matthias; Eggensperger, Katharina; Falkner, Stefan; Lindauer, Marius; Hutter, Frank

Practical Automated Machine Learning for the AutoML Challenge 2018 Inproceedings

In: ICML 2018 AutoML Workshop, 2018.

Schirrmeister, R; Chrabąszcz, P; Hutter, F; Ball, T

Training Generative Reversible Networks Inproceedings

In: ICML 2018 workshop on Theoretical Foundations and Applications of Deep Generative Models, 2018.

Feurer, M; Hutter, F

Towards Further Automation in AutoML Inproceedings

In: ICML 2018 AutoML Workshop, 2018.

Biedenkapp, André; Marben, Joshua; Lindauer, Marius; Hutter, Frank

CAVE: Configuration Assessment, Visualization and Evaluation Inproceedings

In: Proceedings of the International Conference on Learning and Intelligent Optimization (LION'18), 2018.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Efficient Multi-objective Neural Architecture Search via Lamarckian Evolution Journal Article

In: ArXiv e-prints, vol. 1804.09081, 2018.

Ilg, Eddy; Cicek, Oezguen; Galesso, Silvio; Klein, Aaron; Makansi, Osama; Hutter, Frank; Brox, Thomas

Uncertainty Estimates for Optical Flow with Multi-Hypotheses Networks Journal Article

In: Proceedings of ECCV 2018, 2018.

Lindauer, M; Hutter, F

Warmstarting of Model-based Algorithm Configuration Inproceedings

In: Proceedings of the AAAI conference, pp. 1355–1362, 2018.

Eggensperger, Katharina; Lindauer, Marius; Hoos, Holger H; Hutter, Frank; Leyton-Brown, Kevin

Efficient Benchmarking of Algorithm Configurators via Model-Based Surrogates Journal Article

In: Machine Learning, vol. 107, pp. 15-41, 2018.

Wilson, Dennis; Rodrigues, Silvio; Segura, Carlos; Loshchilov, Ilya; Hutter, Frank; Buenfil, Guillermo López; Kheiri, Ahmed; Keedwell, Ed; Ocampo-Pineda, Mario; Özcan, Ender; Peña, Sergio Ivvan Valdez; Goldman, Brian; Rionda, Salvador Botello; Hernández-Aguirre, Arturo; Veeramachaneni, Kalyan; Cussat-Blanc, Sylvain

Evolutionary computation for wind farm layout optimization Journal Article

In: Renewable Energy, vol. 126, pp. 681 - 691, 2018, ISSN: 0960-1481.

Wilson, James; Hutter, Frank; Deisenroth, Marc

Maximizing acquisition functions for Bayesian optimization Inproceedings

In: Bengio, S; Wallach, H; Larochelle, H; Grauman, K; Cesa-Bianchi, N; Garnett, R (Ed.): Advances in Neural Information Processing Systems 31, pp. 9906–9917, Curran Associates, Inc., 2018.

van Rijn, J N; Hutter, F

Hyperparameter Importance Across Datasets Journal Article

In: SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2018), 2018.

2017

Klein, A; Falkner, S; Mansur, N; Hutter, F

RoBO: A Flexible and Robust Bayesian Optimization Framework in Python Inproceedings

In: NIPS 2017 Bayesian Optimization Workshop, 2017.

Falkner, S; Klein, A; Hutter, F

Combining Hyperband and Bayesian Optimization Inproceedings

In: NIPS 2017 Bayesian Optimization Workshop, 2017.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Simple And Efficient Architecture Search for Convolutional Neural Networks Inproceedings

In: NIPS Workshop on Meta-Learning, 2017.

Bischl, Bernd; Casalicchio, Giuseppe; Feurer, Matthias; Hutter, Frank; Lang, Michel; Mantovani, Rafael G; van Rijn, Jan N; Vanschoren, Joaquin

OpenML Benchmarking Suites and the OpenML100 Journal Article

In: arXiv, vol. 1708.0373v1, pp. 1-6, 2017.

Greff, K; Klein, A; Chovanec, M; Hutter, F; Schmidhuber, J

The Sacred Infrastructure for Computational Research Inproceedings

In: Proceedings of the 15th Python in Science Conference (SciPy 2017), 2017.

Lindauer, M; Hoos, H; Hutter, F; Schaub, T

AutoFolio: An Automatically Configured Algorithm Selector (Extended Abstract) Inproceedings

In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI'17), 2017.

Loshchilov, I; Hutter, F

SGDR: Stochastic Gradient Descent with Warm Restarts Inproceedings

In: International Conference on Learning Representations (ICLR) 2017 Conference Track, 2017.

Klein, A; Falkner, S; Springenberg, J T; Hutter, F

Learning Curve Prediction with Bayesian Neural Networks Inproceedings

In: International Conference on Learning Representations (ICLR) 2017 Conference Track, 2017.

Wagner, M; Lindauer, M; Misir, M; Nallaperuma, S; Hutter, F

A case study of algorithm selection for the traveling thief problem Journal Article

In: Journal of Heuristics, pp. 1-26, 2017.

Biedenkapp, André; Lindauer, Marius; Eggensperger, Katharina; Fawcett, Chris; Hoos, Holger H; Hutter, Frank

Efficient Parameter Importance Analysis via Ablation with Surrogates Inproceedings

In: Proceedings of the Thirty-First Conference on Artificial Intelligence (AAAI'17), pp. 773–779, 2017.

Hutter, F; Lindauer, M; Balint, A; Bayless, S; Hoos, H; Leyton-Brown, K

The Configurable SAT Solver Challenge (CSSC) Journal Article

In: Artificial Intelligence Journal (AIJ), vol. 243, pp. 1-25, 2017.

Lindauer, M; Hutter, F

Pitfalls and Best Practices for Algorithm Configuration (Breakout Session Report) Journal Article

In: Dagstuhl Reports, vol. 6, pp. 70-72, 2017.

Schirrmeister, Robin; Springenberg, Jost Tobias; Fiederer, Lukas; Glasstetter, Martin; Eggensperger, Katharina; Tangermann, Michael; Hutter, Frank; Burgard, Wolfram; Ball, Tonio

Deep learning with convolutional neural networks for EEG decoding and visualization Journal Article

In: Human Brain Mapping, vol. 38, pp. 5391–5420, 2017.

Chrabaszcz, Patryk; Loshchilov, Ilya; Hutter, Frank

A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets Miscellaneous

2017.

Wilson, James T.; Moriconi, Riccardo; Hutter, Frank; Deisenroth, Marc P.

The Reparameterization Trick for Acquisition Functions Inproceedings

In: NIPS Workshop on Bayesian Optimization, 2017.

Lindauer, M; Hoos, H; Hutter, F; Leyton-Brown, K

Selection and Configuration of Parallel Portfolios Incollection

In: Hamadi, Y; Sais, L (Ed.): Handbook of Parallel Constraint Reasoning, Springer, 2017.

Klein, A; Falkner, S; Bartels, S; Hennig, P; Hutter, F

Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasets Inproceedings

In: Proceedings of the AISTATS conference, 2017.

Klein, A; Falkner, S; Bartels, S; Hennig, P; Hutter, F

Fast Bayesian hyperparameter optimization on large datasets Inproceedings

In: Electronic Journal of Statistics, 2017.

van Rijn, J N; Hutter, F

An Empirical Study of Hyperparameter Importance Across Datasets Inproceedings

In: Proceedings of the International Workshop on Automatic Selection, Configuration and Composition of Machine Learning Algorithms (AutoML 2017), pp. 97–104, 2017.

2016

Springenberg, J T; Klein, A; Falkner, S; Hutter, F

Bayesian optimization with robust Bayesian neural networks Inproceedings

In: Advances in Neural Information Processing Systems 29, 2016.

Bischl, B; Kerschke, P; Kotthoff, L; Lindauer, M; Malitsky, Y; Frechétte, A; Hoos, H; Hutter, F; Leyton-Brown, K; Tierney, K; Vanschoren, J

ASlib: A Benchmark Library for Algorithm Selection Journal Article

In: Artificial Intelligence Journal (AIJ), vol. 237, pp. 41-58, 2016.

Mendoza, H; Klein, A; Feurer, M; Springenberg, J; Hutter, F

Towards Automatically-Tuned Neural Networks Inproceedings

In: ICML 2016 AutoML Workshop, 2016.

Loshchilov, I; Hutter, F

Online Batch Selection for Faster Training of Neural Networks Inproceedings

In: International Conference on Learning Representations (ICLR) 2016 Workshop Track, 2016.

Loshchilov, I; Hutter, F

CMA-ES for Hyperparameter Optimization of Deep Neural Networks Inproceedings

In: International Conference on Learning Representations (ICLR) 2016 Workshop Track, 2016.

Wang, Ziyu; Hutter, Frank; Zoghi, Masrour; Matheson, David; de Freitas, Nando

Bayesian Optimization in a Billion Dimensions via Random Embeddings Journal Article

In: Journal of Artificial Intelligence Research (JAIR), vol. 55, pp. 361-387, 2016.

Meinel, Andreas; Eggensperger, Katharina; Tangermann, Michael; Hutter, Frank

Hyperparameter Optimization for Machine Learning Problems in BCI (Abstract) Inproceedings

In: Proceedings of the International Brain Computer Interface Meeting 2016, 2016.

Schubert, Tobias; Eggensperger, Katharina; Gkogkidis, Alexis; Hutter, Frank; Ball, Tonio; Burgard, Wolfram

Automatic Bone Parameter Estimation for Skeleton Tracking in Optical Motion Capture Inproceedings

In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA'16), 2016, (Video showing the results of the optimization procedure).

2015

Feurer, Matthias; Klein, Aaron; Eggensperger, Katharina; Springenberg, Jost Tobias; Blum, Manuel; Hutter, Frank

Efficient and Robust Automated Machine Learning Inproceedings

In: Advances in Neural Information Processing Systems 28 (NeurIPS'15), pp. 2962–2970, 2015.

Klein, A; Bartels, S; Falkner, S; Hennig, P; Hutter, F

Towards efficient Bayesian Optimization for Big Data Inproceedings

In: NIPS 2015 Bayesian Optimization Workshop, 2015.

Lindauer, M; Hoos, H; Hutter, F; Schaub, T

AutoFolio: An automatically configured Algorithm Selector Journal Article

In: Journal of Artificial Intelligence, vol. 53, pp. 745-778, 2015.

Falkner, S; Lindauer, M; Hutter, F

SpySMAC: Automated Configuration and Performance Analysis of SAT Solvers Inproceedings

In: Proceedings of the International Conference on Satisfiability Solving (SAT'15), pp. 1-8, 2015.

Feurer, Matthias; Klein, Aaron; Eggensperger, Katharina; Springenberg, Jost Tobias; Blum, Manuel; Hutter, Frank

Methods for Improving Bayesian Optimization for AutoML Inproceedings

In: ICML 2015 AutoML Workshop, 2015.

Vallati, Mauro; Hutter, Frank; Chrpa, Lukáš; McCluskey, T L

On the Effective Configuration of Planning Domain Models Inproceedings

In: Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI), AAAI press, 2015.

Domhan, T; Springenberg, J T; Hutter, F

Speeding up Automatic Hyperparameter Optimization of Deep Neural Networks by Extrapolation of Learning Curves Inproceedings

In: Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI), 2015.

Hutter, F; Lücke, J; Schmidt-Thieme, L

Beyond Manual Tuning of Hyperparameters Journal Article

In: Künstliche Intelligenz, vol. 0, pp. 1-9, 2015.

Hutter, F; Xu, L; Hoos, H H; Leyton-Brown, K

Algorithm runtime prediction: Methods & evaluation (extended abstract) Inproceedings

In: Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI), 2015.

Eggensperger, K; Hutter, F; Hoos, H H; Leyton-Brown, K

Efficient Benchmarking of Hyperparameter Optimizers via Surrogates Inproceedings

In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015.

Feurer, M; Springenberg, T; Hutter, F

Initializing Bayesian Hyperparameter Optimization via Meta-Learning Inproceedings

In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015.

Lindauer, M; Hoos, H; Hutter, F; Schaub, T

AutoFolio: Algorithm Configuration for Algorithm Selection Inproceedings

In: Proceedings of the Twenty-Ninth AAAI Workshops on Artificial Intelligence, 2015.

Seipp, J; Sievers, S; Helmert, M; Hutter, F

Automatic Configuration of Sequential Planning Portfolios Inproceedings

In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015.

Vanschoren, J; Bischl, B; Hutter, F; Sebag, M; Kegl, B; Schmid, M; Napolitano, G; Wolstencroft, K; Williams, A R; Lawrence, N

Towards a Data Science Collaboratory Inproceedings

In: Advances in Intelligent Data Analysis XIV (IDA 2015), 2015.

Lindauer, M; Hoos, H; F,; Hutter,

From Sequential Algorithm Selection to Parallel Portfolio Selection Inproceedings

In: Proceedings of the International Conference on Learning and Intelligent Optimization (LION'15), 2015.

2014

Seipp, Jendrick; Sievers, Silvan; Hutter, Frank

Fast Downward SMAC Miscellaneous

2014, (Planner abstract, IPC 2014 Planning and Learning TrackBest basic solver award, and third place in the categories overall best quality and best learner.).

Seipp, Jendrick; Sievers, Silvan; Hutter, Frank

Fast Downward Cedalion Miscellaneous

2014, (Planner abstract, IPC 2014 Planning and Learning TrackBest learner award, and second place in the category overall best quality at the IPC 2014 Planning and Learning Track. Also achieved the highest coverage in the IPC 2014 sequential agile planning track.).

Eggensperger, Katharina; Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

Surrogate Benchmarks for Hyperparameter Optimization Inproceedings

In: ECAI workshop on Metalearning and Algorithm Selection (MetaSel), pp. 24-31, 2014, (Superseeded by the AAAI15 paper _Efficient Benchmarking of Hyperparameter Optimizers via Surrogates_).

Feurer, M; Springenberg, T; Hutter, F

Using Meta-Learning to Initialize Bayesian Optimization of Hyperparameters Inproceedings

In: ECAI workshop on Metalearning and Algorithm Selection (MetaSel), pp. 3–10, 2014, (Superseeded by the AAAI15 paper _Initializing Bayesian Hyperparameter Optimization via Meta-Learning_).

Domhan, Tobias; Springenberg, Tobias; Hutter, Frank

Extrapolating Learning Curves of Deep Neural Networks Inproceedings

In: ICML 2014 AutoML Workshop, 2014.

Fawcett, Chris; Vallati, Mauro; Hutter, Frank; Hoffmann, Jörg; Hoos, Holger; Leyton-Brown, Kevin

Improved Features for Runtime Prediction of Domain-Independent Planners Inproceedings

In: Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS 2014), 2014.

Hutter, F; Hoos, H; Leyton-Brown, K

An Efficient Approach for Assessing Hyperparameter Importance Inproceedings

In: Proceedings of International Conference on Machine Learning 2014 (ICML 2014), pp. 754–762, 2014.

Leyton-Brown, Kevin; Hoos, Holger; Hutter, Frank; Xu, Lin

Understanding the Empirical Hardness of NP-complete Problems Journal Article

In: Communications of the Association for Computing Machinery (CACM), vol. 57, no. 5, pp. 98–107, 2014.

Geschwender, Daniel; Hutter, Frank; Kotthoff, Lars; Malitsky, Yuri; Hoos, Holger; Leyton-Brown, Kevin

Algorithm Configuration in the Cloud: A Feasibility Study Inproceedings

In: Proceedings of the Learning and Intelligent OptimizatioN Conference (LION 8), 2014.

Hutter, Frank; López-Ibáñez, Manuel; Fawcett, Chris; Lindauer, Marius; Hoos, Holger; Leyton-Brown, Kevin; Stützle, Thomas

AClib: a Benchmark Library for Algorithm Configuration Inproceedings

In: Proceedings of the Learning and Intelligent OptimizatioN Conference (LION 8), 2014.

Hutter, F; Xu, L; Hoos, H H; Leyton-Brown, K

Algorithm runtime prediction: Methods & evaluation Journal Article

In: Artificial Intelligence, vol. 206, no. 0, pp. 79–111, 2014, (The data and source code for this paper are available from our Empirical Performance Models project page).

2013

Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

An Efficient Approach for Assessing Parameter Importance in Bayesian Optimization Inproceedings

In: NIPS workshop on Bayesian Optimization in Theory and Practice, 2013.

Swersky, Kevin; Duvenaud, David; Snoek, Jasper; Hutter, Frank; Osborne, Michael

Raiders of the Lost Architecture: Kernels for Bayesian Optimization in Conditional Parameter Spaces Inproceedings

In: NIPS workshop on Bayesian Optimization in Theory and Practice, 2013.

Eggensperger, Katharina; Feurer, Matthias; Hutter, Frank; Bergstra, James; Snoek, Jasper; Hoos, Holger H; Leyton-Brown, Kevin

Towards an Empirical Foundation for Assessing Bayesian Optimization of Hyperparameters Inproceedings

In: NeurIPS workshop on Bayesian Optimization in Theory and Practice, 2013, (Software and benchmarks are available from our HPOlib website.).

Wang, Z; Zoghi, M; Hutter, F; Matheson, D; de Freitas, N

Bayesian Optimization in High Dimensions via Random Embeddings Inproceedings

In: Proceedings of the 23rd international joint conference on Artificial Intelligence (IJCAI), pp. 1778-1784, AAAI Press 2013, (Distinguished paper award. ).

Thornton, C; Hutter, F; Hoos, H H; Leyton-Brown, K

Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms Inproceedings

In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'13), 2013, (The software is available from our Auto-WEKA page.).

Hutter, F; Hoos, H H; Leyton-Brown, K

An Evaluation of Sequential Model-Based Optimization for Expensive Blackbox Functions Inproceedings

In: Proceedings of GECCO-13 Workshop on Blackbox Optimization Benchmarking (BBOB'13), 2013, (Software and data are available from the SMAC page.).

Hutter, F; Hoos, H H; Leyton-Brown, K

Identifying Key Algorithm Parameters and Instance Features using Forward Selection Incollection

In: Nicosia, Giuseppe; Pardalos, Panos (Ed.): Proceedings of the 7th International Conference on Learning and Optimization (LION-7), Springer Berlin Heidelberg, 2013, (The data and source code for this paper are available from our Empirical Performance Models project page.).

2012

Xu, Lin; Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

Evaluating Component Solver Contributions to Portfolio-Based Algorithm Selectors Inproceedings

In: International Conference on Theory and Applications of Satisfiability Testing (SAT'12), 2012.

Xu, L; Hutter, F; Shen, J; Hoos, H; Leyton-Brown, K

SATzilla2012: Improved Algorithm Selection Based on Cost-sensitive Classification Models Unpublished

2012, (Published online. Solver description for the 2012 SAT challenge. SATzilla2012 won 3 out of the 4 categories for which it was eligible, and placed 2nd in the remaining one. Details: it won the sequential portfolio track, was the best solver for 2 of the 3 main sequential categories (Application and Hard Combinatorial), and 2nd in the sequential Random Category (beaten only by a new non-portfolio solver, CCASAT). See the SATzilla project page for details on SATzilla and source code.).

Hutter, F; Hoos, H H; Leyton-Brown, K

Parallel Algorithm Configuration Inproceedings

In: Proceedings of the Learning and Intelligent OptimizatioN Conference LION 6, pp. 55-70, 2012.

2011

Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

Bayesian Optimization With Censored Response Data Inproceedings

In: NIPS workshop on Bayesian Optimization, Sequential Experimental Design, and Bandits, 2011, (Published online. There is also a new, extended arXiv version.).

Xu, Lin; Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

Hydra-MIP: Automated Algorithm Configuration and Selection for Mixed Integer Programming Inproceedings

In: RCRA workshop on Experimental Evaluation of Algorithms for Solving Problems with Combinatorial Explosion at the International Joint Conference on Artificial Intelligence (IJCAI), 2011.

Xu, Lin; Hutter, Frank; Hoos, Holger; Leyton-Brown, Kevin

Detailed SATzilla Results from the Data Analysis Track of the 2011 SAT Competition Miscellaneous

2011.

Hutter, F; Hoos, H H; Leyton-Brown, K

Sequential Model-Based Optimization for General Algorithm Configuration Inproceedings

In: Proceedings of the conference on Learning and Intelligent OptimizatioN (LION 5), pp. 507-523, 2011, (Best paper award (second prize). SMAC, ROAR, and the instances used are available from the Automated Algorithm Configuration project page. An extended version with additional details is available as UBC tech report TR-2010-10. (pdf) (bib)).

2010

Hutter, F; Bartz-Beielstein, T; Hoos, H H; Leyton-Brown, K; Murphy, K P

Sequential Model-Based Parameter Optimisation: an Experimental Investigation of Automated and Interactive Approaches Incollection

In: Bartz-Beielstein, T; Chiarandini, M; Paquete, L; Preuss, M (Ed.): Empirical Methods for the Analysis of Optimization Algorithms, pp. 361–411, Springer, 2010.

Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

Tradeoffs in the Empirical Evaluation of Competing Algorithm Designs Journal Article

In: Annals of Mathematics and Artificial Intelligenc (AMAI), Special Issue on Learning and Intelligent Optimization, vol. 60, no. 1, pp. 65–89, 2010, (The data from this paper, as well as the empirical analysis tools we introduced are available from the Automated Algorithm Configuration project page.).

Hutter, F; Hoos, H H; Leyton-Brown, K

Sequential Model-Based Optimization for General Algorithm Configuration (extended version) Technical Report

University of British Columbia, Department of Computer Science no. TR-2010-10, 2010.

Hutter, F; Hoos, H H; Leyton-Brown, K

Automated Configuration of Mixed Integer Programming Solvers Inproceedings

In: Proceedings of the Conference on Integration of Artificial Intelligence and Operations Research techniques in Constraint Programming (CPAIOR), pp. 186-202, 2010, (Our webpage on Automated Configuration of MIP solvers also gives the parameter files for CPLEX, Gurobi, and lpsolve.).

Hutter, F; Hoos, H H; Leyton-Brown, K; Murphy, K P

Time-Bounded Sequential Parameter Optimization Inproceedings

In: Proceedings of the conference on Learning and Intelligent OptimizatioN (LION 4), 2010, (Runner-up for the best paper award).

2009

Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin; Stützle, Thomas

ParamILS: An Automatic Algorithm Configuration Framework Journal Article

In: Journal of Artificial Intelligence Research, vol. 36, pp. 267–306, 2009, (See the ParamILS project page for a lot of experimental data for this paper (target algorithms, parameters, resulting parameter configurations). There's also a quick start guide available to help you apply ParamILS for tuning your own algorithms. There's also an older tech report about ParamILS, including additional material (pdf) (bib).).

Hutter, F

Automated Configuration of Algorithms for Solving Hard Computational Problems PhD Thesis

University of British Columbia, Department of Computer Science, 2009, (There are also slides from invited presentation at Canadian AI grad student symposium. 2010 CAIAC Doctoral Dissertation Award for the best thesis in Artificial Intelligence at a Canadian University completed in 2009. See the Automated Algorithm Configuration project page for a lot of experimental data (target algorithms, parameters, benchmark instances, and configuration proceduers).).

Hutter, F; de Oca, M A Montes (Ed.)

SLS-DS 2009: Doctoral Symposium on Engineering Stochastic Local Search Algorithms Proceeding

IRIDIA, Université Libre de Bruxelles, Brussels, Belgium 2009.

Hutter, F; Hoos, H H; Leyton-Brown, K; Murphy, K P

An Experimental Investigation of Model-Based Parameter Optimisation: SPO and Beyond Inproceedings

In: Proceedings of the 11th annual conference on Genetic and evolutionary computation (GECCO '09), pp. 271–278, 2009.

Hutter, F; Hoos, H H; Leyton-Brown, K; Stützle, T

ParamILS: An Automatic Algorithm Configuration Framework Technical Report

University of British Columbia no. TR-2009-01, 2009.

Xu, L; Hutter, F; Hoos, H; Leyton-Brown, K

SATzilla2009: an Automatic Algorithm Portfolio for SAT Unpublished

2009, (Solver description, SAT competition 2009Solver description for the 2009 SAT competition. SATzilla2009 won 3 gold and 2 silver medals in that competition. See the SATzilla project page for details and source code.).

2008

Xu, Lin; Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

SATzilla: Portfolio-based Algorithm Selection for SAT Journal Article

In: Journal of Artificial Intelligence Research, vol. 32, pp. 565–606, 2008, (2010 IJCAI/JAIR Best Paper Prize for the period 2005-2009. See the SATzilla project page for details and source code.).

2007

Hutter, Frank; Babic, Domagoj; Hoos, Holger H; Hu, Alan J

Boosting Verification by Automatic Tuning of Decision Proceedingsdures Inproceedings

In: Proceedings of Formal Methods in Computer Aided Design (FMCAD'07), pp. 27–34, IEEE Computer Society, Washington, DC, USA, 2007, (With the tuning discussed in this paper Domagoj's solver Spear won the QF_BV (Quantifier-Free Bit Vector) category of the 2007 Satisfiability Modulo Theories Competition.).

Hutter, Frank

On the Potential of Automatic Algorithm Configuration Inproceedings

In: Proceedings of the Doctoral Symposium on Engineering Stochastic Local Search Algorithms (SLS-DS)., 2007, (Best poster award (voted by the attendees of SLS 07).).

Xu, L; Hutter, F; Hoos, H H; Leyton-Brown, K

SATzilla-07: The Design and Analysis of an Algorithm Portfolio for SAT Inproceedings

In: Principles and Practice of Constraint Programming (CP'07), 2007, (SATzilla won 3 gold medals, 1 silver and 1 bronze in the 2007 SAT competition! It is available for download from the SATzilla website.).

Hutter, F; Hoos, H; Stützle, T

Automatic Algorithm Configuration based on Local Search Inproceedings

In: Proceedings of the Twenty-Second Conference on Artifical Intelligence (AAAI '07), pp. 1152–1157, 2007, (The ParamILS algorithm introduced in this paper is available for download from the ParamILS website. There's also a quick start guide available to help you apply it for tuning your own algorithms.).

Tompkins, Dave; Hutter, Frank; H, Holger; Hoos,

Scaling and Probabilistic Smoothing (SAPS) Miscellaneous

2007, (SAPS is unchanged from last year, but I got a tenfold speedup by automated parameter tuning (using the techniques from the AAAI-07 ParamILS paper)).

Xu, Lin; Hutter, Frank; Hoos, Holger H; Leyton-brown, Kevin

SATzilla2007: a new & improved algorithm portfolio for SAT Miscellaneous

2007, (In a nutshell, SATzilla predicts the runtime of each solver in the portfolio and picks the most promising one. SATzilla2007 won 3 gold medals, 1 silver and 1 bronze! See the SAT competition webpage for details.).

Babić, D; Hutter, F

SPEAR Theorem Prover Miscellaneous

2007, (Solver description, SAT competitionSPEAR is a new tree search algorithm with 25 free parameters. I tuned it (using the techniques from the AAAI-07 paper on ParamILS), getting a 30% speedup; for software verification, my parameter settings beat the default by a factor of 50!).

2006

Hutter, F; Hamadi, Y; Hoos, H H; Leyton-Brown, K

Performance Prediction and Automated Tuning of Randomized and Parametric Algorithms Inproceedings

In: Principles and Practice of Constraint Programming (CP'06), pp. 213–228, 2006, (All our experimental data for this paper, as well as our Matlab code, is available on the Empirical Hardness Models project page.).

Hutter, Frank

Automated Algorithm Configuration Based on Machine Learning Miscellaneous

2006.

2005

Hutter, Frank; Hamadi, Youssef

Parameter Adjustment Based on Performance Prediction: Towards an Instance-Aware Problem Solver Technical Report

Microsoft Research Cambridge, UK, no. MSR-TR-2005-125, 2005, (Slides from a talk I gave at the Cork Constraint Computation Centre (4C) Slides from a talk I gave in the Lab for Computational Intelligence at UBC).

Hutter, Frank; Hoos, Holger H; Stützle, Thomas

Efficient Stochastic Local Search for MPE Solving Inproceedings

In: Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI-05), pp. 169–174, 2005, (My solver GLS+ and the test instances we used are available on our MPE page. The solver can read general factor graphs, i.e. Bayes nets (in BNT format), MRFs, CRFs, etc. There's also a nice Matlab interface.).

2004

Hutter, Frank

Stochastic Local Search for Solving the Most Probable Explanation Problem in Bayesian Networks Masters Thesis

Darmstadt University of Technoloy, 2004, (Supervisor: Thomas Stützle, Cosupervisor: Holger Hoos; My solver GLS+ and most of the test instances I used are available on our MPE page.).

Hutter, Frank; Ng, Brenda; Dearden, Richard

Incremental Thin Junction Trees for Dynamic Bayesian Networks Technical Report

Intellectics Group, Darmstadt University of Technology no. TR-AIDA-04-01, 2004.

de Freitas, Nando; Dearden, Richard; Hutter, Frank; Morales-Menendez, Ruben; Mutch, Jim; Poole, David

Diagnosis by a Waiter and a Mars Explorer Journal Article

In: Proceedings of the IEEE, vol. 92, no. 4, pp. 139-144, 2004, (Check out my GPF webpage for the particle filtering code used for the rover examples.).

Dearden, Richard; Willeke, Thomas; Hutter, Frank; Simmons, Reid; Verma, Vandi; Thrun, Sebastian

Real-time Fault Detection and Situational Awareness for Rovers: Report on the Mars Technology Program Task Inproceedings

In: In Proceedings of IEEE Aerospace Conference, 2004, pp. 826–840, IEEE Press, 2004, (Check out my GPF webpage for the particle filtering code.).

Andronescu, M; Fejes, A P; Hutter, F; Hoos, H H; Condon, A

A new algorithm for RNA secondary structure design Journal Article

In: Journal of Molecular Biology, vol. 336, no. 3, pp. 607–624, 2004, (Check out the free RNA Designer Software at ).

2003

Hutter, Frank; Dearden, Richard

The Gaussian Particle Filter for Diagnosis of Non-Linear Systems Inproceedings

In: Proceedings of the 14th International Conference on Principles of Diagnosis(DX03), pp. 5–70, 2003, (Check out my GPF webpage for the Gaussian particle filtering code.).

Hutter, Frank; Dearden, Richard

Efficient On-line Fault Diagnosis for Non-Linear Systems Inproceedings

In: Seventh International Symposium on Artificial Intelligence and Robotics in Space (i-SAIRAS-03), 2003, (Check out my GPF webpage for the Gaussian particle filtering code.).

2002

Hutter, F; Tompkins, D A D; Hoos, H H

Scaling and Probabilistic Smoothing: Efficient Dynamic Local Search for SAT Inproceedings

In: Hentenryck, Pascal (Ed.): Principles and Practice of Constraint Programming - CP 2002, pp. 233-248, Springer Berlin Heidelberg, 2002, (Check out the DLS for SAT webpage, maintained by Dave.).

Andronescu, M; Fejes, A P; Hutter, F; Hoos, H H; Condon, A

A New SLS Algorithm for RNA Secondary Structure Design Technical Report

Department of Computer Science, University of British Columbia no. TR-2002-10, 2002, (Available as a postscript file. Check out the free RNA Designer Software at http://www.rnasoft.ca/).