Publications – Machine Learning Lab

Ferreira, Fabio; Schlageter, Moreno; Rajan, Raghu; Biedenkapp, André; Hutter, Frank

One-shot World Models Using a Transformer Trained on a Synthetic Prior Inproceedings

In: NeurIPS 2024 Workshop on Open-World Agents, 2024.

Küken, Jaris; Purucker, Lennart; Hutter, Frank

Large Language Models Engineer Too Many Simple Features for Tabular Data Inproceedings

In: NeurIPS 2024 Third Table Representation Learning Workshop, 2024, (Oral Presentation).

Arango, Sebastian Pineda; Janowski, Maciej; Purucker, Lennart; Zela, Arber; Hutter, Frank; Grabocka, Josif

Ensembling Finetuned Language Models for Text Classification Inproceedings

In: NeurIPS 2024 Workshop on Fine-Tuning in Modern Machine Learning: Principles and Scalability, 2024.

Mallik, Neeratyoy; Janowski, Maciej; Hog, Johannes; Rakotoarison, Herilalaina; Klein, Aaron; Grabocka, Josif; Hutter, Frank

Warmstarting for Scaling Language Models Inproceedings

In: NeurIPS 2024 Workshop Adaptive Foundation Models, 2024.

Bhethanabhotla, Sathya Kamesh; Swelam, Omar; Siems, Julien; Salinas, David; Hutter, Frank

Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Models Inproceedings

In: NeurIPS 2024 TSALM Workshop, 2024, (Spotlight Presentation).

Sukthanker, Rhea Sanjay; Staffler, Benedikt; Hutter, Frank; Klein, Aaron

Large Language Model Compression with Neural Architecture Search Inproceedings

In: NeurIPS 2024 Workshop on Machine Learning and Compression, 2024.

Müller, Andreas; Siems, Julien; Nori, Harsha; Salinas, David; Zela, Arber; Caruana, Rich; Hutter, Frank

GAMformer: Exploring In-Context Learning for Generalized Additive Models Inproceedings

In: NeurIPS 2024 TRL Workshop, 2024.

Hoo, Shi Bin; Müller, Samuel; Salinas, David; Hutter, Frank

The Tabular Foundation Model TabPFN Outperforms Specialized Time Series Forecasting Models Based on Simple Features Inproceedings

In: NeurIPS 2024 TRL Workshop, 2024.

Feuer, Benjamin; Schirrmeister, Robin Tibor; Cherepanova, Valeriia; Hegde, Chinmay; Hutter, Frank; Goldblum, Micah; Cohen, Niv; White, Colin

TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks Inproceedings

In: 38th Conference on Neural Information Processing Systems (NeurIPS), 2024.

Grazzi, Riccardo; Siems, Julien; Franke, Jörg K. H.; Zela, Arber; Hutter, Frank; Pontil, Massimiliano

Unlocking State-Tracking in linear RNNs through Negative Eigenvalues Inproceedings

In: NeurIPS 2024 Workshop on Mathematics of Modern Machine Learning Workshop (M3L), 2024, (Oral Presentation).

Franke, Jörg K. H.; Hefenbrock, Michael; Koehler, Gregor; Hutter, Frank

Improving Deep Learning Optimization through Constrained Parameter Regularization Inproceedings

In: 38th Conference on Neural Information Processing Systems (NeurIPS), 2024.

Helli, Kai; Schnurr, David; Hollmann, Noah; Müller, Samuel; Hutter, Frank

Drift-Resilient TabPFN: In-Context Learning Distribution Shifts on Tabular Data Inproceedings

In: 38th Conference on Neural Information Processing Systems (NeurIPS), 2024.

Sukthanker, Rhea Sanjay; Zela, Arber; Staffler, Benedikt; Klein, Aaron; Purucker, Lennart; Franke, Joerg K. H.; Hutter, Frank

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models Inproceedings

In: 38th Conference on Neural Information Processing Systems (NeurIPS), DBT Track, 2024.

Strangmann, Tobias; Purucker, Lennart; Franke, Jörg K. H.; Rapant, Ivo; Ferreira, Fabio; Hutter, Frank

Transfer Learning for Finetuning Large Language Models Inproceedings

In: NeurIPS 2024 Workshop on Adaptive Foundation Models, 2024.

Ndir, Tidiane Camaret; Biedenkapp, André; Awad, Noor

Inferring Behavior-Specific Context Improves Zero-Shot Generalization in Reinforcement Learning Inproceedings

In: Seventeenth European Workshop on Reinforcement Learning, 2024.

Robertson, Jake; Schmidt, Thorsten; Hutter, Frank; Awad, Noor

A Human-in-the-Loop Fairness-Aware Model Selection Framework for Complex Fairness Objective Landscapes Inproceedings

In: Proceedings of the Seventh AAAI/ACM Conference on AI, Ethics, and Society (AIES-24), 2024.

Scheuer*, Dominik; Runge, Frederic*; Franke, Jörg K. H.; Wolfinger, Michael T.; Flamm, Christoph; Hutter, Frank

KinPFN: Bayesian Approximation of RNA Folding Kinetics using Prior-Data Fitted Networks Working paper

2024.

Arango, Sebastian Pineda; Janowski, Maciej; Purucker, Lennart; Zela, Arber; Hutter, Frank; Grabocka, Josif

Dynamic Post-Hoc Neural Ensemblers Inproceedings

In: Preprint, 2024.

Runge, Frederic; Hutter, Frank

Machine Learning for RNA Design: LEARNA Book Chapter

In: Churkin, Alexander; Barash, Danny (Ed.): RNA Design: Methods and Protocols, Chapter 5, pp. 63–93, Springer US, New York, NY, 1, 2024, ISBN: 978-1-0716-4079-1.

Shala, Gresa; Arango, Sebastian Pineda; Biedenkapp, André; Hutter, Frank; Grabocka, Josif

HPO-RL-Bench: A Zero-Cost Benchmark for HPO in Reinforcement Learning Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), ABCD Track, 2024, (Runner up for the best paper award).

Bordne, Philipp; Hasan, M. Asif; Bergman, Eddie; Awad, Noor; Biedenkapp, André

CANDID DAC: Leveraging Coupled Action Dimensions with Importance Differences in DAC Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Watanabe, Shuhei; Mallik, Neeratyoy; Bergman, Edward; Hutter, Frank

Fast Benchmarking of Asynchronous Multi-Fidelity Optimization on Zero-Cost Benchmarks Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), ABCD Track, 2024.

Robertson, Jake; Hollmann, Noah; Awad, Noor; Hutter, Frank

FairPFN: Transformers Can do Counterfactual Fairness Conference

Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Rapant, Ivo; Purucker, Lennart; Ferreira, Fabio; Arango, Sebastian Pineda; Kadra, Arlind; Grabocka, Josif; Hutter, Frank

Quick-Tune-Tool: A Practical Tool and its User Guide for Automatically Finetuning Pretrained Models Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Maier, Jannis; Möller, Felix; Purucker, Lennart

Hardware Aware Ensemble Selection for Balancing Predictive Accuracy and Cost Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Sukthanker, Rhea Sanjay; Krishnakumar, Arjun; Safari, Mahmoud; Hutter, Frank

Weight-Entanglement Meets Gradient-Based Neural Architecture Search Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Methods Track, 2024.

Grazzi, Riccardo; Siems, Julien; Schrodi, Simon; Brox, Thomas; Hutter, Frank

Is Mamba Capable of In-Context Learning? Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Methods Track, 2024.

Salinas, David; Erickson, Nick

TabRepo: A Large Scale Repository of Tabular Model Evaluations and its AutoML Applications Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), ABCD Track, 2024.

Strack, Lukas; Safari, Mahmoud; Hutter, Frank

Towards Efficient Search for Customized Activation Functions With Gradient Descent Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Geburek, Anton Merlin; Mallik, Neeratyoy; Stoll, Danny; Bouthillier, Xavier; Hutter, Frank

LMEMs for post-hoc analysis of HPO Benchmarking Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Karakasli, Goktug; Adriaensen, Steven; Hutter, Frank

NOSBench-101: Towards Reproducible Neural Optimizer Search Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Helli, Kai; Schnurr, David; Hollmann, Noah; Müller, Samuel; Hutter, Frank

Drift-Resilient TabPFN: In-Context Learning Distribution Shifts on Tabular Data Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Carstensen, Timur; Elsken, Thomas; Rapp, Martin

In-Context Learning for Latency Estimation Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Krishnakumar, Arjun; Jha, Abhash Kumar; Moradian, Shakiba; Rapp, Martin; Hutter, Frank

LoRA-DARTS: Low Rank Adaptation for Differentiable Architecture Search Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Rakotoarison, Herilalaina; Adriaensen, Steven; Mallik, Neeratyoy; Garibov, Samir; Bergman, Edward; Hutter, Frank

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Viering, Tom Julian; Adriaensen, Steven; Rakotoarison, Herilalaina; Hutter, Frank

From Epoch to Sample Size: Developing New Data-driven Priors for Learning Curve Prior-Fitted Networks Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Birinxhiku, Lum; Stoll, Danny; Schrodi, Simon; Hutter, Frank

Beyond Graph-Based Modeling for Hierarchical Neural Architecture Search Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Blauth, Simon; Bürger, Tobias; Häringer, Zacharias; Franke, Jörg K. H.; Hutter, Frank

Fast Optimizer Benchmark Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024.

Bergman, Eddie; Purucker, Lennart; Hutter, Frank

Don’t Waste Your Time: Early Stopping Cross-Validation Inproceedings

In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Methods Track, 2024.

Prasanna, Sai; Farid, Karim; Rajan, Raghu; Biedenkapp, André

Dreaming of Many Worlds: Learning Contextual World Models Aids Zero-Shot Generalization Journal Article

In: Reinforcement Learning Journal, vol. 3, iss. 1, no. 1, pp. 1317–1350, 2024, ISBN: 979-8-218-41163-3.

Sukthanker, Rhea Sanjay; Zela, Arber; Staffler, Benedikt; Dooley, Samuel; Grabocka, Josif; Hutter, Frank

Multi-objective Differentiable Neural Architecture Search Conference

2nd Workshop on Advancing Neural Network Training: Computational Efficiency, Scalability, and Resource Optimization (WANT@ICML), 2024.

Patil, Sharat; Schirrmeister, Robin Tibor; Ball, Tonio; Hutter, Frank

CoordConformer: Heterogenous EEG datasets decoding using Transformers Conference

Workshop on Geometry-grounded Representation Learning and Generative Modeling (GRaM@ICML), 2024.

Kadlecová, Gabriela; Lukasik, Jovita; Pilát, Martin; Vidnerová, Petra; Safari, Mahmoud; Neruda, Roman; Hutter, Frank

Surprisingly Strong Performance Prediction with Neural Graph Features Inproceedings

In: Proceedings of the 41st International Conference on Machine Learning (ICML), 2024.

Rakotoarison, Herilalaina; Adriaensen, Steven; Mallik, Neeratyoy; Garibov, Samir; Bergman, Eddie; Hutter, Frank

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization Inproceedings

In: Proceedings of the 41st International Conference on Machine Learning (ICML), 2024.

Lindauer, Marius; Karl, Florian; Klier, Anne; Moosbauer, Julia; Tornede, Alexander; Mueller, Andreas C; Hutter, Frank; Feurer, Matthias; Bischl, Bernd

Position: A Call to Action for a Human-Centered AutoML Paradigm Inproceedings

In: Proceedings of the 41st International Conference on Machine Learning (ICML), 2024.

Runge, Frederic; Franke, Jörg K. H.; Fertmann, Daniel; Backofen, Rolf; Hutter, Frank

Partial RNA Design Journal Article

In: Bioinformatics, vol. 40, no. Supplement_1, pp. i437–i445, 2024, (Oral Presentation at ISMB'24).

Matus, Dominika; Runge, Frederic; Franke, Jörg K. H.; Gerne, Lars; Uhl, Michael; Hutter, Frank; Backofen, Rolf

RNA-Protein Interaction Prediction via Sequence Embeddings Workshop

The Generative and Experimental perspectives in bioMolecular design (GEM) workshop (ICLR 2024), 2024.

Patil, Sharat; Runge, Frederic; Franke, Jörg K. H.; Hutter, Frank

Towards Generative RNA Design with Tertiary Interactions Workshop

The Generative and Experimental perspectives in bioMolecular design (GEM) workshop (ICLR 2024), 2024, (Oral Presentation).

Kohli, Ravin; Feurer, Matthias; Eggensperger, Katharina; Bischl, Bernd; Hutter, Frank

Towards Quantifying the Effect of Datasets for Benchmarking: A Look at Tabular Machine Learning Inproceedings

In: Data-centric Machine Learning Research (DMLR) Workshop (ICLR 2024), 2024.

Franke, Jörg; Hefenbrock, Michael; Hutter, Frank

Preserving Principal Subspaces to Reduce Catastrophic Forgetting in Fine-tuning Inproceedings

In: Mathematical and Empirical Understanding of Foundation Models (ME-FoMo) Workshop, 2024.

Grazzi, Riccardo; Siems, Julien; Schrodi, Simon; Brox, Thomas; Hutter, Frank

Is Mamba Capable of In-Context Learning? Inproceedings

In: Mathematical and Empirical Understanding of Foundation Models (ME-FoMo) Workshop, 2024.

Shala, Gresa; Biedenkapp, André; Grabocka, Josif

Hierarchical Transformers are Efficient Meta-Reinforcement Learners Journal Article

In: arXiv:2402.06402 [cs.LG], 2024.

Franke, Jörg K. H.; Runge, Frederic; Köksal, Ryan; Backofen, Rolf; Hutter, Frank

RNAformer: A Simple Yet Effective Deep Learning Model for RNA Secondary Structure Prediction Miscellaneous

2024.

Hvarfner, Carl; Hutter, Frank; Nardi, Luigi

A General Framework for User-Guided Bayesian Optimization Inproceedings

In: The Twelfth International Conference on Learning Representations (ICLR), 2024.

Arango, Sebastian Pineda; Ferreira, Fabio; Kadra, Arlind; Hutter, Frank; Grabocka, Josif

Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Inproceedings

In: The Twelfth International Conference on Learning Representations (ICLR), 2024, (Oral Presentation).

Runge, Frederic; Farid, Karim; Franke, Jörg K. H.; Hutter, Frank

RNABench: A Comprehensive Library for In Silico RNA Modelling Miscellaneous

2024.

Bergman, Edward; Feurer, Matthias; Bahram, Aron; Balef, Amir Rezaei; Purucker, Lennart; Segel, Sarah; Lindauer, Marius; Hutter, Frank; Eggensperger, Katharina

AMLTK: A Modular AutoML Toolkit in Python Journal Article

In: Journal of Open Source Software, vol. 9, no. 100, pp. 6367, 2024.

Wegmeth, Lukas; Vente, Tobias; Purucker, Lennart

Revealing the Hidden Impact of Top-N Metrics on Optimization in Recommender Systems Inproceedings

In: European Conference on Information Retrieval, pp. 140–156, Springer 2024.

Franke, Jörg K. H.; Hefenbrock, Michael; Koehler, Gregor; Hutter, Frank

New Horizons in Parameter Regularization: A Constraint Approach Inproceedings

In: OPT2023: 15th Annual Workshop on Optimization for Machine Learning, (NeurIPS 2023), 2023.

Runge, Frederic; Franke, Jörg K. H.; Fertmann, Daniel; Hutter, Frank

Rethinking Performance Measures of RNA Secondary Structure Problems Workshop

Machine Learning for Structural Biology Workshop, (NeruIPS 2023), 2023.

Hvarfner, Carl; Hellsten, Erik Orm; Hutter, Frank; Nardi, Luigi

Self-Correcting Bayesian Optimization through Bayesian Active Learning Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023.

Dooley*, Samuel; Sukthanker*, Rhea Sanjay; Dickerson, John P; White, Colin; Hutter, Frank; Goldblum, Micah

Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023, (Oral Paper - top 2% of accepted papers).

Schrodi, Simon; Stoll, Danny; Ru, Binxin; Sukthanker, Rhea Sanjay; Brox, Thomas; Hutter, Frank

Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023.

Mallik, Neeratyoy; Bergman, Eddie; Hvarfner, Carl; Stoll, Danny; Janowski, Maciej; Lindauer, Marius; Nardi, Luigi; Hutter, Frank

PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023.

Adriaensen, Steven; Rakotoarison, Herilalaina; Müller, Samuel; Hutter, Frank

Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networks Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023.

Hollmann, Noah; Müller, Samuel; Hutter, Frank

Large Language Models for Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineering Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023.

Ferreira, Fabio; Rapant, Ivo; Franke, Jörg K. H.; Hutter, Frank

Beyond Random Augmentations: Pretraining with Hard Views Conference Forthcoming

Forthcoming.

Wegmeth, Lukas; Vente, Tobias; Purucker, Lennart; Beel, Joeran

The Effect of Random Seeds for Data Splitting on Recommendation Accuracy Conference

Perspectives on the Evaluation of Recommender Systems Workshop (PERSPECTIVES 2023), co-located with the 17th ACM Conference on Recommender Systems, 2023.

Purucker, Lennart; Beel, Joeran

CMA-ES for Post Hoc Ensembling in AutoML: A Great Success and Salvageable Failure Conference

AutoML Conference 2023, 2023.

Purucker, Lennart; Schneider, Lennart; Anastacio, Marie; Beel, Joeran; Bischl, Bernd; Hoos, Holger

Q(D)O-ES: Population-based Quality (Diversity) Optimisation for Post Hoc Ensemble Selection in AutoML Conference

AutoML Conference 2023, 2023.

Siems, Julien; Ditschuneit, Konstantin; Ripken, Winfried; Lindborg, Alma; Schambach, Maximilian; Otterbach, Johannes; Genzel, Martin

Curve Your Enthusiasm: Concurvity Regularization in Differentiable Generalized Additive Models Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), 2023.

Watanabe, Shuhei; Hutter, Frank

c-TPE: Tree-Structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimization Inproceedings

In: Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI'23), ijcai.org, 2023.

Watanabe, Shuhei; Awad, Noor; Onishi, Masaki; Hutter, Frank

Speeding Up Multi-Objective Hyperparameter Optimization by Task Similarity-Based Meta-Learning for the Tree-Structured Parzen Estimator Inproceedings

In: Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI'23), 2023.

Watanabe, Shuhei; Bansal, Archit; Hutter, Frank

PED-ANOVA: Efficiently Quantifying Hyperparameter Importance in Arbitrary Subspaces Inproceedings

In: Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI'23), 2023.

Runge, Frederic; Franke, Jörg K. H.; Hutter, Frank

Towards Automated Design of Riboswitches Workshop

The 2023 ICML Workshop on Computational Biology, 2023.

Müller, Samuel; Feurer, Matthias; Hollmann, Noah; Hutter, Frank

PFNs4BO: In-Context Learning for Bayesian Optimization Inproceedings

In: Proceedings of the 40th International Conference on Machine Learning (ICML 2023), 2023.

Franke, Jörg K. H.; Runge, Frederic; Hutter, Frank

Scalable Deep Learning for RNA Secondary Structure Prediction Workshop

The 2023 ICML Workshop on Computational Biology, 2023.

Rajan, Raghu; Diaz, Jessica Lizeth Borja; Guttikonda, Suresh; Ferreira, Fabio; Biedenkapp, André; von Hartz, Jan Ole; Hutter, Frank

MDP Playground: An Analysis and Debug Testbed for Reinforcement Learning Journal Article

In: Journal of Artificial Intelligence Research (JAIR), vol. 77, pp. 821-890, 2023.

Arango, Sebastian Pineda; Ferreira, Fabio; Kadra, Arlind; Hutter, Frank; Grabocka, Josif

Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Conference Forthcoming

Forthcoming.

Benjamins, Carolin; Eimer, Theresa; Schubert, Frederik; Mohan, Aditya; Döhler, Sebastian; Biedenkapp, André; Rosenhan, Bodo; Hutter, Frank; Lindauer, Marius

Contextualize Me - The Case for Context in Reinforcement Learning Journal Article

In: Transactions on Machine Learning Research, 2023, ISBN: 2835-8856.

Awad, Noor; Sharma, Ayushi; Müller, Philipp; Thomas, Janek; Hutter, Frank

MO-DEHB: Evolutionary-based Hyperband for Multi-Objective Optimization Online

2023, visited: 09.05.2023.

Shala, Gresa; Biedenkapp, André; Hutter, Frank; Grabocka, Josif

Gray-Box Gaussian Processes for Automated Reinforcement Learning Inproceedings

In: Eleventh International Conference on Learning Representations (ICLR'23), 2023.

Shala, Gresa; Elsken, Thomas; Hutter, Frank; Grabocka, Josif

Transfer NAS with Meta-learned Bayesian Surrogates Inproceedings

In: The Eleventh International Conference on Learning Representations, 2023, (top 5% of accepted papers).

Hollmann, Noah; Müller, Samuel; Eggensperger, Katharina; Hutter, Frank

TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second Inproceedings

In: The Eleventh International Conference on Learning Representations (ICLR), 2023, ( top-25% of accepted papers ).

Hvarfner, Carl; Hellsten, Erik; Hutter, Frank; Nardi, Luigi

Self-Correcting Bayesian Optimization through Bayesian Active Learning Miscellaneous

2023.

Feurer, Matthias; Eggensperger, Katharina; Bergman, Edward; Pfisterer, Florian; Bischl, Bernd; Hutter, Frank

Mind the Gap: Measuring Generalization Performance Across Multiple Objectives Inproceedings

In: Crémilleux, Bruno; Hess, Sibylle; Nijssen, Siegfried (Ed.): Advances in Intelligent Data Analysis XXI. IDA 2023., pp. 130-142, Springer, Cham, 2023.

Siems, Julien; Schambach, Maximilian; Schulze, Sebastian; Otterbach, Johannes

Interpretable Reinforcement Learning via Neural Additive Models for Inventory Management Conference

AI4ABM Workshop at ICLR 2023, 2023.

Weerts, Hilde; Pfisterer, Florian; Feurer, Matthias; Eggensperger, Katharina; Bergman, Edward; Awad, Noor; Vanschoren, Joaquin; Pechenizkiy, Mykola; Bischl, Bernd; Hutter, Frank

Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML Journal Article

In: arXiv:2303.08485 [cs.AI], 2023.

Weissteiner, Jakob; Heiss, Jakob; Siems, Julien; Seuken, Sven

Bayesian Optimization based Combinatorial Assignment Inproceedings

In: AAAI 2023, 2023.

White, Colin; Safari, Mahmoud; Sukthanker, Rhea; Ru, Binxin; Elsken, Thomas; Zela, Arber; Dey, Debadeepta; Hutter, Frank

Neural Architecture Search: Insights from 1000 Papers Online

2023, visited: 20.01.2023.

Schrodi, Simon; Stoll, Danny; Ru, Binxin; Sukthanker, Rhea; Brox, Thomas; Hutter, Frank

Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars Miscellaneous

2023.

Hollmann, Noah; Müller, Samuel; Hutter, Frank

LLMs for Semi-Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineering Inproceedings

In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023.

Adriaensen, Steven; Biedenkapp, André; Shala, Gresa; Awad, Noor; Eimer, Theresa; Lindauer, Marius; Hutter, Frank

Automated Dynamic Algorithm Configuration Journal Article

In: Journal of Artificial Intelligence Research (JAIR), vol. 75, pp. 1633-1699, 2022.

Bansal, Archit; Stoll, Danny; Janowski, Maciej; Zela, Arber; Hutter, Frank

JAHS-Bench-201: A Foundation For Research On Joint Architecture And Hyperparameter Search Inproceedings

In: Thirty-sixth Conference on Neural Information Processing Systems, 2022, (Featured Paper - top 7.5% of accepted papers).

Shala, Gresa; Arango, Sebastian Pineda; Biedenkapp, André; Hutter, Frank; Grabocka, Josif

AutoRL-Bench 1.0 Inproceedings

In: Workshop on Meta-Learning (MetaLearn@NeurIPS'22), 2022.

Shala, Gresa; Biedenkapp, André; Hutter, Frank; Grabocka, Josif

Gray-Box Gaussian Processes for Automated Reinforcement Learning Inproceedings

In: Workshop on Meta-Learning (MetaLearn@NeurIPS'22), 2022.

Hvarfner, Carl; Hutter, Frank; Nardi, Luigi

Joint Entropy Search For Maximally-Informed Bayesian Optimization Inproceedings

In: Oh, Alice H.; Agarwal, Alekh; Belgrave, Danielle; Cho, Kyunghyun (Ed.): Advances in Neural Information Processing Systems (NeurIPS 2022), 2022.

Franke, Jörg; Runge, Frederic; Hutter, Frank

Probabilistic Transformer: Modelling Ambiguities and Distributions for RNA Folding and Molecule Design Inproceedings

In: Oh, Alice H.; Agarwal, Alekh; Belgrave, Danielle; Cho, Kyunghyun (Ed.): Advances in Neural Information Processing Systems (NeurIPS 2022), 2022.

Krishnakumar, Arjun; White, Colin; Zela, Arber; Tu, Renbo; Safari, Mahmoud; Hutter, Frank

NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxies Inproceedings

In: Thirty-sixth Conference on Neural Information Processing Systems, 2022.

Purucker, Lennart; Stamm, Felix; Lemmerich, Florian; Beel, Joeran

Estimating the Pruned Search Space Size of Subgroup Discovery Inproceedings

In: 2022 IEEE International Conference on Data Mining (ICDM), 2022.

Biedenkapp, André

Dynamic Algorithm Configuration by Reinforcement Learning PhD Thesis

University of Freiburg, Department of Computer Science, 2022.

Nematollahi, Iman; Rosete-Beas, Erick; Azad, Seyed Mahdi B; Rajan, Raghu; Hutter, Frank; Burgard, Wolfram

T3VIP: Transformation-based 3D Video Prediction Inproceedings

In: IEEE/RSJ International Conf. on Intelligent Robots and Systems (IROS), 2022.

Feurer, Matthias; Eggensperger, Katharina; Falkner, Stefan; Lindauer, Marius; Hutter, Frank

Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learning Journal Article

In: Journal of Machine Learning Research, vol. 23, no. 261, pp. 1-61, 2022.

Feurer, Matthias

Robust and Efficient Automated Machine Learning: Systems, Infrastructure and Advances in Hyperparameter Optimization PhD Thesis

University of Freiburg, Department of Computer Science, 2022.

Weissteiner, Jakob; Heiss, Jakob; Siems, Julien; Seuken, Sven

Monotone-Value Neural Networks: Exploiting Preference Monotonicity in Combinatorial Assignment Inproceedings

In: IJCAI-ECAI, 2022.

Hvarfner, Carl; Hutter, Frank; Nardi, Luigi

Joint Entropy Search For Maximally-Informed Bayesian Optimization Inproceedings

In: Workshop on Adaptive Experimental Design and Active Learning in the Real World (ReALML@ICML'22), 2022.

Sass, René; Bergman, Eddie; Biedenkapp, André; Hutter, Frank; Lindauer, Marius

DeepCAVE: An Interactive Analysis Tool for Automated Machine Learning Inproceedings

In: Workshop on Adaptive Experimental Design and Active Learning in the Real World (ReALML@ICML'22), 2022.

Biedenkapp, André; Dang, Nguyen; Krejca, Martin S.; Hutter, Frank; Doerr, Carola

Theory-inspired Parameter Control Benchmarks for Dynamic Algorithm Configuration Inproceedings

In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'22), 2022, (Won the best paper award in the GECH track).

Eggensperger, Katharina

Advanced Hyperparameter Optimization: Performance Modelling and Efficient Benchmarking PhD Thesis

University of Freiburg, Department of Computer Science, 2022.

pdf
bibtex

Biedenkapp, André; Speck, David; Sievers, Silvan; Hutter, Frank; Lindauer, Marius; Seipp, Jendrik

Learning Domain-Independent Policies for Open List Selection Inproceedings

In: Workshop on Bridging the Gap Between AI Planning and Reinforcement Learning (PRL @ ICAPS'22), 2022.

Öztürk*, Ekrem; Ferreira*, Fabio; Jomaa*, Hadi S.; Schmidt-Thieme, Lars; Grabocka, Josif; Hutter, Frank

Zero-shot AutoML with Pretrained Models Inproceedings

In: International Conference on Machine Learning (ICML), 2022.

Wagner, Diane; Ferreira, Fabio; Stoll, Danny; Schirrmeister, Robin Tibor; Müller, Samuel; Hutter, Frank

On the Importance of Hyperparameters and Data Augmentation for Self-Supervised Learning Workshop

ICML Pre-training Workshop, 2022.

Parker-Holder, Jack; Rajan, Raghu; Song, Xingyou; Biedenkapp, André; Miao, Yingjie; Eimer, Theresa; Zhang, Baohe; Nguyen, Vu; Calandra, Roberto; Faust, Aleksandra; Hutter, Frank; Lindauer, Marius

Automated Reinforcement Learning (AutoRL): A Survey and Open Problems Journal Article

In: Journal of Artificial Intelligence Research (JAIR), vol. 74, pp. 517-568, 2022.

Müller, Samuel; Hollmann, Noah; Arango, Sebastian Pineda; Grabocka, Josif; Hutter, Frank

Transformers Can Do Bayesian Inference Inproceedings

In: 10th International Conference on Learning Representations, ICLR 2022, 2022.

Mehta*, Yash; White*, Colin; Zela, Arber; Krishnakumar, Arjun; Zabergja, Guri; Moradian, Shakiba; Safari, Mahmoud; Yu, Kaicheng; Hutter, Frank

NAS-Bench-Suite: NAS Evaluation is (Now) Surprisingly Easy Inproceedings

In: International Conference on Learning Representations (ICLR) 2022, 2022.

Zela, Arber; Siems, Julien; Zimmer, Lucas; Lukasik, Jovita; Keuper, Margret; Hutter, Frank

Surrogate NAS Benchmarks: Going Beyond the Limited Search Spaces of Tabular NAS Benchmarks Inproceedings

In: International Conference on Learning Representations (ICLR), 2022.

Purucker, Lennart; Beel, Joeran

Assembled-OpenML: Creating Efficient Benchmarks for Ensembles in AutoML with OpenML Conference

First Conference on Automated Machine Learning (Late-Breaking Workshop), 2022.

Hvarfner, Carl; Stoll, Danny; Souza, Artur; Lindauer, Marius; Hutter, Frank; Nardi, Luigi

πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimization Inproceedings

In: 10th International Conference on Learning Representations, ICLR 2022, OpenReview.net, 2022.

Benjamins, Carolin; Eimer, Theresa; Schubert, Frederik; Mohan, Aditya; Biedenkapp, André; Rosenhan, Bodo; Hutter, Frank; Lindauer, Marius

Contextualize Me – The Case for Context in Reinforcement Learning Journal Article

In: arXiv:2202.04500, 2022.

Ferreira, Fabio; Nierhoff, Thomas; Sälinger, Andreas; Hutter, Frank

Learning Synthetic Environments and Reward Networks for Reinforcement Learning Inproceedings

In: 10th International Conference on Learning Representations (ICLR), OpenReview.net, 2022.

Lindauer, Marius; Eggensperger, Katharina; Feurer, Matthias; Biedenkapp, André; Deng, Difan; Benjamins, Carolin; Ruhkopf, Tim; Sass, René; Hutter, Frank

SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization Journal Article

In: Journal of Machine Learning Research (JMLR) -- MLOSS, vol. 23, no. 54, pp. 1-9, 2022.

Feurer, Matthias; Letham, Benjamin; Hutter, Frank; Bakshy, Eytan

Practical Transfer Learning for Bayesian Optimization Journal Article

In: arXiv:1802:02219v3 [stat.ML], 2022.

Müller, Samuel; Arango, Sebastian Pineda; Feurer, Matthias; Grabocka, Josif; Hutter, Frank

Bayesian Optimization with a Neural Network Meta-learned on Synthetic Data Only Workshop

Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Hollmann, Noah; Müller, Samuel; Eggensperger, Katharina; Hutter, Frank

TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second Inproceedings

In: NeurIPS 2022 First Table Representation Workshop, 2022.

Schrodi, Simon; Stoll, Danny; Ru, Binxin; Sukthanker, Rhea Sanjay; Brox, Thomas; Hutter, Frank

Towards Discovering Neural Architectures from Scratch Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Adriaensen, Steven; Rakotoarison, Herilalaina; Müller, Samuel; Hutter, Frank

Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networks Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Watanabe, Shuhei; Awad, Noor; Onishi, Masaki; Hutter, Frank

Multi-objective Tree-structured Parzen Estimator Meets Meta-learning Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Sukthanker, Rhea Sanjay; Krishnakumar, Arjun; Patil, Sharat; Hutter, Frank

GraViT-E: Gradient-based Vision Transformer Search with Entangled Weights Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Mallik, Neeratyoy; Hvarfner, Carl; Stoll, Danny; Janowski, Maciej; Bergman, Eddie; Lindauer, Marius; Nardi, Luigi; Hutter, Frank

PriorBand: HyperBand + Human Expert Knowledge Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Dooley, Samuel; Sukthanker, Rhea Sanjay; Dickerson, John P; White, Colin; Hutter, Frank; Goldblum, Micah

On the Importance of Architectures and Hyperparameters for Fairness in Face Recognition Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Dooley, Samuel; Sukthanker, Rhea Sanjay; Dickerson, John P; White, Colin; Hutter, Frank; Goldblum, Micah

On the Importance of Architectures and Hyperparameters for Fairness in Face Recognition Inproceedings

In: Workshop on Trustworthy and Socially Responsible Machine Learning, NeurIPS 2022, 2022.

Shala, Gresa; Elsken, Thomas; Hutter, Frank; Grabocka, Josif

Transfer NAS with Meta-learned Bayesian Surrogates Inproceedings

In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022.

Watanabe, Shuhei; Hutter, Frank

c-TPE: Generalizing Tree-structured Parzen Estimator with Inequality Constraints for Continuous and Categorical Hyperparameter Optimization Inproceedings

In: NeurIPS Workshop on Gaussian Processes, Spatiotemporal Modeling, and Decision-making Systems, 2022.

Bischl, Bernd; Casalicchio, Giuseppe; Feurer, Matthias; Gijsbers, Pieter; Hutter, Frank; Lang, Michel; Mantovani, Rafael G; van Rijn, Jan N; Vanschoren, Joaquin

OpenML Benchmarking Suites Inproceedings

In: Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, 2021.

Benjamins, Carolin; Eimer, Theresa; Schubert, Frederik; Biedenkapp, André; Rosenhan, Bodo; Hutter, Frank; Lindauer, Marius

CARL: A Benchmark for Contextual and Adaptive Reinforcement Learning Inproceedings

In: Workshop on Ecological Theory of Reinforcement Learning (EcoRL@NeurIPS'21), 2021.

Eggensperger, Katharina; Müller, Philipp; Mallik, Neeratyoy; Feurer, Matthias; Sass, René; Klein, Aaron; Awad, Noor; Lindauer, Marius; Hutter, Frank

HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO Inproceedings

In: Vanschoren, J.; Yeung, S. (Ed.): Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, 2021.

Awad, Noor; Mallik, Neeratyoy; Hutter, Frank

DEHB: Evolutionary Hyberband for Scalable, Robust and Efficient Hyperparameter Optimization Inproceedings

In: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (IJCAI'21), ijcai.org, 2021.

Eimer, Theresa; Biedenkapp, André; Reimer, Maximilian; Adriaensen, Steven; Hutter, Frank; Lindauer, Marius

DACBench: A Benchmark Library for Dynamic Algorithm Configuration Inproceedings

In: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (IJCAI'21), ijcai.org, 2021.

Speck, David; Biedenkapp, André; Hutter, Frank; Mattmüller, Robert; Lindauer, Marius

Learning Heuristic Selection with Dynamic Algorithm Configuration Inproceedings

In: Proceedings of the 31st International Conference on Automated Planning and Scheduling (ICAPS'21), 2021.

Narayanan, Ashwin Raaghav; Zela, Arber; Saikia, Tonmoy; Brox, Thomas; Hutter, Frank

Multi-headed Neural Ensemble Search Inproceedings

In: Workshop on Uncertainty and Robustness in Deep Learning (UDL@ICML`21), 2021.

Biedenkapp, André; Rajan, Raghu; Hutter, Frank; Lindauer, Marius

TempoRL: Learning When to Act Inproceedings

In: Proceedings of the 38th International Conference on Machine Learning (ICML 2021), 2021.

Eimer, Theresa; Biedenkapp, André; Hutter, Frank; Lindauer, Marius

Self-Paced Context Evaluations for Contextual Reinforcement Learning Inproceedings

In: Proceedings of the 38th International Conference on Machine Learning (ICML 2021), 2021.

Izquierdo, Sergio; Guerrero-Viu, Julia; Hauns, Sven; Miotto, Guilherme; Schrodi, Simon; Biedenkapp, André; Elsken, Thomas; Deng, Difan; Lindauer, Marius; Hutter, Frank

Bag of Baselines for Multi-objective Joint Neural Architecture Search and Hyperparameter Optimization Inproceedings

In: Workshop on Automated Machine Learning (AutoML@ICML'21), 2021.

Rajan, Raghu; Diaz, Jessica Lizeth Borja; Guttikonda, Suresh; Ferreira, Fabio; Biedenkapp, André; von Hartz, Jan Ole; Hutter, Frank

MDP Playground: A Design and Debug Testbed for Reinforcement Learning Inproceedings

In: arXiv:1909.07750, 2021.

Colin White Shen Yan, Yash Savani; Hutter, Frank

NAS-Bench-x11 and the Power of Learning Curves Inproceedings

In: Proceedings of the CVPR 2021 Workshop on Neural Architecture Search (CVPR-NAS '21), 2021.

Elsken, Thomas; Staffler, Benedikt; Zela, Arber; Metzen, Jan Hendrik; Hutter, Frank

Bag of Tricks for Neural Architecture Search Journal Article

In: Proceedings of the CVPR 2021 Workshop on Neural Architecture Search (CVPR-NAS '21), 2021.

Chatzimichailidis, Avraam; Zela, Arber; Shalini, Shalini; Labus, Peter; Keuper, Janis; Hutter, Frank; Yang, Yang

Group Sparsity: A Unified Framework for Network Pruning and Neural Architecture Search Journal Article

In: Proceedings of the CVPR 2021 Workshop on Neural Architecture Search (CVPR-NAS '21), 2021.

pdf
bibtex

Kadra, Arlind; Lindauer, Marius; Hutter, Frank; Grabocka, Josif

Well-tuned Simple Nets Excel on Tabular Datasets Inproceedings

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

White, Colin; Zela, Arber; Ru, Binxin; Liu, Yang; Hutter, Frank

How Powerful are Performance Predictors in Neural Architecture Search? Inproceedings

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

Zaidi, Sheheryar; Zela, Arber; Elsken, Thomas; Holmes, Christopher C.; Hutter, Frank; Teh, Yee Whye

Neural Ensemble Search for Uncertainty Estimation and Dataset Shift Inproceedings

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

Yan, Shen; White, Colin; Savani, Yash; Hutter, Frank

NAS-Bench-x11 and the Power of Learning Curves Inproceedings

In: Thirty-Fifth Conference on Neural Information Processing Systems, 2021.

Franke, Jörg K H; Köhler, Gregor; Biedenkapp, André; Hutter, Frank

Sample-Efficient Automated Deep Reinforcement Learning Journal Article

In: International Conference on Learning Representations (ICLR) 2021, 2021.

Siems, Julien; Klein, Aaron; Archambeau, Cedric; Mahsereci, Maren

Dynamic Pruning of a Neural Network via Gradient Signal-to-Noise Ratio Conference

AutoML Workshop at ICML 2021, 2021.

Zhang, Baohe; Rajan, Raghu; Pineda, Luis; Lambert, Nathan; Biedenkapp, André; Chua, Kurtland; Hutter, Frank; Calandra, Roberto

On the Importance of Hyperparameter Optimization for Model-based Reinforcement Learning Inproceedings

In: Proceedings of the 24th International Conference on Artificial Intelligence and Statistics (AISTATS)'21, 2021.

Müller, Samuel; Hutter, Frank

TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentation Inproceedings

In: ICCV, 2021, (Oral Presentation (Top 3%)).

Ferreira, Fabio; Nierhoff, Thomas; Hutter, Frank

Learning Synthetic Environments for Reinforcement Learning with Evolution Strategies Journal Article

In: AAAI workshop on Meta-Learning Challenges, 2021.

Müller, Samuel; Biedenkapp, André; Hutter, Frank

In-Loop Meta-Learning with Gradient-Alignment Reward Inproceedings

In: AAAI workshop on Meta-Learning Challenges, 2021.

Feurer, Matthias; van Rijn, Jan N; Kadra, Arlind; Gijsbers, Pieter; Mallik, Neeratyoy; Ravi, Sahithya; Müller, Andreas; Vanschoren, Joaquin; Hutter, Frank

OpenML-Python: an extensible Python API for OpenML Journal Article

In: Journal of Machine Learning Research, vol. 22, no. 100, pp. 1-5, 2021.

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-Pytorch: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Journal Article

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-1, 2021.

Souza, Artur; Nardi, Luigi; Oliveira, Leonardo; Olukotun, Kunle; Lindauer, Marius; Hutter, Frank

Bayesian Optimization with a Prior for the Optimum Inproceedings

In: Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD), 2021.

Awad, Noor; Shala, Gresa; Deng, Difan; Mallik, Neeratyoy; Feurer, Matthias; Eggensperger, Katharina; Biedenkapp, André; Vermetten, Diederick; Wang, Hao; Doerr, Carola; Lindauer, Marius; Hutter, Frank

Squirrel: A Switching Hyperparameter Optimizer Description of the entry by AutoML.org & IOHprofiler to the NeurIPS 2020 BBO challenge Journal Article

In: arXiv:2012.08180 [cs.LG], 2020, (Optimizer description for the NeurIPS 2020 BBO competition. Squirrel won the competition´s warm-starting friendly leaderboard.).

Lindauer, Marius; Hutter, Frank

Best Practices for Scientific Research on Neural Architecture Search Journal Article

In: Journal of Machine Learning Research, vol. 21, no. 243, pp. 1-18, 2020.

Liu, Zhengying; Pavao, Adrien; Xu, Zhen; Escalera, Sergio; Ferreira, Fabio; Guyon, Isabelle; Hong, Sirui; Hutter, Frank; Ji, Rongrong; Junior, Julio C S Jacques; Li, Ge; Lindauer, Marius; Luo, Zhipeng; Madadi, Meysam; Nierhoff, Thomas; Niu, Kangning; Pan, Chunguang; Stoll, Danny; Treguer, Sebastien; Wang, Jin; Wang, Peng; Wu, Chenglin; Xiong, Youcheng; Zela, Arber; Zhang, Yang

Winning Solutions and Post-Challenge Analyses of the ChaLearn AutoDL Challenge 2019 Journal Article

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 9, pp. 3108-3125, 2020.

Lukasik, Jovita; Friede, David; Zela, Arber; Stuckenschmidt, Heiner; Hutter, Frank; Keuper, Margret

Smooth Variational Graph Embeddings for Efficient Neural Architecture Search Journal Article

In: arXiv:2010.04683 [cs.LG], 2020.

Siems, Julien; Zimmer, Lucas; Zela, Arber; Lukasik, Jovita; Keuper, Margret; Hutter, Frank

NAS-Bench-301 and the Case for Surrogate Benchmarks for Neural Architecture Search Journal Article

In: NeurIPS 4th Workshop on Meta-Learning, 2020.

Souza, Artur; Nardi, Luigi; Oliveira, Leonardo B; Olukotun, Kunle; Lindauer, Marius; Hutter, Frank

Prior-guided Bayesian Optimization Journal Article

In: NeurIPS 4th Workshop on Meta-Learning, 2020.

Speck, David; Biedenkapp, André; Hutter, Frank; Mattmüller, Robert; Lindauer, Marius

Learning Heuristic Selection with Dynamic Algorithm Configuration Inproceedings

In: Workshop on Bridging the Gap Between AI Planning and Reinforcement Learning (PRL@ICAPS'20), 2020.

Stoll, Danny; Franke, Jörg K H; Wagner, Diane; Selg, Simon; Hutter, Frank

Hyperparameter Transfer Across Developer Adjustments Journal Article

In: NeurIPS 4th Workshop on Meta-Learning, 2020.

Eggensperger, Katharina; Haase, Kai; Müller, Philipp; Lindauer, Marius; Hutter, Frank

Neural Model-based Optimization with Right-Censored Observations Journal Article

In: arXiv:2009:13828 [cs.AI], 2020.

Shala, Gresa; Biedenkapp, André; Awad, Noor; Adriaensen, Steven; Lindauer, Marius; Hutter, Frank

Learning Step-Size Adaptation in CMA-ES Inproceedings

In: Proceedings of the Sixteenth International Conference on Parallel Problem Solving from Nature (PPSN'20), 2020.

Biedenkapp, André; Rajan, Raghu; Hutter, Frank; Lindauer, Marius

Towards TempoRL: Learning When to Act Inproceedings

In: Workshop on Inductive Biases, Invariances and Generalization in RL (BIG@ICML'20), 2020.

Eimer, Theresa; Biedenkapp, André; Hutter, Frank; Lindauer, Marius

Towards Self-Paced Context Evaluations for Contextual Reinforcement Learning Inproceedings

In: Workshop on Inductive Biases, Invariances and Generalization in RL (BIG@ICML'20), 2020.

Biedenkapp, André; Bozkurt, Furkan H; Eimer, Theresa; Hutter, Frank; Lindauer, Marius

Dynamic Algorithm Configuration: Foundation of a New Meta-Algorithmic Framework Inproceedings

In: Proceedings of the Twenty-fourth European Conference on Artificial Intelligence (ECAI'20), 2020.

Elsken, Thomas; Staffler, Benedikt; Metzen, Jan Hendrik; Hutter, Frank

Meta-Learning of Neural Architectures for Few-Shot Learning Inproceedings

In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, (Oral Presentation (Top 6%)).

Gargiani, Matilde; Zanelli, Andrea; Diehl, Moritz; Hutter, Frank

On the Promise of the Stochastic Generalized Gauss-Newton Method for Training DNNs Journal Article

In: arXiv:2006.02409 [cs.LG], 2020.

Zaidi, Sheheryar; Zela, Arber; Elsken, Thomas; Holmes, Chris; Hutter, Frank; Teh, Yee Whye

Neural Ensemble Search for Performant and Calibrated Predictions Journal Article

In: Workshop on Uncertainty and Robustness in Deep Learning (UDL@ICML`20), 2020, (Oral Presentation).

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Journal Article

In: arXiv:2006.13799 [cs.LG], 2020.

Lehman, J; Clune, J; Misevic, D; Adami, C; Beaulieu, J; Bentley, P J; Bernard, S; Beslon, G; Bryson, D M; Chrabaszcz, P; Cheney, N; Cully, A; Doncieux, S; Dyer, F C; Ellefsen, K O; Feldt, R; Fischer, S; Forrest, S; Frénoy, A; Gagné, C; Goff, Le L K; Grabowski, L M; Hodjat, B; Hutter, F; Keller, L; Knibbe, C; Krcah, P; Lenski, R E; Lipson, H; MacCurdy, R; Maestre, C; Miikkulainen, R; Mitri, S; Moriarty, D E; Mouret, J -B; Nguyen, A; Ofria, C; Parizeau, M; Parsons, D P; Pennock, R T; Punch, W F; Ray, T S; Schoenauer, M; Shulte, E; Sims, K; Stanley, K O; Taddei, F; Tarapore, D; Thibault, S; Weimer, W; Watson, R; Yosinksi, J

The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities Journal Article

In: Artificial Life, vol. 26, no. 2, pp. 274-306, 2020.

Awad, Noor; Mallik, Neeratyoy; Hutter, F

Differential Evolution for Neural Architecture Search Inproceedings

In: Proceedings of the 1st workshop on neural architecture search(@ICLR'20), 2020.

Gargiani, Matilde; Zanelli, Andrea; Tran-Dinh, Quoc; Diehl, Moritz; Hutter, Frank

Transferring Optimally Across Data Distrutions via Homotopy Methods Inproceedings

In: International Conference on Learning Representations, 2020.

Schirrmeister, Robin; Zhou, Yuxuan; Ball, Tonio; Zhang, Dan

Understanding Anomaly Detection with Deep Invertible Networks through Hierarchies of Distributions and Features Inproceedings

In: Larochelle, H; Ranzato, M; Hadsell, R; Balcan, M F; Lin, H (Ed.): Advances in Neural Information Processing Systems, pp. 21038–21049, Curran Associates, Inc., 2020.

Schorn, Christoph; Elsken, Thomas; Vogel, Sebastian; Runge, Armin; Guntoro, Andre; Ascheid, Gerd

Automated design of error-resilient and hardware-efficient deep neural networks Journal Article

In: Neural Computing and Applications, pp. 1 - 19, 2020.

Tomašev, Nenad; Cornebise, Julien; Hutter, Frank; Mohamed, Shakir; Khan, Mohammad Emtiyaz; Winne, Ruben De; Schaul, Tom; Clopath, Claudia

AI for social good: unlocking the opportunity for positive impact Journal Article

In: Nature Communications, vol. 11, no. 1, 2020.

Volpp, Michael; Fröhlich, Lukas P; Fischer, Kirsten; Doerr, Andreas; Falkner, Stefan; Hutter, Frank; Daniel, Christian

Meta-Learning Acquisition Functions for Transfer Learning in Bayesian Optimization Inproceedings

In: International Conference on Learning Representations, 2020.

Zela, Arber; Siems, Julien; Hutter, Frank

NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Inproceedings

In: International Conference on Learning Representations, 2020.

Zela, Arber; Elsken, Thomas; Saikia, Tonmoy; Marrakchi, Yassine; Brox, Thomas; Hutter, Frank

Understanding and Robustifying Differentiable Architecture Search Inproceedings

In: International Conference on Learning Representations, 2020, (Oral Presentation (Top 7%)).

Rajan, Raghu; Hutter, Frank

MDP Playground: Meta-Features in Reinforcement Learning Inproceedings

In: NeurIPS 2019 Deep RL Workshop, 2019.

Zimmermann, Roland; Siems, Julien

Faster training of Mask R-CNN by focusing on instance boundaries Journal Article

In: Computer Vision and Image Understanding, 2019.

Bischl, Bernd; Casalicchio, Giuseppe; Feurer, Matthias; Hutter, Frank; Lang, Michel; Mantovani, Rafael G; van Rijn, Jan N; Vanschoren, Joaquin

OpenML Benchmarking Suites Journal Article

In: arXiv, vol. 1708.0373v2, pp. 1-6, 2019.

Biedenkapp, André; Bozkurt, Furkan H; Hutter, Frank; Lindauer, Marius

Towards White-box Benchmarks for Algorithm Control Inproceedings

In: IJCAI 2019 DSO Workshop, 2019.

Fuks, L; Awad, Noor; Hutter, F; Lindauer, M

An Evolution Strategy with Progressive Episode Lengths for Playing Games Inproceedings

In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’19), 2019.

pdf
bibtex

Lindauer, Marius; Eggensperger, Katharina; Feurer, Matthias; Biedenkapp, André; Marben, Joshua; Müller, Philipp; Hutter, Frank

BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters Journal Article

In: arXiv:1908.06756 [cs.LG], 2019.

Lindauer, Marius; Feurer, Matthias; Eggensperger, Katharina; Biedenkapp, André; Hutter, Frank

Towards Assessing the Impact of Bayesian Optimization's Own Hyperparameters Inproceedings

In: IJCAI 2019 DSO Workshop, 2019.

Gargiani, M; Klein, A; Falkner, S; Hutter, F

Probabilistic Rollouts for Learning Curve Extrapolation Across Hyperparameter Settings Inproceedings

In: 6th ICML Workshop on Automated Machine Learning, 2019.

Feurer, Matthias; Hutter, Frank

Hyperparameter Optimization Incollection

In: Hutter, Frank; Kotthoff, Lars; Vanschoren, Joaquin (Ed.): AutoML: Methods, Sytems, Challenges, pp. 3–33, Springer, 2019.

Feurer, Matthias; Klein, Aaron; Eggensperger, Katharina; Springenberg, Jost; Blum, Manuel; Hutter, Frank

Auto-sklearn: Efficient and Robust Automated Machine Learning Incollection

In: Hutter, Frank; Kotthoff, Lars; Vanschoren, Joaquin (Ed.): AutoML: Methods, Systems, Challenges, pp. 113–134, Springer, 2019.

Mendoza, Hector; Klein, Aaron; Feurer, Matthias; Springenberg, Jost Tobias; Urban, Matthias; Burkart, Michael; Dippel, Max; Lindauer, Marius; Hutter, Frank

Towards Automatically-Tuned Deep Neural Networks Incollection

In: Hutter, Frank; Kotthoff, Lars; Vanschoren, Joaquin (Ed.): AutoML: Methods, Sytems, Challenges, pp. 135–149, Springer, 2019.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Neural Architecture Search: A Survey Journal Article

In: Journal of Machine Learning Research, vol. 20, no. 55, pp. 1-21, 2019.

Eggensperger, Katharina; Lindauer, Marius; Hutter, Frank

Pitfalls and Best Practices in Algorithm Configuration Journal Article

In: Journal of Artificial Intelligence Research (JAIR), vol. 64, pp. 861–893, 2019.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Efficient Multi-Objective Neural Architecture Search via Lamarckian Evolution Inproceedings

In: International Conference on Learning Representations, 2019.

Franke, Jörg KH; Köhler, Gregor; Awad, Noor; Hutter, Frank

Neural Architecture Evolution in Deep Reinforcement Learning for Continuous Control Journal Article

In: NeurIPS 2019 Workshop on Meta-Learning, 2019.

Hutter, Frank; Kotthoff, Lars; Vanschoren, Joaquin (Ed.)

Automated Machine Learning - Methods, Systems, Challenges Book

Springer, 2019.

Loshchilov, Ilya; Hutter, Frank

Decoupled Weight Decay Regularization Inproceedings

In: International Conference on Learning Representations, 2019.

Klein, Aaron; Dai, Zhenwen; Hutter, Frank; Lawrence, Neil; Gonzalez, Javier

Meta-Surrogate Benchmarking for Hyperparameter Optimization Incollection

In: Wallach, H; Larochelle, H; Beygelzimer, A; d' Alché-Buc, F; Fox, E; Garnett, R (Ed.): Advances in Neural Information Processing Systems 32, pp. 6270–6280, Curran Associates, Inc., 2019.

Runge, Frederic; Stoll, Danny; Falkner, Stefan; Hutter, Frank

Learning to Design RNA Inproceedings

In: International Conference on Learning Representations, 2019.

Saikia, T; Marrakchi, Y; Zela, A; Hutter, F; Brox, T

AutoDispNet: Improving Disparity Estimation With AutoML Inproceedings

In: IEEE International Conference on Computer Vision (ICCV), 2019.

Ying, Chris; Klein, Aaron; Real, Esteban; Christiansen, Eric; Murphy, Kevin; Hutter, Frank

Nas-bench-101: Towards reproducible neural architecture search Inproceedings

In: Thirty-sixth International Conference on Machine Learning, 2019.

Lindauer, M; van Rijn, J N; Kotthoff, L

The Algorithm Selection Competitions 2015 and 2017 Journal Article

In: Artificial Intelligence, pp. 1-35, 2018.

Chrabąszcz, Patryk; Loshchilov, Ilya; Hutter, Frank

Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari Inproceedings

In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI-18, pp. 1419–1426, International Joint Conferences on Artificial Intelligence Organization, 2018.

Eggensperger, Katharina; Lindauer, Marius; Hutter, Frank

Neural Networks for Predicting Algorithm Runtime Distributions Inproceedings

In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’18), pp. 1442-1448, 2018.

Falkner, Stefan; Klein, Aaron; Hutter, Frank

BOHB: Robust and Efficient Hyperparameter Optimization at Scale Inproceedings

In: Proceedings of the 35th International Conference on Machine Learning (ICML 2018), pp. 1436–1445, 2018.

Feurer, M; Hutter, F

Towards Further Automation in AutoML Inproceedings

In: ICML 2018 AutoML Workshop, 2018.

pdf
bibtex

Feurer, Matthias; Eggensperger, Katharina; Falkner, Stefan; Lindauer, Marius; Hutter, Frank

Practical Automated Machine Learning for the AutoML Challenge 2018 Inproceedings

In: ICML 2018 AutoML Workshop, 2018.

pdf
bibtex

Feurer, Matthias; Letham, Benjamin; Bakshy, Eytan

Scalable Meta-Learning for Bayesian Optimization using Ranking-Weighted Gaussian Process Ensembles Inproceedings

In: ICML 2018 AutoML Workshop, 2018, (This publication is superseded by the 2022 arXiv preprint Practical Transfer Learning for Bayesian Optimization.).

pdf
bibtex

Schirrmeister, R; Chrabąszcz, P; Hutter, F; Ball, T

Training Generative Reversible Networks Inproceedings

In: ICML 2018 workshop on Theoretical Foundations and Applications of Deep Generative Models, 2018.

Zela, Arber; Klein, Aaron; Falkner, Stefan; Hutter, Frank

Towards Automated Deep Learning: Efficient Joint Neural Architecture and Hyperparameter Search Inproceedings

In: ICML 2018 AutoML Workshop, 2018.

Biedenkapp, André; Marben, Joshua; Lindauer, Marius; Hutter, Frank

CAVE: Configuration Assessment, Visualization and Evaluation Inproceedings

In: Proceedings of the International Conference on Learning and Intelligent Optimization (LION'18), 2018.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Efficient Multi-objective Neural Architecture Search via Lamarckian Evolution Journal Article

In: ArXiv e-prints, vol. 1804.09081, 2018.

Ilg, Eddy; Cicek, Oezguen; Galesso, Silvio; Klein, Aaron; Makansi, Osama; Hutter, Frank; Brox, Thomas

Uncertainty Estimates for Optical Flow with Multi-Hypotheses Networks Journal Article

In: Proceedings of ECCV 2018, 2018.

Lindauer, M; Hutter, F

Warmstarting of Model-based Algorithm Configuration Inproceedings

In: Proceedings of the AAAI conference, pp. 1355–1362, 2018.

Abdulrahman, S M; Brazdil, P; van Rijn, J N; Vanschoren, J

Speeding up algorithm selection using average ranking and active testing by introducing runtime Inproceedings

In: Machine Learning, pp. 79–108, 2018.

Bandi, Peter; Geessink, Oscar; Manson, Quirine; Dijk, Marcory Van; Balkenhol, Maschenka; Hermsen, Meyke; Bejnordi, Babak Ehteshami; Lee, Byungjae; Paeng, Kyunghyun; Zhong, Aoxiao; Franke, Jörg; Both, Fabian; others,

From detection of individual metastases to classification of lymph node status at the patient level: the CAMELYON17 challenge Journal Article

In: IEEE transactions on medical imaging, vol. 38, no. 2, pp. 550–560, 2018.

Eggensperger, Katharina; Lindauer, Marius; Hoos, Holger H; Hutter, Frank; Leyton-Brown, Kevin

Efficient Benchmarking of Algorithm Configurators via Model-Based Surrogates Journal Article

In: Machine Learning, vol. 107, pp. 15-41, 2018.

Franke, Jörg; Niehues, Jan; Waibel, Alex

Robust and Scalable Differentiable Neural Computer for Question Answering Inproceedings

In: Proceedings of the Workshop on Machine Reading for Question Answering, pp. 47–59, 2018.

van Rijn, J N; Hutter, F

Hyperparameter Importance Across Datasets Journal Article

In: SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2018), 2018.

van Rijn, J N; Holmes, G; Pfahringer, B; Vanschoren, J

The online performance estimation framework: heterogeneous ensemble learning for data streams Inproceedings

In: Machine Learning, pp. 149–176, 2018.

Wilson, James; Hutter, Frank; Deisenroth, Marc

Maximizing acquisition functions for Bayesian optimization Inproceedings

In: Bengio, S; Wallach, H; Larochelle, H; Grauman, K; Cesa-Bianchi, N; Garnett, R (Ed.): Advances in Neural Information Processing Systems 31, pp. 9906–9917, Curran Associates, Inc., 2018.

Wilson, Dennis; Rodrigues, Silvio; Segura, Carlos; Loshchilov, Ilya; Hutter, Frank; Buenfil, Guillermo López; Kheiri, Ahmed; Keedwell, Ed; Ocampo-Pineda, Mario; Özcan, Ender; Peña, Sergio Ivvan Valdez; Goldman, Brian; Rionda, Salvador Botello; Hernández-Aguirre, Arturo; Veeramachaneni, Kalyan; Cussat-Blanc, Sylvain

Evolutionary computation for wind farm layout optimization Journal Article

In: Renewable Energy, vol. 126, pp. 681 - 691, 2018, ISSN: 0960-1481.

Martinez-Cantin, Ruben; Tee, Kevin; McCourt, Mike; Eggensperger, Katharina

Filtering Outliers in Bayesian Optimization Inproceedings

In: NeuriPS workshop on Bayesian Optimization (BayesOpt'17), 2017.

Falkner, S; Klein, A; Hutter, F

Combining Hyperband and Bayesian Optimization Inproceedings

In: NIPS 2017 Bayesian Optimization Workshop, 2017.

pdf
bibtex

Klein, A; Falkner, S; Mansur, N; Hutter, F

RoBO: A Flexible and Robust Bayesian Optimization Framework in Python Inproceedings

In: NIPS 2017 Bayesian Optimization Workshop, 2017.

pdf
bibtex

Lindauer, Marius; van Rijn, Jan N; Kotthoff, Lars

Open Algorithm Selection Challenge 2017: Setup and Scenarios Inproceedings

In: Lindauer, Marius; van Rijn, Jan N; Kotthoff, Lars (Ed.): Proceedings of the Open Algorithm Selection Challenge, pp. 1–7, PMLR, Brussels, Belgium, 2017.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Simple And Efficient Architecture Search for Convolutional Neural Networks Inproceedings

In: NIPS Workshop on Meta-Learning, 2017.

Bischl, Bernd; Casalicchio, Giuseppe; Feurer, Matthias; Hutter, Frank; Lang, Michel; Mantovani, Rafael G; van Rijn, Jan N; Vanschoren, Joaquin

OpenML Benchmarking Suites and the OpenML100 Journal Article

In: arXiv, vol. 1708.0373v1, pp. 1-6, 2017.

Greff, K; Klein, A; Chovanec, M; Hutter, F; Schmidhuber, J

The Sacred Infrastructure for Computational Research Inproceedings

In: Proceedings of the 15th Python in Science Conference (SciPy 2017), 2017.

pdf
bibtex

Lindauer, M; Hoos, H; Hutter, F; Schaub, T

AutoFolio: An Automatically Configured Algorithm Selector (Extended Abstract) Inproceedings

In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI'17), 2017.

pdf
bibtex

Klein, A; Falkner, S; Springenberg, J T; Hutter, F

Learning Curve Prediction with Bayesian Neural Networks Inproceedings

In: International Conference on Learning Representations (ICLR) 2017 Conference Track, 2017.

pdf
bibtex

Loshchilov, I; Hutter, F

SGDR: Stochastic Gradient Descent with Warm Restarts Inproceedings

In: International Conference on Learning Representations (ICLR) 2017 Conference Track, 2017.

pdf
bibtex

Lindauer, M; Hoos, H; Leyton-Brown, K; Schaub, T

Automatic Construction of Parallel Portfolios via Algorithm Configuration Journal Article

In: Artificial Intelligence Journal (AIJ), vol. 244, pp. 272-290, 2017.

Wagner, M; Friedrich, T; Lindauer, M

Improving local search in a minimum vertex cover solver for classes of networks Inproceedings

In: Proceedings of the IEEE Congress on Evolutionary Computation (CEC), 2017.

pdf
bibtex

Wagner, M; Lindauer, M; Misir, M; Nallaperuma, S; Hutter, F

A case study of algorithm selection for the traveling thief problem Journal Article

In: Journal of Heuristics, pp. 1-26, 2017.

Biedenkapp, André; Lindauer, Marius; Eggensperger, Katharina; Fawcett, Chris; Hoos, Holger H; Hutter, Frank

Efficient Parameter Importance Analysis via Ablation with Surrogates Inproceedings

In: Proceedings of the Thirty-First Conference on Artificial Intelligence (AAAI'17), pp. 773–779, 2017.

Hutter, F; Lindauer, M; Balint, A; Bayless, S; Hoos, H; Leyton-Brown, K

The Configurable SAT Solver Challenge (CSSC) Journal Article

In: Artificial Intelligence Journal (AIJ), vol. 243, pp. 1-25, 2017.

Lindauer, M; Hutter, F

Pitfalls and Best Practices for Algorithm Configuration (Breakout Session Report) Journal Article

In: Dagstuhl Reports, vol. 6, pp. 70-72, 2017.

Lindauer, M; Kotthoff, L

What can we learn from algorithm selection data? (Breakout Session Report) Journal Article

In: Dagstuhl Reports, vol. 6, pp. 64-65, 2017.

Wilson, James T.; Moriconi, Riccardo; Hutter, Frank; Deisenroth, Marc P.

The Reparameterization Trick for Acquisition Functions Inproceedings

In: NIPS Workshop on Bayesian Optimization, 2017.

pdf
bibtex

Chrabaszcz, Patryk; Loshchilov, Ilya; Hutter, Frank

A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets Miscellaneous

2017.

Klein, A; Falkner, S; Bartels, S; Hennig, P; Hutter, F

Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasets Inproceedings

In: Proceedings of the AISTATS conference, 2017.

Klein, A; Falkner, S; Bartels, S; Hennig, P; Hutter, F

Fast Bayesian hyperparameter optimization on large datasets Inproceedings

In: Electronic Journal of Statistics, 2017.

pdf
bibtex

Lindauer, M; Hoos, H; Hutter, F; Leyton-Brown, K

Selection and Configuration of Parallel Portfolios Incollection

In: Hamadi, Y; Sais, L (Ed.): Handbook of Parallel Constraint Reasoning, Springer, 2017.

pdf
bibtex

Müller, Markus; Franke, Jörg; Stüker, Sebastian; Waibe, Alex

Improving phoneme set discovery for documenting unwritten languages Journal Article

In: Studientexte zur Sprachkommunikation: Elektronische Sprachsignalverarbeitung 2017, pp. 202–209, 2017.

Müller, Markus; Franke, Jörg; Waibel, Alex; Stüker, Sebastian

Towards phoneme inventory discovery for documentation of unwritten languages Inproceedings

In: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5200–5204, IEEE 2017.

van Rijn, J N; Hutter, F

An Empirical Study of Hyperparameter Importance Across Datasets Inproceedings

In: Proceedings of the International Workshop on Automatic Selection, Configuration and Composition of Machine Learning Algorithms (AutoML 2017), pp. 97–104, 2017.

pdf
bibtex

Schirrmeister, Robin; Springenberg, Jost Tobias; Fiederer, Lukas; Glasstetter, Martin; Eggensperger, Katharina; Tangermann, Michael; Hutter, Frank; Burgard, Wolfram; Ball, Tonio

Deep learning with convolutional neural networks for EEG decoding and visualization Journal Article

In: Human Brain Mapping, vol. 38, pp. 5391–5420, 2017.

Springenberg, J T; Klein, A; Falkner, S; Hutter, F

Bayesian optimization with robust Bayesian neural networks Inproceedings

In: Advances in Neural Information Processing Systems 29, 2016.

Bischl, B; Kerschke, P; Kotthoff, L; Lindauer, M; Malitsky, Y; Frechétte, A; Hoos, H; Hutter, F; Leyton-Brown, K; Tierney, K; Vanschoren, J

ASlib: A Benchmark Library for Algorithm Selection Journal Article

In: Artificial Intelligence Journal (AIJ), vol. 237, pp. 41-58, 2016.

Mendoza, H; Klein, A; Feurer, M; Springenberg, J; Hutter, F

Towards Automatically-Tuned Neural Networks Inproceedings

In: ICML 2016 AutoML Workshop, 2016.

Loshchilov, I; Hutter, F

Online Batch Selection for Faster Training of Neural Networks Inproceedings

In: International Conference on Learning Representations (ICLR) 2016 Workshop Track, 2016.

Loshchilov, I; Hutter, F

CMA-ES for Hyperparameter Optimization of Deep Neural Networks Inproceedings

In: International Conference on Learning Representations (ICLR) 2016 Workshop Track, 2016.

code
bibtex

Manthey, N; Lindauer, M

SpyBug: Automated Bug Detection in the Configuration Space of SAT Solvers Inproceedings

In: Proceedings of the International Conference on Satisfiability Solving (SAT'16), 2016.

pdf
bibtex

Wang, Ziyu; Hutter, Frank; Zoghi, Masrour; Matheson, David; de Freitas, Nando

Bayesian Optimization in a Billion Dimensions via Random Embeddings Journal Article

In: Journal of Artificial Intelligence Research (JAIR), vol. 55, pp. 361-387, 2016.

Lindauer, M.; Bergdoll, D.; Hutter, F.

An Empirical Study of Per-Instance Algorithm Scheduling Inproceedings

In: Proceedings of the International Conference on Learning and Intelligent Optimization (LION'16), 2016.

Franke, Joerg; Mueller, Markus; Hamlaoui, Fatima; Stueker, Sebastian; Waibel, Alex

Phoneme boundary detection using deep bidirectional lstms Inproceedings

In: Speech Communication; 12. ITG Symposium, pp. 1–5, VDE 2016.

Meinel, Andreas; Eggensperger, Katharina; Tangermann, Michael; Hutter, Frank

Hyperparameter Optimization for Machine Learning Problems in BCI (Abstract) Inproceedings

In: Proceedings of the International Brain Computer Interface Meeting 2016, 2016.

pdf
bibtex

Post, Martijn J; van der Putten, Peter; van Rijn, J N

Does Feature Selection Improve Classification? A Large Scale Experiment in OpenML Inproceedings

In: Advances in Intelligent Data Analysis XV, pp. 158–170, Springer 2016.

pdf
bibtex

van Rijn, J N

Massively Collaborative Machine Learning PhD Thesis

Leiden University, 2016.

Schubert, Tobias; Eggensperger, Katharina; Gkogkidis, Alexis; Hutter, Frank; Ball, Tonio; Burgard, Wolfram

Automatic Bone Parameter Estimation for Skeleton Tracking in Optical Motion Capture Inproceedings

In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA'16), 2016, (Video showing the results of the optimization procedure).

Feurer, Matthias; Klein, Aaron; Eggensperger, Katharina; Springenberg, Jost Tobias; Blum, Manuel; Hutter, Frank

Efficient and Robust Automated Machine Learning Inproceedings

In: Advances in Neural Information Processing Systems 28 (NeurIPS'15), pp. 2962–2970, 2015.

Klein, A; Bartels, S; Falkner, S; Hennig, P; Hutter, F

Towards efficient Bayesian Optimization for Big Data Inproceedings

In: NIPS 2015 Bayesian Optimization Workshop, 2015.

pdf
bibtex

Falkner, S; Lindauer, M; Hutter, F

SpySMAC: Automated Configuration and Performance Analysis of SAT Solvers Inproceedings

In: Proceedings of the International Conference on Satisfiability Solving (SAT'15), pp. 1-8, 2015.

pdf
bibtex

Lindauer, M; Hoos, H; Hutter, F; Schaub, T

AutoFolio: An automatically configured Algorithm Selector Journal Article

In: Journal of Artificial Intelligence, vol. 53, pp. 745-778, 2015.

pdf
bibtex

Domhan, T; Springenberg, J T; Hutter, F

Speeding up Automatic Hyperparameter Optimization of Deep Neural Networks by Extrapolation of Learning Curves Inproceedings

In: Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI), 2015.

pdf
bibtex

Feurer, Matthias; Klein, Aaron; Eggensperger, Katharina; Springenberg, Jost Tobias; Blum, Manuel; Hutter, Frank

Methods for Improving Bayesian Optimization for AutoML Inproceedings

In: ICML 2015 AutoML Workshop, 2015.

Hutter, F; Lücke, J; Schmidt-Thieme, L

Beyond Manual Tuning of Hyperparameters Journal Article

In: Künstliche Intelligenz, vol. 0, pp. 1-9, 2015.

Hutter, F; Xu, L; Hoos, H H; Leyton-Brown, K

Algorithm runtime prediction: Methods & evaluation (extended abstract) Inproceedings

In: Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI), 2015.

pdf
bibtex

Vallati, Mauro; Hutter, Frank; Chrpa, Lukáš; McCluskey, T L

On the Effective Configuration of Planning Domain Models Inproceedings

In: Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI), AAAI press, 2015.

pdf
bibtex

Vanschoren, J; van Rijn, J; Bischl, B; Casalicchio, G; Lang, M; Feurer, M

OpenML: a Networked Science Platform for Machine Learning (Abstract) Inproceedings

In: ICML 2015 MLOSS Workshop, 2015.

pdf
bibtex

Eggensperger, K; Hutter, F; Hoos, H H; Leyton-Brown, K

Efficient Benchmarking of Hyperparameter Optimizers via Surrogates Inproceedings

In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015.

Feurer, M; Springenberg, T; Hutter, F

Initializing Bayesian Hyperparameter Optimization via Meta-Learning Inproceedings

In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015.

Hoos, H; Kaminski, R; Lindauer, M; Schaub, T

aspeed: Solver Scheduling via Answer Set Programming Journal Article

In: Theory and Practice of Logic Programming, vol. 15, pp. 117-142, 2015.

pdf
bibtex

Lindauer, M; Hoos, H; Hutter, F; Schaub, T

AutoFolio: Algorithm Configuration for Algorithm Selection Inproceedings

In: Proceedings of the Twenty-Ninth AAAI Workshops on Artificial Intelligence, 2015.

pdf
bibtex

Lindauer, M; Hoos, H; F,; Hutter,

From Sequential Algorithm Selection to Parallel Portfolio Selection Inproceedings

In: Proceedings of the International Conference on Learning and Intelligent Optimization (LION'15), 2015.

pdf
bibtex

van Rijn, J N; Abdulrahman, S M; Brazdil, P; Vanschoren, J

Fast algorithm selection using learning curves Inproceedings

In: Advances in Intelligent Data Analysis XIV, pp. 298–309, Springer 2015.

pdf
bibtex

van Rijn, J N; Holmes, G; Pfahringer, B; Vanschoren, J

Having a Blast: Meta-Learning and Heterogeneous Ensembles for Data Streams Inproceedings

In: Data Mining (ICDM), 2015 IEEE International Conference on, pp. 1003–1008, IEEE 2015.

pdf
bibtex

van Rijn, J N; Vanschoren, J

Sharing RapidMiner Workflows and Experiments with OpenML Inproceedings

In: Vanschoren, Joaquin; Brazdil, Pavel; Giraud-Carrier, Christophe; Kotthoff, Lars (Ed.): Proceedings of the 2015 International Workshop on Meta-Learning and Algorithm Selection (MetaSel), pp. 93–103, Aachen, 2015.

pdf
bibtex

van Rijn, J N; Holmes, G; Pfahringer, B; Vanschoren, J

Case study on bagging stable classifiers for data streams Inproceedings

In: BENELEARN 2015, 2015.

Seipp, J; Sievers, S; Helmert, M; Hutter, F

Automatic Configuration of Sequential Planning Portfolios Inproceedings

In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015.

pdf
bibtex

van Rijn, J N; Takes, F W; Vis, J K

The Complexity of Rummikub Problems Inproceedings

In: BNAIC 2015: Proceedings of the 27th Benelux Conference on Artificial Intelligence, 2015.

Vanschoren, J; Bischl, B; Hutter, F; Sebag, M; Kegl, B; Schmid, M; Napolitano, G; Wolstencroft, K; Williams, A R; Lawrence, N

Towards a Data Science Collaboratory Inproceedings

In: Advances in Intelligent Data Analysis XIV (IDA 2015), 2015.

pdf
bibtex

Vanschoren, J; van Rijn, J N; Bischl, B

Taking machine learning research online with OpenML Inproceedings

In: Proceedings of the 4th International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications, pp. 1–4, 2015.

pdf
bibtex

Seipp, Jendrick; Sievers, Silvan; Hutter, Frank

Fast Downward Cedalion Miscellaneous

2014, (Planner abstract, IPC 2014 Planning and Learning TrackBest learner award, and second place in the category overall best quality at the IPC 2014 Planning and Learning Track. Also achieved the highest coverage in the IPC 2014 sequential agile planning track.).

pdf
bibtex

Seipp, Jendrick; Sievers, Silvan; Hutter, Frank

Fast Downward SMAC Miscellaneous

2014, (Planner abstract, IPC 2014 Planning and Learning TrackBest basic solver award, and third place in the categories overall best quality and best learner.).

pdf
bibtex

Eggensperger, Katharina; Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

Surrogate Benchmarks for Hyperparameter Optimization Inproceedings

In: ECAI workshop on Metalearning and Algorithm Selection (MetaSel), pp. 24-31, 2014, (Superseeded by the AAAI15 paper _Efficient Benchmarking of Hyperparameter Optimizers via Surrogates_).

Feurer, M; Springenberg, T; Hutter, F

Using Meta-Learning to Initialize Bayesian Optimization of Hyperparameters Inproceedings

In: ECAI workshop on Metalearning and Algorithm Selection (MetaSel), pp. 3–10, 2014, (Superseeded by the AAAI15 paper _Initializing Bayesian Hyperparameter Optimization via Meta-Learning_).

Domhan, Tobias; Springenberg, Tobias; Hutter, Frank

Extrapolating Learning Curves of Deep Neural Networks Inproceedings

In: ICML 2014 AutoML Workshop, 2014.

Fawcett, Chris; Vallati, Mauro; Hutter, Frank; Hoffmann, Jörg; Hoos, Holger; Leyton-Brown, Kevin

Improved Features for Runtime Prediction of Domain-Independent Planners Inproceedings

In: Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS 2014), 2014.

pdf
bibtex

Hutter, F; Hoos, H; Leyton-Brown, K

An Efficient Approach for Assessing Hyperparameter Importance Inproceedings

In: Proceedings of International Conference on Machine Learning 2014 (ICML 2014), pp. 754–762, 2014.

Leyton-Brown, Kevin; Hoos, Holger; Hutter, Frank; Xu, Lin

Understanding the Empirical Hardness of NP-complete Problems Journal Article

In: Communications of the Association for Computing Machinery (CACM), vol. 57, no. 5, pp. 98–107, 2014.

Geschwender, Daniel; Hutter, Frank; Kotthoff, Lars; Malitsky, Yuri; Hoos, Holger; Leyton-Brown, Kevin

Algorithm Configuration in the Cloud: A Feasibility Study Inproceedings

In: Proceedings of the Learning and Intelligent OptimizatioN Conference (LION 8), 2014.

Hoos, H; Lindauer, M; Schaub, T

claspfolio 2: Advances in Algorithm Selection for Answer Set Programming Journal Article

In: Theory and Practice of Logic Programming, vol. 14, pp. 569-585, 2014.

pdf
bibtex

Hoogeboom, H J; Kosters, W A; van Rijn, J N; Vis, J K

Acyclic Constraint Logic and Games Journal Article

In: ICGA Journal, vol. 37, no. 1, pp. 3–16, 2014.

pdf
bibtex

Hutter, Frank; López-Ibáñez, Manuel; Fawcett, Chris; Lindauer, Marius; Hoos, Holger; Leyton-Brown, Kevin; Stützle, Thomas

AClib: a Benchmark Library for Algorithm Configuration Inproceedings

In: Proceedings of the Learning and Intelligent OptimizatioN Conference (LION 8), 2014.

Hutter, F; Xu, L; Hoos, H H; Leyton-Brown, K

Algorithm runtime prediction: Methods & evaluation Journal Article

In: Artificial Intelligence, vol. 206, no. 0, pp. 79–111, 2014, (The data and source code for this paper are available from our Empirical Performance Models project page).

Lindauer, M

Algorithm Selection, Scheduling and Configuration of Boolean Constraint Solvers PhD Thesis

University of Potsdam, 2014, (Preliminary Version).

pdf
bibtex

van Rijn, J N; Holmes, G; Pfahringer, B; Vanschoren, J

Algorithm Selection on Data Streams Incollection

In: Discovery Science, vol. 8777, pp. 325–336, Springer, 2014.

van Rijn, J N; Vis, J K

Endgame Analysis of Dou Shou Qi Journal Article

In: ICGA Journal, vol. 37, no. 2, pp. 120–124, 2014.

pdf
bibtex

van Rijn, J N; Holmes, G; Pfahringer, B; Vanschoren, J

Towards meta-learning over data streams Inproceedings

In: MetaSel 2014, pp. 37–38, CEUR-WS 2014.

pdf
bibtex

Vanschoren, J; van Rijn, J N; Bischl, B; Torgo, L

OpenML: networked science in machine learning Journal Article

In: ACM SIGKDD Explorations Newsletter, vol. 15, no. 2, pp. 49–60, 2014.

pdf
bibtex

Eggensperger, Katharina; Feurer, Matthias; Hutter, Frank; Bergstra, James; Snoek, Jasper; Hoos, Holger H; Leyton-Brown, Kevin

Towards an Empirical Foundation for Assessing Bayesian Optimization of Hyperparameters Inproceedings

In: NeurIPS workshop on Bayesian Optimization in Theory and Practice, 2013, (Software and benchmarks are available from our HPOlib website.).

Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

An Efficient Approach for Assessing Parameter Importance in Bayesian Optimization Inproceedings

In: NIPS workshop on Bayesian Optimization in Theory and Practice, 2013.

Swersky, Kevin; Duvenaud, David; Snoek, Jasper; Hutter, Frank; Osborne, Michael

Raiders of the Lost Architecture: Kernels for Bayesian Optimization in Conditional Parameter Spaces Inproceedings

In: NIPS workshop on Bayesian Optimization in Theory and Practice, 2013.

pdf
bibtex

Gebser, M; Jost, H; Kaminski, R; Obermeier, P; Sabuncu, O; Schaub, T; Schneider, M

Ricochet Robots: A transverse ASP benchmark Inproceedings

In: pp. 348-360, 2013.

Thornton, C; Hutter, F; Hoos, H H; Leyton-Brown, K

Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms Inproceedings

In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'13), 2013, (The software is available from our Auto-WEKA page.).

pdf
bibtex

Wang, Z; Zoghi, M; Hutter, F; Matheson, D; de Freitas, N

Bayesian Optimization in High Dimensions via Random Embeddings Inproceedings

In: Proceedings of the 23rd international joint conference on Artificial Intelligence (IJCAI), pp. 1778-1784, AAAI Press 2013, (Distinguished paper award. ).

Hutter, F; Hoos, H H; Leyton-Brown, K

An Evaluation of Sequential Model-Based Optimization for Expensive Blackbox Functions Inproceedings

In: Proceedings of GECCO-13 Workshop on Blackbox Optimization Benchmarking (BBOB'13), 2013, (Software and data are available from the SMAC page.).

pdf
bibtex

Hoos, H; Kaufmann, B; Schaub, T; Schneider, M

Robust Benchmark Set Selection for Boolean Constraint Solvers Inproceedings

In: pp. 138-152, 2013.

Hutter, F; Hoos, H H; Leyton-Brown, K

Identifying Key Algorithm Parameters and Instance Features using Forward Selection Incollection

In: Nicosia, Giuseppe; Pardalos, Panos (Ed.): Proceedings of the 7th International Conference on Learning and Optimization (LION-7), Springer Berlin Heidelberg, 2013, (The data and source code for this paper are available from our Empirical Performance Models project page.).

pdf
bibtex

Pardalos, P; Nicosia, G (Ed.)

Proceedings of the Seventh International Conference on Learning and Intelligent Optimization (LION'13) Proceeding

Springer-Verlag, vol. 7997, 2013.

pdf
bibtex

Cabalar, P; Son, T (Ed.)

Proceedings of the Twelfth International Conference on Logic Programming and Nonmonotonic Reasoning (LPNMR'13) Proceeding

Springer-Verlag, vol. 8148, 2013.

pdf
bibtex

van Rijn, J N; Bischl, B; Torgo, L; Gao, B; Umaashankar, V; Fischer, S; Winter, P; Wiswedel, B; Berthold, M R; Vanschoren, J

OpenML: A Collaborative Science Platform Incollection

In: Machine Learning and Knowledge Discovery in Databases, pp. 645–649, Springer, 2013.

pdf
bibtex

van Rijn, J N; Umaashankar, V; Fischer, S; Bischl, B; Torgo, L; Gao, B; Winter, P; Wiswedel, B; Berthold, M R; Vanschoren, J

A RapidMiner extension for open machine learning Inproceedings

In: RapidMiner Community Meeting and Conference, pp. 59–70, 2013.

pdf
bibtex

van Rijn, J N; Vis, J K

Complexity and retrograde analysis of the game Dou Shou Qi Inproceedings

In: BNAIC 2013: Proceedings of the 25th Benelux Conference on Artificial Intelligence, Delft University of Technology (TU Delft); under the auspices of the Benelux Association for Artificial Intelligence (BNVKI) and the Dutch Research School for Information and Knowledge Systems (SIKS) 2013.

Kaufmann, B; Schaub, T; Schneider, M

clasp, claspfolio, aspeed: Three Solvers from the Answer Set Solving Collection Potassco Inproceedings

In: pp. 17-19, 2012.

Hoos, H; Kaminski, R; Schaub, T; Schneider, M

aspeed: ASP-based Solver Scheduling Inproceedings

In: pp. 176-187, 2012.

Silverthorn, B; Lierler, Y; Schneider, M

Surviving Solver Sensitivity: An ASP Practitioner's Guide Inproceedings

In: pp. 164-175, 2012.

Xu, L; Hutter, F; Shen, J; Hoos, H; Leyton-Brown, K

SATzilla2012: Improved Algorithm Selection Based on Cost-sensitive Classification Models Unpublished

2012, (Published online. Solver description for the 2012 SAT challenge. SATzilla2012 won 3 out of the 4 categories for which it was eligible, and placed 2nd in the remaining one. Details: it won the sequential portfolio track, was the best solver for 2 of the 3 main sequential categories (Application and Hard Combinatorial), and 2nd in the sequential Random Category (beaten only by a new non-portfolio solver, CCASAT). See the SATzilla project page for details on SATzilla and source code.).

Xu, Lin; Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

Evaluating Component Solver Contributions to Portfolio-Based Algorithm Selectors Inproceedings

In: International Conference on Theory and Applications of Satisfiability Testing (SAT'12), 2012.

pdf
bibtex

Schneider, M; Hoos, H

Quantifying Homogeneity of Instance Sets for Algorithm Configuration Inproceedings

In: Learning and Intelligent Optimization (LION'12), 2012.

Hoos, Holger; Leyton-Brown, Kevin; Schaub, Torsten; Schneider, Marius

Algorithm Configuration for Portfolio-based Parallel SAT-Solving Journal Article

In: Proceedings of the First Workshop on Combining Constraint Solving with Mining and Learning (CoCoMile'12), 2012.

pdf
bibtex

Hutter, F; Hoos, H H; Leyton-Brown, K

Parallel Algorithm Configuration Inproceedings

In: Proceedings of the Learning and Intelligent OptimizatioN Conference LION 6, pp. 55-70, 2012.

Dovier, A; Costa, Santos V (Ed.)

Technical Communications of the Twenty-eighth International Conference on Logic Programming (ICLP'12) Proceeding

Leibniz International Proceedings in Informatics (LIPIcs), vol. 17, 2012.

pdf
bibtex

Dovier, A; Costa, Santos V (Ed.)

Technical Communications of the Twenty-eighth International Conference on Logic Programming (ICLP'12) Proceeding

Leibniz International Proceedings in Informatics (LIPIcs), vol. 17, 2012.

pdf
bibtex

Hamadi, Y; Schoenauer, M (Ed.)

Proceedings of the Sixth International Conference on Learning and Intelligent Optimization (LION'12) Proceeding

Springer-Verlag, 2012.

pdf
bibtex

Balint, A; Belov, A; Diepold, D; Gerber, S; Järvisalo, M; Sinz, C (Ed.)

Proceedings of SAT Challenge 2012: Solver and Benchmark Descriptions Proceeding

University of Helsinki, vol. B-2012-2, 2012, (Available at r̆lhttps://helda.helsinki.fi/handle/10138/34218).

pdf
bibtex

Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

Bayesian Optimization With Censored Response Data Inproceedings

In: NIPS workshop on Bayesian Optimization, Sequential Experimental Design, and Bandits, 2011, (Published online. There is also a new, extended arXiv version.).

Xu, Lin; Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

Hydra-MIP: Automated Algorithm Configuration and Selection for Mixed Integer Programming Inproceedings

In: RCRA workshop on Experimental Evaluation of Algorithms for Solving Problems with Combinatorial Explosion at the International Joint Conference on Artificial Intelligence (IJCAI), 2011.

pdf
bibtex

Xu, Lin; Hutter, Frank; Hoos, Holger; Leyton-Brown, Kevin

Detailed SATzilla Results from the Data Analysis Track of the 2011 SAT Competition Miscellaneous

2011.

pdf
bibtex

Gebser, M; Kaminski, R; Kaufmann, B; Schaub, T; Schneider, M; Ziller, S

A Portfolio Solver for Answer Set Programming: Preliminary Report Inproceedings

In: pp. 352-357, 2011.

Gebser, M; Kaminski, R; Kaufmann, B; M, Ostrowski; Schaub, T; Schneider, M

Potassco: The Potsdam Answer Set Solving Collection Journal Article

In: AI Communications, vol. 24, no. 2, pp. 107-124, 2011.

pdf
bibtex

Hutter, F; Hoos, H H; Leyton-Brown, K

Sequential Model-Based Optimization for General Algorithm Configuration Inproceedings

In: Proceedings of the conference on Learning and Intelligent OptimizatioN (LION 5), pp. 507-523, 2011, (Best paper award (second prize). SMAC, ROAR, and the instances used are available from the Automated Algorithm Configuration project page. An extended version with additional details is available as UBC tech report TR-2010-10. (pdf) (bib)).

Delgrande, J; Faber, W (Ed.)

Proceedings of the Eleventh International Conference on Logic Programming and Nonmonotonic Reasoning (LPNMR'11) Proceeding

Springer-Verlag, vol. 6645, 2011.

pdf
bibtex

Möller, M; Schneider, M; Wegner, M; Schaub, T

Centurio, a General Game Player: Parallel, Java- and ASP-based Journal Article

In: Künstliche Intelligenz, vol. 25, no. 1, pp. 17-24, 2011.

pdf
bibtex

Hutter, F; Bartz-Beielstein, T; Hoos, H H; Leyton-Brown, K; Murphy, K P

Sequential Model-Based Parameter Optimisation: an Experimental Investigation of Automated and Interactive Approaches Incollection

In: Bartz-Beielstein, T; Chiarandini, M; Paquete, L; Preuss, M (Ed.): Empirical Methods for the Analysis of Optimization Algorithms, pp. 361–411, Springer, 2010.

pdf
bibtex

Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

Tradeoffs in the Empirical Evaluation of Competing Algorithm Designs Journal Article

In: Annals of Mathematics and Artificial Intelligenc (AMAI), Special Issue on Learning and Intelligent Optimization, vol. 60, no. 1, pp. 65–89, 2010, (The data from this paper, as well as the empirical analysis tools we introduced are available from the Automated Algorithm Configuration project page.).

pdf
bibtex

Hutter, F; Hoos, H H; Leyton-Brown, K

Sequential Model-Based Optimization for General Algorithm Configuration (extended version) Technical Report

University of British Columbia, Department of Computer Science no. TR-2010-10, 2010.

pdf
bibtex

Hutter, F; Hoos, H H; Leyton-Brown, K

Automated Configuration of Mixed Integer Programming Solvers Inproceedings

In: Proceedings of the Conference on Integration of Artificial Intelligence and Operations Research techniques in Constraint Programming (CPAIOR), pp. 186-202, 2010, (Our webpage on Automated Configuration of MIP solvers also gives the parameter files for CPLEX, Gurobi, and lpsolve.).

Hutter, F; Hoos, H H; Leyton-Brown, K; Murphy, K P

Time-Bounded Sequential Parameter Optimization Inproceedings

In: Proceedings of the conference on Learning and Intelligent OptimizatioN (LION 4), 2010, (Runner-up for the best paper award).

Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin; Stützle, Thomas

ParamILS: An Automatic Algorithm Configuration Framework Journal Article

In: Journal of Artificial Intelligence Research, vol. 36, pp. 267–306, 2009, (See the ParamILS project page for a lot of experimental data for this paper (target algorithms, parameters, resulting parameter configurations). There's also a quick start guide available to help you apply ParamILS for tuning your own algorithms. There's also an older tech report about ParamILS, including additional material (pdf) (bib).).

pdf
bibtex

Hutter, F

Automated Configuration of Algorithms for Solving Hard Computational Problems PhD Thesis

University of British Columbia, Department of Computer Science, 2009, (There are also slides from invited presentation at Canadian AI grad student symposium. 2010 CAIAC Doctoral Dissertation Award for the best thesis in Artificial Intelligence at a Canadian University completed in 2009. See the Automated Algorithm Configuration project page for a lot of experimental data (target algorithms, parameters, benchmark instances, and configuration proceduers).).

Hutter, F; de Oca, M A Montes (Ed.)

SLS-DS 2009: Doctoral Symposium on Engineering Stochastic Local Search Algorithms Proceeding

IRIDIA, Université Libre de Bruxelles, Brussels, Belgium 2009.

pdf
bibtex

Hutter, F; Hoos, H H; Leyton-Brown, K; Murphy, K P

An Experimental Investigation of Model-Based Parameter Optimisation: SPO and Beyond Inproceedings

In: Proceedings of the 11th annual conference on Genetic and evolutionary computation (GECCO '09), pp. 271–278, 2009.

Hutter, F; Hoos, H H; Leyton-Brown, K; Stützle, T

ParamILS: An Automatic Algorithm Configuration Framework Technical Report

University of British Columbia no. TR-2009-01, 2009.

pdf
bibtex

Xu, L; Hutter, F; Hoos, H; Leyton-Brown, K

SATzilla2009: an Automatic Algorithm Portfolio for SAT Unpublished

2009, (Solver description, SAT competition 2009Solver description for the 2009 SAT competition. SATzilla2009 won 3 gold and 2 silver medals in that competition. See the SATzilla project page for details and source code.).

pdf
bibtex

Xu, Lin; Hutter, Frank; Hoos, Holger H; Leyton-Brown, Kevin

SATzilla: Portfolio-based Algorithm Selection for SAT Journal Article

In: Journal of Artificial Intelligence Research, vol. 32, pp. 565–606, 2008, (2010 IJCAI/JAIR Best Paper Prize for the period 2005-2009. See the SATzilla project page for details and source code.).

pdf
bibtex

Hutter, Frank; Babic, Domagoj; Hoos, Holger H; Hu, Alan J

Boosting Verification by Automatic Tuning of Decision Proceedingsdures Inproceedings

In: Proceedings of Formal Methods in Computer Aided Design (FMCAD'07), pp. 27–34, IEEE Computer Society, Washington, DC, USA, 2007, (With the tuning discussed in this paper Domagoj's solver Spear won the QF_BV (Quantifier-Free Bit Vector) category of the 2007 Satisfiability Modulo Theories Competition.).

pdf
bibtex

Hutter, Frank

On the Potential of Automatic Algorithm Configuration Inproceedings

In: Proceedings of the Doctoral Symposium on Engineering Stochastic Local Search Algorithms (SLS-DS)., 2007, (Best poster award (voted by the attendees of SLS 07).).

pdf
bibtex

Xu, L; Hutter, F; Hoos, H H; Leyton-Brown, K

SATzilla-07: The Design and Analysis of an Algorithm Portfolio for SAT Inproceedings

In: Principles and Practice of Constraint Programming (CP'07), 2007, (SATzilla won 3 gold medals, 1 silver and 1 bronze in the 2007 SAT competition! It is available for download from the SATzilla website.).

pdf
bibtex

Hutter, F; Hoos, H; Stützle, T

Automatic Algorithm Configuration based on Local Search Inproceedings

In: Proceedings of the Twenty-Second Conference on Artifical Intelligence (AAAI '07), pp. 1152–1157, 2007, (The ParamILS algorithm introduced in this paper is available for download from the ParamILS website. There's also a quick start guide available to help you apply it for tuning your own algorithms.).

Babić, D; Hutter, F

SPEAR Theorem Prover Miscellaneous

2007, (Solver description, SAT competitionSPEAR is a new tree search algorithm with 25 free parameters. I tuned it (using the techniques from the AAAI-07 paper on ParamILS), getting a 30% speedup; for software verification, my parameter settings beat the default by a factor of 50!).

pdf
bibtex

Tompkins, Dave; Hutter, Frank; H, Holger; Hoos,

Scaling and Probabilistic Smoothing (SAPS) Miscellaneous

2007, (SAPS is unchanged from last year, but I got a tenfold speedup by automated parameter tuning (using the techniques from the AAAI-07 ParamILS paper)).

pdf
bibtex

Xu, Lin; Hutter, Frank; Hoos, Holger H; Leyton-brown, Kevin

SATzilla2007: a new & improved algorithm portfolio for SAT Miscellaneous

2007, (In a nutshell, SATzilla predicts the runtime of each solver in the portfolio and picks the most promising one. SATzilla2007 won 3 gold medals, 1 silver and 1 bronze! See the SAT competition webpage for details.).

pdf
bibtex

Hutter, F; Hamadi, Y; Hoos, H H; Leyton-Brown, K

Performance Prediction and Automated Tuning of Randomized and Parametric Algorithms Inproceedings

In: Principles and Practice of Constraint Programming (CP'06), pp. 213–228, 2006, (All our experimental data for this paper, as well as our Matlab code, is available on the Empirical Hardness Models project page.).

Hutter, Frank

Automated Algorithm Configuration Based on Machine Learning Miscellaneous

2006.

Hutter, Frank; Hamadi, Youssef

Parameter Adjustment Based on Performance Prediction: Towards an Instance-Aware Problem Solver Technical Report

Microsoft Research Cambridge, UK, no. MSR-TR-2005-125, 2005, (Slides from a talk I gave at the Cork Constraint Computation Centre (4C) Slides from a talk I gave in the Lab for Computational Intelligence at UBC).

pdf
bibtex

Hutter, Frank; Hoos, Holger H; Stützle, Thomas

Efficient Stochastic Local Search for MPE Solving Inproceedings

In: Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI-05), pp. 169–174, 2005, (My solver GLS+ and the test instances we used are available on our MPE page. The solver can read general factor graphs, i.e. Bayes nets (in BNT format), MRFs, CRFs, etc. There's also a nice Matlab interface.).

Hutter, Frank

Stochastic Local Search for Solving the Most Probable Explanation Problem in Bayesian Networks Masters Thesis

Darmstadt University of Technoloy, 2004, (Supervisor: Thomas Stützle, Cosupervisor: Holger Hoos; My solver GLS+ and most of the test instances I used are available on our MPE page.).

pdf
bibtex

Hutter, Frank; Ng, Brenda; Dearden, Richard

Incremental Thin Junction Trees for Dynamic Bayesian Networks Technical Report

Intellectics Group, Darmstadt University of Technology no. TR-AIDA-04-01, 2004.

pdf
bibtex

Dearden, Richard; Willeke, Thomas; Hutter, Frank; Simmons, Reid; Verma, Vandi; Thrun, Sebastian

Real-time Fault Detection and Situational Awareness for Rovers: Report on the Mars Technology Program Task Inproceedings

In: In Proceedings of IEEE Aerospace Conference, 2004, pp. 826–840, IEEE Press, 2004, (Check out my GPF webpage for the particle filtering code.).

pdf
bibtex

de Freitas, Nando; Dearden, Richard; Hutter, Frank; Morales-Menendez, Ruben; Mutch, Jim; Poole, David

Diagnosis by a Waiter and a Mars Explorer Journal Article

In: Proceedings of the IEEE, vol. 92, no. 4, pp. 139-144, 2004, (Check out my GPF webpage for the particle filtering code used for the rover examples.).

Andronescu, M; Fejes, A P; Hutter, F; Hoos, H H; Condon, A

A new algorithm for RNA secondary structure design Journal Article

In: Journal of Molecular Biology, vol. 336, no. 3, pp. 607–624, 2004, (Check out the free RNA Designer Software at ).

pdf
bibtex

Hutter, Frank; Dearden, Richard

The Gaussian Particle Filter for Diagnosis of Non-Linear Systems Inproceedings

In: Proceedings of the 14th International Conference on Principles of Diagnosis(DX03), pp. 5–70, 2003, (Check out my GPF webpage for the Gaussian particle filtering code.).

pdf
bibtex

Hutter, Frank; Dearden, Richard

Efficient On-line Fault Diagnosis for Non-Linear Systems Inproceedings

In: Seventh International Symposium on Artificial Intelligence and Robotics in Space (i-SAIRAS-03), 2003, (Check out my GPF webpage for the Gaussian particle filtering code.).

pdf
bibtex

Hutter, F; Tompkins, D A D; Hoos, H H

Scaling and Probabilistic Smoothing: Efficient Dynamic Local Search for SAT Inproceedings

In: Hentenryck, Pascal (Ed.): Principles and Practice of Constraint Programming - CP 2002, pp. 233-248, Springer Berlin Heidelberg, 2002, (Check out the DLS for SAT webpage, maintained by Dave.).

pdf
bibtex

Andronescu, M; Fejes, A P; Hutter, F; Hoos, H H; Condon, A

A New SLS Algorithm for RNA Secondary Structure Design Technical Report

Department of Computer Science, University of British Columbia no. TR-2002-10, 2002, (Available as a postscript file. Check out the free RNA Designer Software at http://www.rnasoft.ca/).

Machine Learning Lab

Featured Publications

All Publications

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002