Main Track
DeltaProduct: Improving State-Tracking in Linear RNNs via Householder Products Proceedings Article In: 39th Conference on Neural Information Processing Systems (NeurIPS), 2025. |
Learning in Compact Spaces with Approximately Normalized Transformer Proceedings Article In: 39th Conference on Neural Information Processing Systems (NeurIPS), 2025. |
EquiTabPFN: A Target-Permutation Equivariant Prior Fitted Network Proceedings Article In: 39th Conference on Neural Information Processing Systems (NeurIPS), 2025. |
Do-PFN: In-Context Learning for Causal Effect Estimation Proceedings Article In: 39th Conference on Neural Information Processing Systems (NeurIPS), 2025, (Spotlight). |
Gompertz Linear Units: Leveraging Asymmetry for Enhanced Learning Dynamics Proceedings Article In: 39th Conference on Neural Information Processing Systems (NeurIPS), 2025. |
Cost-Sensitive Freeze-thaw Bayesian Optimization for Efficient Hyperparameter Tuning Proceedings Article In: 39th Conference on Neural Information Processing Systems (NeurIPS), 2025. |
Bayesian Neural Scaling Laws Extrapolation with Prior-Fitted Networks Proceedings Article In: Proceedings of the 42nd International Conference on Machine Learning (ICML), 2025. |
FairPFN: A Tabular Foundation Model for Causal Fairness Proceedings Article In: Proceedings of the 42nd International Conference on Machine Learning (ICML), 2025. |
Tuning LLM Judge Design Decisions for 1/1000 of the Cost Proceedings Article In: Proceedings of the 42nd International Conference on Machine Learning (ICML), 2025. |
Position: The Future of Bayesian Prediction Is Prior-Fitted Proceedings Article In: Proceedings of the 42nd International Conference on Machine Learning (ICML), 2025. |
Frozen Layers: Memory-efficient Many-fidelity Hyperparameter Optimization Proceedings Article In: Proceedings of the Fourth International Conference on Automated Machine Learning (AutoML 2025), Main Track, 2025. |
Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues Proceedings Article In: Proceedings of the Thirteenth International Conference on Learning Representations (ICLR), 2025, (Oral). |
Efficient Cross-Episode Meta-RL Proceedings Article In: Proceedings of the Thirteenth International Conference on Learning Representations (ICLR'25), 2025. |
KinPFN: Bayesian Approximation of RNA Folding Kinetics using Prior-Data Fitted Networks Proceedings Article In: Proceedings of the Thirteenth International Conference on Learning Representations (ICLR), 2025. |
Diffusion-based Neural Network Weights Generation Proceedings Article In: Proceedings of the Thirteenth International Conference on Learning Representations (ICLR), 2025. |
Multi-objective Differentiable Neural Architecture Search Proceedings In: Proceedings of the Thirteenth International Conference on Learning Representations (ICLR), 2025., 2025. |
Beyond Random Augmentations: Pretraining with Hard Views Conference Proceedings of the Thirteenth International Conference on Learning Representations (ICLR), 2025. |
TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks Proceedings Article In: 38th Conference on Neural Information Processing Systems (NeurIPS), 2024. |
Improving Deep Learning Optimization through Constrained Parameter Regularization Proceedings Article In: 38th Conference on Neural Information Processing Systems (NeurIPS), 2024. |
Drift-Resilient TabPFN: In-Context Learning Distribution Shifts on Tabular Data Proceedings Article In: 38th Conference on Neural Information Processing Systems (NeurIPS), 2024. |
A Human-in-the-Loop Fairness-Aware Model Selection Framework for Complex Fairness Objective Landscapes Proceedings Article In: Proceedings of the Seventh AAAI/ACM Conference on AI, Ethics, and Society (AIES-24), 2024. |
HPO-RL-Bench: A Zero-Cost Benchmark for HPO in Reinforcement Learning Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), ABCD Track, 2024, (Runner up for the best paper award). |
Weight-Entanglement Meets Gradient-Based Neural Architecture Search Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Methods Track, 2024. |
Is Mamba Capable of In-Context Learning? Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Methods Track, 2024. |
TabRepo: A Large Scale Repository of Tabular Model Evaluations and its AutoML Applications Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), ABCD Track, 2024. |
Fast Benchmarking of Asynchronous Multi-Fidelity Optimization on Zero-Cost Benchmarks Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), ABCD Track, 2024. |
Don’t Waste Your Time: Early Stopping Cross-Validation Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Methods Track, 2024. |
Surprisingly Strong Performance Prediction with Neural Graph Features Proceedings Article In: Proceedings of the 41st International Conference on Machine Learning (ICML), 2024. |
In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization Proceedings Article In: Proceedings of the 41st International Conference on Machine Learning (ICML), 2024. |
Position: A Call to Action for a Human-Centered AutoML Paradigm Proceedings Article In: Proceedings of the 41st International Conference on Machine Learning (ICML), 2024. |
A General Framework for User-Guided Bayesian Optimization Proceedings Article In: The Twelfth International Conference on Learning Representations (ICLR), 2024. |
Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Proceedings Article In: The Twelfth International Conference on Learning Representations (ICLR), 2024, (Oral Presentation). |
Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars Proceedings Article In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023. |
Self-Correcting Bayesian Optimization through Bayesian Active Learning Proceedings Article In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023. |
Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition Proceedings Article In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023, (Oral Paper - top 2% of accepted papers). |
PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning Proceedings Article In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023. |
Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networks Proceedings Article In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023. |
Large Language Models for Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineering Proceedings Article In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023. |
Probabilistic Transformer: Modelling Ambiguities and Distributions for RNA Folding and Molecule Design Proceedings Article In: Oh, Alice H.; Agarwal, Alekh; Belgrave, Danielle; Cho, Kyunghyun (Ed.): Advances in Neural Information Processing Systems (NeurIPS 2022), 2022. |
Joint Entropy Search For Maximally-Informed Bayesian Optimization Proceedings Article In: Oh, Alice H.; Agarwal, Alekh; Belgrave, Danielle; Cho, Kyunghyun (Ed.): Advances in Neural Information Processing Systems (NeurIPS 2022), 2022. |
Datasets and Benchmarks Track
TabArena: A Living Benchmark for Machine Learning on Tabular Data Proceedings Article In: NeurIPS 2025 Datasets and Benchmarks Track , 2025, (Spotlight). |
HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models Proceedings Article In: 38th Conference on Neural Information Processing Systems (NeurIPS), DBT Track, 2024. |
JAHS-Bench-201: A Foundation For Research On Joint Architecture And Hyperparameter Search Proceedings Article In: Thirty-sixth Conference on Neural Information Processing Systems, 2022, (Featured Paper - top 7.5% of accepted papers). |
NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxies Proceedings Article In: Thirty-sixth Conference on Neural Information Processing Systems, 2022. |
Workshops
nanoTabPFN: A Lightweight and Educational Reimplementation of TabPFN Proceedings Article In: EurIPS 2025 Workshop: AI for Tabular Data, 2025. |
Balancing Synthetic Data and Replay for Enhancing Task-Specific Capabilities Proceedings Article Forthcoming In: NeurIPS 2025 Workshop on Continual and Compatible Foundation Model Updates, Forthcoming. |
Increasing LLM Coding Capabilities through Diverse Synthetic Coding Tasks Proceedings Article Forthcoming In: NeurIPS 2025 Fourth Workshop on Deep Learning for Code, Forthcoming. |
Towards Scaling Laws for Symbolic Regression Proceedings Article Forthcoming In: The 5th Workshop on Mathematical Reasoning and AI at NeurIPS 2025, Forthcoming. |
Agentic NL2SQL to Reduce Computational Costs Proceedings Article In: NeurIPS 2025 Workshop on Efficient Reasoning, 2025. |
Causal Data Augmentation for Robust Fine-Tuning of Tabular Foundation Models Proceedings Article In: EurIPS 2025 Workshop: AI for Tabular Data, 2025. |
Generalization Can Emerge in Tabular Foundation Models From a Single Table Proceedings Article Forthcoming In: EurIPS 2025 Workshop: AI for Tabular Data, Forthcoming. |
Does TabPFN Understand Causal Structures? Proceedings Article In: EurIPS 2025 Workshop: AI for Tabular Data, 2025. |
TempoPFN: Towards Synthetic Pre-training of Linear RNNs for Zero-shot Time Series Forecasting Proceedings Article Forthcoming In: EurIPS 2025 Workshop: AI for Tabular Data, Forthcoming. |
Towards Scaling Laws for Symbolic Regression Proceedings Article In: EurIPS 2025 Workshop: AI for Tabular Data, 2025. |
Tune My Adam, Please! Proceedings Article In: Proceedings of the Fourth International Conference on Automated Machine Learning (AutoML), Non-Archival Track, 2025. |
STRAND: Structure Refinement of RNA-Protein Complexes via Diffusion Proceedings Article In: The 2nd workshop on Generative AI and Biology at ICML, 2025. |
Do-PFN: In-Context Learning for Causal Effect Estimation Proceedings Article In: Foundation Models for Structured Data workshop at ICML, 2025. |
Towards Synthetic Data for Fine-tuning Tabular Foundation Models Proceedings Article In: Foundation Models for Structured Data workshop at ICML, 2025. |
Towards Benchmarking Foundation Models for Tabular Data With Text Proceedings Article In: Foundation Models for Structured Data workshop at ICML, 2025. |
Early Stopping Tabular In-Context Learning Proceedings Article In: Foundation Models for Structured Data workshop at ICML, 2025. |
Real-TabPFN: Improving Tabular Foundation Models via Continued Pre-training With Real-World Data Proceedings Article In: Foundation Models for Structured Data workshop at ICML, 2025. |
Unreflected Use of Tabular Data Repositories Can Undermine Research Quality Proceedings Article In: The Future of Machine Learning Data Practices and Repositories at ICLR, 2025, (Workshop Spotlight). |
DeltaProduct: Improving State-Tracking in Linear RNNs via Householder Products Proceedings Article In: Foundation Models in the Wild at ICLR, 2025, (Oral). |
Bayesian Approximation of RNA Folding Times Proceedings Article In: Workshop on AI for Nucleic Acids at ICLR, 2025. |
$alpha$-PFN: In-Context Learning Entropy Search Proceedings Article In: The Frontiers in Probabilistic Inference: Sampling meets Learning (FPI) at ICLR, 2025. |
One-shot World Models Using a Transformer Trained on a Synthetic Prior Proceedings Article In: NeurIPS 2024 Workshop on Open-World Agents, 2024. |
Large Language Models Engineer Too Many Simple Features for Tabular Data Proceedings Article In: NeurIPS 2024 Third Table Representation Learning Workshop, 2024, (Workshop Oral). |
Ensembling Finetuned Language Models for Text Classification Proceedings Article In: NeurIPS 2024 Workshop on Fine-Tuning in Modern Machine Learning: Principles and Scalability, 2024. |
Warmstarting for Scaling Language Models Proceedings Article In: NeurIPS 2024 Workshop Adaptive Foundation Models, 2024. |
Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Models Proceedings Article In: NeurIPS 2024 TSALM Workshop, 2024, (Spotlight Presentation). |
Large Language Model Compression with Neural Architecture Search Proceedings Article In: NeurIPS 2024 Workshop on Machine Learning and Compression, 2024. |
GAMformer: Exploring In-Context Learning for Generalized Additive Models Proceedings Article In: NeurIPS 2024 TRL Workshop, 2024. |
[TabPFN-TS] From Tables to Time: Extending TabPFN-v2 to Time Series Forecasting Proceedings Article In: NeurIPS 2024 TRL Workshop, 2024. |
Unlocking State-Tracking in linear RNNs through Negative Eigenvalues Proceedings Article In: NeurIPS 2024 Workshop on Mathematics of Modern Machine Learning Workshop (M3L), 2024, (Oral Presentation). |
Transfer Learning for Finetuning Large Language Models Proceedings Article In: NeurIPS 2024 Workshop on Adaptive Foundation Models, 2024. |
CANDID DAC: Leveraging Coupled Action Dimensions with Importance Differences in DAC Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
FairPFN: Transformers Can do Counterfactual Fairness Conference Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
Towards Efficient Search for Customized Activation Functions With Gradient Descent Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
LMEMs for post-hoc analysis of HPO Benchmarking Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
Quick-Tune-Tool: A Practical Tool and its User Guide for Automatically Finetuning Pretrained Models Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
NOSBench-101: Towards Reproducible Neural Optimizer Search Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
Drift-Resilient TabPFN: In-Context Learning Distribution Shifts on Tabular Data Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
In-Context Learning for Latency Estimation Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
LoRA-DARTS: Low Rank Adaptation for Differentiable Architecture Search Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization Proceedings Article In: Proceedings of the 41st International Conference on Machine Learning (ICML), 2024. |
From Epoch to Sample Size: Developing New Data-driven Priors for Learning Curve Prior-Fitted Networks Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
Beyond Graph-Based Modeling for Hierarchical Neural Architecture Search Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
Fast Optimizer Benchmark Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
Hardware Aware Ensemble Selection for Balancing Predictive Accuracy and Cost Proceedings Article In: Proceedings of the Third International Conference on Automated Machine Learning (AutoML 2024), Workshop Track, 2024. |
Multi-objective Differentiable Neural Architecture Search Conference 2nd Workshop on Advancing Neural Network Training: Computational Efficiency, Scalability, and Resource Optimization (WANT@ICML), 2024. |
CoordConformer: Heterogenous EEG datasets decoding using Transformers Conference Workshop on Geometry-grounded Representation Learning and Generative Modeling (GRaM@ICML), 2024. |
RNA-Protein Interaction Prediction via Sequence Embeddings Workshop The Generative and Experimental perspectives in bioMolecular design (GEM) workshop (ICLR 2024), 2024. |
Towards Generative RNA Design with Tertiary Interactions Workshop The Generative and Experimental perspectives in bioMolecular design (GEM) workshop (ICLR 2024), 2024, (Oral Presentation). |
Towards Quantifying the Effect of Datasets for Benchmarking: A Look at Tabular Machine Learning Proceedings Article In: Data-centric Machine Learning Research (DMLR) Workshop (ICLR 2024), 2024. |
Preserving Principal Subspaces to Reduce Catastrophic Forgetting in Fine-tuning Proceedings Article In: Mathematical and Empirical Understanding of Foundation Models (ME-FoMo) Workshop, 2024. |
Is Mamba Capable of In-Context Learning? Proceedings Article In: Mathematical and Empirical Understanding of Foundation Models (ME-FoMo) Workshop, 2024. |
Rethinking Performance Measures of RNA Secondary Structure Problems Workshop Machine Learning for Structural Biology Workshop, (NeruIPS 2023), 2023. |
New Horizons in Parameter Regularization: A Constraint Approach Proceedings Article In: OPT2023: 15th Annual Workshop on Optimization for Machine Learning, (NeurIPS 2023), 2023. |
AutoRL-Bench 1.0 Proceedings Article In: Workshop on Meta-Learning (MetaLearn@NeurIPS'22), 2022. |
Gray-Box Gaussian Processes for Automated Reinforcement Learning Proceedings Article In: Workshop on Meta-Learning (MetaLearn@NeurIPS'22), 2022. |
TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second Proceedings Article In: NeurIPS 2022 First Table Representation Workshop, 2022. |
Bayesian Optimization with a Neural Network Meta-learned on Synthetic Data Only Workshop Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022. |
Towards Discovering Neural Architectures from Scratch Proceedings Article In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022. |
Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networks Proceedings Article In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022. |
GraViT-E: Gradient-based Vision Transformer Search with Entangled Weights Proceedings Article In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022. |
Multi-objective Tree-structured Parzen Estimator Meets Meta-learning Proceedings Article In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022. |
PriorBand: HyperBand + Human Expert Knowledge Proceedings Article In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022. |
On the Importance of Architectures and Hyperparameters for Fairness in Face Recognition Proceedings Article In: Workshop on Trustworthy and Socially Responsible Machine Learning, NeurIPS 2022, 2022. |
On the Importance of Architectures and Hyperparameters for Fairness in Face Recognition Proceedings Article In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022. |
Transfer NAS with Meta-learned Bayesian Surrogates Proceedings Article In: Sixth Workshop on Meta-Learning at the Conference on Neural Information Processing Systems, 2022. |
c-TPE: Generalizing Tree-structured Parzen Estimator with Inequality Constraints for Continuous and Categorical Hyperparameter Optimization Proceedings Article In: NeurIPS Workshop on Gaussian Processes, Spatiotemporal Modeling, and Decision-making Systems, 2022. |