Amazon Web Services, Amazon Berlin; Representation Learning Lab, University of Freiburg
Arlind Kadra, Maciej Janowski, Martin Wistuba, Josif Grabocka
hyperparameter optimization;multi-fidelity hyperparameter optimization;multi-fidelity hpo;power laws;deep neural networks;deep power laws;deep ensemble;deep learning;large language models;scaling laws;llm
Scaling Laws for Hyperparameter Optimization