“…Finally, section 5 summarizes the findings, highlighting open challenges and potential solutions. focus on optimization of industrial processes (Chen, Jiang, Chang, & Chen, 2014), meta-learning (Vanschoren, 2019), optimization of internal parameters (Wawrzyński, 2017), and papers related to AutoML systems that are not focused on hyperparameter optimization (such as model selection algorithms (Silva et al, 2016;van Rijn, Abdulrahman, Brazdil, & Vanschoren, 2015) or pure feature selection methods (Hegde & Mundada, 2020)). Neural Architecture Search (NAS) is usually considered as a distinct category with its own methods and techniques for optimizing the structure of a neural network; hence, articles on NAS were only considered when the problem was addressed as an HPO problem.…”