“…Multiple attempts to tackle hyperparameter optimization problem can be identified in the literature, particularly using simulated annealing (Boardman and Trappenberg, 2006), its adoption to grid search (Jimenez et al, 2009), evolutionary techniques (Wu et al, 2007;Friedrichs and Igel, 2005), particle swarm optimization (Li-xia et al, 2011;Yongqi, 2012;Garšva and Danėnas, 2014), firefly algorithm (Chao and Horng, 2015). Other works focus on combined selection of both features and hyperparameters (Maali and Al-Jumaily, 2012;Yao et al, 2009;Sunkad, 2016). Osman et al (2017) showed empirically that optimized hyperparameters significantly improved performance for k-nearest neighbours algorithm while prediction accuracy of support vector machines either improved or was at least retained.…”