Optimizer Elo Ratings
Produced by
optimizer-elo-ratings using
the
humpday package. See the
article.
Class of objective functions: all
Dimension 21
Function evaluation limit: 550
| Name | Rating | Games | Active |
|---|
| bobyqa_default | 2631.0 | 434 | yes |
| bobyqa_noise | 2598.0 | 461 | yes |
| nevergrad_oneplus | 2167.0 | 55 | no |
| dlib | 2114.0 | 475 | yes |
| scipy_slsqp | 2094.0 | 412 | yes |
| dlib_default | 2050.0 | 479 | yes |
| nevergrad_ngopt4 | 2005.0 | 48 | no |
| nevergrad_ngopt8 | 1998.0 | 48 | no |
| nevergrad_ngopt | 1977.0 | 50 | no |
| ultraopt_etpe | 1977.0 | 139 | no |
| pymoo_pattern | 1931.0 | 22 | no |
| nlopt_directr | 1924.0 | 25 | no |
| freelunch_sa_21 | 1799.0 | 11 | no |
| pymoo_nsga3 | 1790.0 | 27 | no |
| freelunch_sade_21 | 1786.0 | 9 | no |
| nlopt_esch | 1769.0 | 19 | no |
| scipy_powell | 1718.0 | 389 | yes |
| freelunch_de_8 | 1712.0 | 13 | no |
| platypus_omopso | 1709.0 | 27 | no |
| nlopt_direct | 1688.0 | 27 | no |
| freelunch_sa_3 | 1687.0 | 7 | no |
| platypus_epsmoea | 1658.0 | 29 | no |
| freelunch_pso_21 | 1651.0 | 8 | no |
| freelunch_sade_8 | 1644.0 | 12 | no |
| freelunch_sa_8 | 1638.0 | 8 | no |
| platypus_evolutionary | 1613.0 | 22 | no |
| platypus_moead | 1612.0 | 27 | no |
| freelunch_pso_3 | 1605.0 | 4 | no |
| platypus_genetic | 1600.0 | 29 | no |
| optuna_random_clone_1 | 1600 | 61 | no |
| optuna_random_clone | 1600 | 51 | no |
| optuna_random_clone_2 | 1600 | 48 | no |
| optuna_random | 1600 | 45 | no |
| shgo_slsqp_sobol | 1600 | 0 | yes |
| shgo_powell_sobol | 1600 | 0 | yes |
| shgo_nelder_sobol | 1600 | 0 | yes |
| skopt_gp_default | 1600 | 0 | yes |
| pysot_ei | 1600 | 0 | no |
| pysot_lcb | 1600 | 0 | no |
| pysot_random | 1600 | 0 | no |
| pysot_srbf | 1600 | 0 | no |
| pysot_dycors | 1600 | 0 | no |
| ax_default | 1600 | 0 | no |
| optuna_cmaes | 1600 | 0 | no |
| platypus_cmaes | 1600 | 0 | no |
| pymoo_unsga3 | 1600 | 0 | no |
| ultraopt_gbrt | 1600 | 0 | no |
| bayesopt_ucb | 1600 | 0 | no |
| bayesopt_ei | 1600 | 0 | no |
| bayesopt_poi | 1600 | 0 | no |
| nlopt_ags | 1600 | 0 | no |
| hebo_sequential | 1600 | 0 | no |
| hebo_batch | 1600 | 0 | no |
| freelunch_krillherd_3 | 1600 | 0 | no |
| freelunch_krillherd_8 | 1600 | 0 | no |
| optuna_tpe | 1595.0 | 52 | no |
| freelunch_de_21 | 1594.0 | 6 | no |
| scipy_lbfgsb | 1592.0 | 174 | yes |
| platypus_nsgaii | 1566.0 | 24 | no |
| pymoo_nelder | 1562.0 | 16 | no |
| nevergrad_hammersley | 1560.0 | 52 | no |
| platypus_smpso | 1546.0 | 19 | no |
| platypus_ibea | 1537.0 | 26 | no |
| nlopt_crs2lm | 1534.0 | 17 | no |
| nevergrad_de | 1529.0 | 50 | no |
| ultraopt_forest | 1524.0 | 116 | no |
| freelunch_pso_8 | 1513.0 | 10 | no |
| nlopt_directl | 1496.0 | 20 | no |
| nevergrad_portfolio | 1481.0 | 48 | no |
| nlopt_isres | 1467.0 | 21 | no |
| freelunch_sade_3 | 1456.0 | 6 | no |
| pymoo_nsga2 | 1366.0 | 14 | no |
| platypus_spea2 | 1362.0 | 21 | no |
| freelunch_de_3 | 1340.0 | 17 | no |
| platypus_gde3 | 1220.0 | 26 | no |
| nlopt_directo | 1148.0 | 35 | no |
| hyperopt_atpe | 1105.0 | 496 | yes |
| hyperopt_tpe | 956.0 | 457 | yes |
| hyperopt_rand | 941.0 | 466 | yes |
| ultraopt_random | 835.0 | 138 | no |