Leaderboards

fasterfastestoverallresidual-k_001residual-k_002residual-k_003residual-k_005residual-k_008residual-k_013residual-k_021residual-k_034special-k_001special-k_002special-k_003special-k_005special-k_008special-k_013special-k_021special-k_034univariate-k_001univariate-k_002univariate-k_003univariate-k_005univariate-k_008univariate-k_013univariate-k_021univariate-k_034

Accuracy and Speed of Some Short Term Automated Time-Series Forecasting Approaches (Python Packages only)

The Elo Ratings in this table are produced transparently in the repo timeseries-elo-ratings and based on k-step ahead prediction duels using live time series data. See METHODOLOGY.md for interpretation of Elo ratings. The table named univariate-k_002 refers to 2-step ahead prediction, and so forth. Residual leaderboards use so-called z-streams (as explained in An Introduction to Z-Streams).

There is some motivation in the blog post Fast Python Time-Series Forecasting. All algorithms utilized here can be called the same way using the TimeMachines Python package. However, as indicated in the table, some of these draw an important part of their functionality (if not all) from other packages such as Facebook Prophet, Statsmodels TSA, Flux, PmdArima, Uber Orbit and more. Take relative performance with with a grain of salt, since many packages don't intend completely autonomous use and some are aimed at longer term seasonal forecasts. If you have a suggestion for a package or technique that should be included, please file an issue or, even better, add a skater and make a pull request. There is a guide for contributors and a long list of popular time-series packages.

Some of these methods are used in real-time to provide free prediction to anyone who publishes public data using a community API explained at microprediction.com. See the example crawlers folder for examples of algorithms calling the timemachines package. See the knowledge center or contributor guide for instructions on publishing live data that can influence these ratings.

NameRatingGamesActiveSecondsDependencies
elo_faster_univariate_balanced_ensemble2342.0975yes20.1timemachines
orbit_lgt_122226.016yes0.0orbit-ml , timemachines
tsa_p2_d0_q12170.01001yes84.3statsmodels , timemachines
bats_trendy_bc2168.038yes964.9tbats , timemachines
elo_faster_univariate_precision_ensemble2160.01255yes-26.3timemachines
sluggish_moving_average2144.01438yes0.0timemachines
tsa_p1_d0_q12136.0317yes38.5statsmodels , timemachines
elo_fastest_univariate_aggressive_ensemble2131.01269yes1.0timemachines
bats_trendy_arma2116.018yes1772.9tbats , timemachines
merlion_arima2111.038yes34.4timemachines
tsa_aggressive_d0_ensemble2095.028yes672.3statsmodels , timemachines
tsa_p3_d0_q12074.0150yes64.8statsmodels , timemachines
bats_damped2056.025yes1014.4tbats , timemachines
tsa_aggressive_combined_ensemble2034.023yes5620.4statsmodels , timemachines
tsa_balanced_d0_ensemble2031.034yes251.7statsmodels , timemachines
sk_ae_add_damped2014.01445yes15.6sktime , timemachines
tsa_p2_d0_q02012.0529yes35.7statsmodels , timemachines
thinking_fast_and_fast1994.01253yes0.0timemachines
elo_fastest_residual_balanced_ensemble1983.01340yes3.0timemachines
bats_trendy_arma_bc1980.025yes2171.2tbats , timemachines
darts_autoarima1978.025no63.1darts , timemachines
thinking_slow_and_slow1958.01190yes0.1timemachines
elo_faster_residual_precision_ensemble1946.01033yes2.9timemachines
aggressive_ema_ensemble1945.01495yes0.1timemachines
orbit_lgt_241945.015yes0.0orbit-ml , timemachines
thinking_fast_and_slow1927.01146yes0.0timemachines
fbprophet_recursive1923.069yes121.3prophet , timemachines
quick_precision_ema_ensemble1918.01289yes0.2timemachines
slow_balanced_ema_ensemble1893.01758yes0.1timemachines
elo_fastest_univariate_precision_ensemble1885.02040yes0.9timemachines
fbprophet_exogenous_hypocratic1879.066yes125.9prophet , timemachines
divine_univariate1875.095yes-0.1divinity , timemachines
elo_faster_univariate_aggressive_ensemble1866.01188yes26.0timemachines
tsa_precision_theta_ensemble1858.01044yes-3.5statsmodels , timemachines
divine_univariate_hypocratic_fast1856.098yes-0.1divinity , timemachines
thinking_slow_and_fast1855.01816yes0.0timemachines
elo_fastest_univariate_balanced_ensemble1842.01296yes1.5timemachines
bats_damped_arma1842.021yes1971.6tbats , timemachines
divine_univariate_hypocratic_slow1835.0147yes-0.1divinity , timemachines
elo_fastest_residual_precision_ensemble1804.01456yes2.0timemachines
bats_trendy1787.036yes901.0tbats , timemachines
elo_faster_residual_aggressive_ensemble1774.0711yes-0.9timemachines
bats_arma_bc1762.028yes2280.1tbats , timemachines
tsa_balanced_combined_ensemble1758.055yes943.9statsmodels , timemachines
rvr_slowly_hypocratic1740.0653yes0.7river , timemachines
tsa_p3_d0_q01736.0392yes43.1statsmodels , timemachines
tsa_precision_d0_ensemble1732.069yes1255.8statsmodels , timemachines
sk_autoarima1726.0126yes183.9sktime , timemachines
tsa_precision_combined_ensemble1718.056yes484.5statsmodels , timemachines
bats_damped_bc1704.032yes1219.4tbats , timemachines
smdk_p5_d0_q3_n500_aggressive1700.0806yes24.9simdkalman , timemachines
bats_bc1690.050yes272.2tbats , timemachines
elo_fastest_residual_aggressive_ensemble1689.01097yes1.8timemachines
fbprophet_univariate1680.0127yes161.4prophet , timemachines
precision_ema_ensemble1676.01747yes0.1timemachines
elo_faster_residual_balanced_ensemble1664.01053yes3.5timemachines
slow_aggressive_ema_ensemble1661.01152yes0.2timemachines
bats_damped_arma_bc1660.017yes3256.9tbats , timemachines
thinking_precision_ensemble1641.089yes0.5timemachines
slow_precision_ema_ensemble1632.01163yes0.1timemachines
fbprophet_known1630.065yes125.0prophet , timemachines
darts_theta1618.067no1.4darts , timemachines
pmd_univariate1608.0811yes-4.1pmdarima , timemachines
regress_change_on_first_known16000no-1.0timemachines
tsa_p1_d1_q016000no-1.0statsmodels , timemachines
tsa_p2_d1_q016000no-1.0statsmodels , timemachines
tsa_p3_d1_q016000no-1.0statsmodels , timemachines
sk_ae_mul16000no-0.1sktime , timemachines
sk_ae_mul_damped16000no-0.1sktime , timemachines
rvr_p3_d0_q016000no-1.0river , timemachines
rvr_aggressive_ensemble16000no-1.0river , timemachines
dlm_univariate_a16000no-1.0pydlm , timemachines
dlm_univariate_b16000no-1.0pydlm , timemachines
darts_nbeats16000no-1.0darts , timemachines
balanced_ema_ensemble1596.01633yes-0.2timemachines
quick_balanced_ema_ensemble1581.01225yes0.1timemachines
sk_ae_add1563.02056yes12.4sktime , timemachines
tsa_aggressive_theta_ensemble1559.01681yes2.6statsmodels , timemachines
bats_arma1539.026yes1550.3tbats , timemachines
nprophet_p31536.0411yes83.3neuralprophet , timemachines
quick_aggressive_ema_ensemble1529.03134yes0.2timemachines
pycrt_mean_81518.01no3386.1pycaret , timemachines
pycrt_median_31515.01no2389.6pycaret , timemachines
sk_theta1511.01246yes0.8sktime , timemachines
pycrt_median_3_full1505.01yes10324.9pycaret , timemachines
darts_four_theta1504.0111no1.5darts , timemachines
pmd_exogenous_hypocratic1501.01006yes4.1pmdarima , timemachines
darts_arima1500.075no12.0darts , timemachines
smdk_p5_d0_q3_n10001473.0607yes69.9simdkalman , timemachines
fbprophet_cautious1471.063yes143.3prophet , timemachines
nprophet_p1_hypocratic1470.0488yes62.3neuralprophet , timemachines
suc_tsa_p2_d0_q11458.0103no3.0successor , timemachines
merlion_prophet1456.075yes33.4timemachines
tsa_balanced_theta_ensemble1448.01225yes2.5statsmodels , timemachines
nprophet_p21444.0666yes73.6neuralprophet , timemachines
suc_quick_aggressive_ema_ensemble1439.089no4.3successor , timemachines
pycrt_median_81432.02no2288.3pycaret , timemachines
nprophet_p5_hypocratic1427.0562yes65.4neuralprophet , timemachines
tsa_p1_d0_q01419.0717yes54.0statsmodels , timemachines
pycrt_mean_31419.02no3660.3pycaret , timemachines
darts_fft1414.089no0.7darts , timemachines
rvr_quickly_hypocratic1413.0820yes0.4river , timemachines
smdk_p5_d0_q3_n5001412.0911yes-16.9simdkalman , timemachines
slowly_moving_average1406.01597yes0.0timemachines
fbprophet_univariate_hypocratic1402.056yes208.3prophet , timemachines
fbprophet_cautious_hypocratic1388.057yes232.1prophet , timemachines
darts_exp_smoothing1368.0187no9.9darts , timemachines
bats_fast1333.035yes714.8tbats , timemachines
smdk_p5_d0_q3_n1000_aggressive1305.0678yes49.6simdkalman , timemachines
gk_basic_skater1298.09yes3661.4greykite , timemachines
nprophet_p81280.0490yes36.1neuralprophet , timemachines
nprophet_p8_hypocratic1277.0433yes67.9neuralprophet , timemachines
darts_prophet1276.020no77.6darts , timemachines
sk_ae1272.01377yes11.6sktime , timemachines
nprophet_p11253.01255yes61.7neuralprophet , timemachines
fbprophet_univariate_univariate_hypocratic1229.042yes473.4prophet , timemachines
nprophet_p51225.0450yes63.7neuralprophet , timemachines
quickly_moving_average1220.01228yes0.0timemachines
fbprophet_exogenous1198.0125yes174.8prophet , timemachines
fbprophet_exogenous_exogenous1076.053yes529.8prophet , timemachines
nprophet_p2_hypocratic1061.0556yes51.9neuralprophet , timemachines
tsa_slowly_hypocratic_d0_ensemble1040.088yes469.5statsmodels , timemachines
suc_tsa_aggressive_d0_ensemble1021.023yes2.7successor , timemachines
rapidly_moving_average1005.01479yes0.0timemachines
rvr_p2_d0_q0940.0756yes0.1river , timemachines
rvr_p1_d0_q0935.0944yes0.0river , timemachines
empirical_last_value934.0884yes0.0timemachines
rvr_balanced_ensemble902.0729yes0.3river , timemachines
tsa_quickly_hypocratic_d0_ensemble885.054yes4522.7statsmodels , timemachines
nprophet_p3_hypocratic811.0489yes36.9neuralprophet , timemachines
merlion_mses754.014yes190.6timemachines
rvr_p5_d0_q0677.0623yes0.1river , timemachines
rvr_p8_d0_q0584.0645yes0.1river , timemachines