Dev Builds » 20210617-0008

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:41:19 581046 4000 469 1588 1943 -99.86 ± 5.13 45 1122 741 91 1 -208.68 ± 12.51
ncm-dbt-02 06:39:48 585303 4000 463 1604 1933 -101.93 ± 4.99 41 1136 746 77 0 -214.85 ± 12.45
ncm-dbt-03 06:40:34 586541 4000 444 1579 1977 -101.37 ± 5.17 55 1114 742 89 0 -209.91 ± 12.5
ncm-dbt-04 06:38:56 567092 4000 423 1603 1974 -105.63 ± 5.01 49 1152 729 70 0 -222.67 ± 12.59
ncm-dbt-05 06:39:24 581408 4000 475 1597 1928 -100.14 ± 5.29 57 1112 729 100 2 -206.73 ± 12.62
20000 2274 7971 9755 -101.78 ± 2.29 247 5636 3687 427 3 -212.52 ± 5.6

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
445305 ncm-dbt-01 583196 500 68 210 222 -101.46 ± 14.32 8 134 100 8 0 -207.95 ± 33.99
445304 ncm-dbt-02 585928 500 68 198 234 -92.45 ± 13.59 2 136 102 10 0 -196.45 ± 33.71
445303 ncm-dbt-04 569270 500 62 205 233 -102.22 ± 13.7 6 137 101 6 0 -213.85 ± 33.67
445302 ncm-dbt-05 582068 500 49 203 248 -110.6 ± 14.99 7 153 77 13 0 -234.38 ± 39.07
445301 ncm-dbt-03 586943 500 48 193 259 -103.73 ± 14.65 7 142 90 11 0 -215.85 ± 36.11
445300 ncm-dbt-01 580282 500 54 196 250 -101.46 ± 14.78 5 146 85 14 0 -213.85 ± 37.18
445299 ncm-dbt-02 588132 500 65 200 235 -96.19 ± 14.11 4 138 97 11 0 -202.15 ± 34.7
445298 ncm-dbt-05 582694 500 56 197 247 -100.71 ± 14.77 7 138 95 9 1 -209.91 ± 35.06
445297 ncm-dbt-04 563861 500 45 201 254 -112.14 ± 13.22 4 153 88 5 0 -245.2 ± 36.32
445296 ncm-dbt-03 586604 500 45 195 260 -107.54 ± 13.56 4 149 90 7 0 -232.26 ± 35.99
445295 ncm-dbt-02 584243 500 47 203 250 -112.14 ± 13.89 5 154 83 8 0 -243.0 ± 37.64
445294 ncm-dbt-05 581902 500 57 206 237 -106.77 ± 15.12 9 143 86 12 0 -219.87 ± 36.98
445293 ncm-dbt-01 580987 500 52 197 251 -103.73 ± 14.8 7 143 88 12 0 -215.85 ± 36.55
445292 ncm-dbt-04 565194 500 54 195 251 -100.7 ± 15.35 7 143 84 16 0 -207.95 ± 37.36
445291 ncm-dbt-03 585295 500 58 202 240 -102.97 ± 15.23 10 136 92 12 0 -207.95 ± 35.71
445290 ncm-dbt-02 586266 500 67 196 237 -91.71 ± 13.88 2 137 99 12 0 -194.57 ± 34.34
445289 ncm-dbt-01 579992 500 59 204 237 -103.73 ± 14.03 5 143 95 6 1 -221.9 ± 34.93
445288 ncm-dbt-05 581319 500 67 207 226 -99.95 ± 15.2 9 135 93 13 0 -202.15 ± 35.52
445287 ncm-dbt-04 569669 500 47 192 261 -103.73 ± 14.03 6 141 95 8 0 -217.85 ± 34.98
445286 ncm-dbt-03 586435 500 57 203 240 -104.49 ± 15.1 8 143 86 13 0 -215.85 ± 36.98
445285 ncm-dbt-01 581610 500 74 189 237 -81.36 ± 14.68 7 115 114 14 0 -160.64 ± 31.79
445284 ncm-dbt-02 585126 500 61 206 233 -103.73 ± 13.38 4 143 97 6 0 -221.9 ± 34.46
445283 ncm-dbt-05 579826 500 60 191 249 -93.2 ± 15.51 6 137 90 16 1 -192.71 ± 36.1
445282 ncm-dbt-04 566572 500 52 211 237 -114.45 ± 14.05 9 146 90 5 0 -240.82 ± 35.87
445281 ncm-dbt-03 586012 500 52 198 250 -104.49 ± 14.04 6 142 94 8 0 -219.87 ± 35.19
445280 ncm-dbt-02 582861 500 54 214 232 -115.22 ± 15.0 10 150 80 10 0 -240.82 ± 38.39
445279 ncm-dbt-05 581818 500 56 205 239 -106.77 ± 14.67 7 146 86 11 0 -223.94 ± 36.98
445278 ncm-dbt-01 580447 500 58 191 251 -94.69 ± 14.83 3 144 86 17 0 -200.24 ± 36.91
445277 ncm-dbt-04 567324 500 46 199 255 -109.83 ± 13.23 3 153 88 6 0 -240.82 ± 36.39
445276 ncm-dbt-03 585801 500 67 201 232 -95.44 ± 13.94 4 136 100 10 0 -200.24 ± 34.09
445275 ncm-dbt-05 579951 500 65 197 238 -93.95 ± 14.96 7 132 97 14 0 -190.85 ± 34.75
445274 ncm-dbt-02 584958 500 44 190 266 -104.49 ± 14.96 8 142 88 12 0 -215.85 ± 36.55
445273 ncm-dbt-04 568196 500 62 195 243 -94.69 ± 14.39 5 135 98 12 0 -196.45 ± 34.53
445272 ncm-dbt-01 579661 500 54 197 249 -102.22 ± 14.33 5 144 90 11 0 -215.85 ± 36.11
445271 ncm-dbt-03 587070 500 53 195 252 -101.46 ± 15.22 8 140 88 14 0 -207.95 ± 36.54
445270 ncm-dbt-04 566651 500 55 205 240 -107.54 ± 15.13 9 144 85 12 0 -221.9 ± 37.21
445269 ncm-dbt-05 581693 500 65 191 244 -89.48 ± 14.3 5 128 105 12 0 -183.51 ± 33.24
445268 ncm-dbt-02 584916 500 57 197 246 -99.95 ± 14.0 6 136 100 8 0 -207.95 ± 33.99
445267 ncm-dbt-01 582193 500 50 204 246 -110.6 ± 14.06 5 153 83 9 0 -238.66 ± 37.66
445266 ncm-dbt-03 588174 500 64 192 244 -90.96 ± 15.05 8 126 102 14 0 -181.7 ± 33.83

Commit

Commit ID 55e69dc88d84b627af938fe2a1ee69326db055d2
Author bmc4
Date 2021-06-17 00:08:33 UTC
Simplify reduction when best move doesn't change frequently. STC: LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 40400 W: 3468 L: 3377 D: 33555 Ptnml(0-2): 134, 2734, 14388, 2795, 149 https://tests.stockfishchess.org/tests/view/60c93e5a457376eb8bcab15f LTC: LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 34200 W: 1190 L: 1128 D: 31882 Ptnml(0-2): 22, 998, 15001, 1054, 25 https://tests.stockfishchess.org/tests/view/60c96a1a457376eb8bcab180 closes https://github.com/official-stockfish/Stockfish/pull/3559 bench: 5629669
Copyright 2011–2025 Next Chess Move LLC