Dev Builds » 20210522-0535

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:47:53 581806 4000 349 1773 1878 -129.35 ± 5.0 83 1299 577 41 0 -282.0 ± 14.18
ncm-dbt-02 06:47:53 586707 4000 330 1776 1894 -131.54 ± 5.0 80 1331 544 45 0 -290.01 ± 14.62
ncm-dbt-03 06:49:01 585494 4012 354 1807 1851 -131.81 ± 5.1 87 1332 534 53 0 -288.68 ± 14.75
ncm-dbt-04 06:49:20 568074 4014 344 1800 1870 -132.03 ± 5.06 95 1306 566 40 0 -286.86 ± 14.32
ncm-dbt-05 06:47:39 582669 3974 335 1792 1847 -133.6 ± 5.11 101 1293 555 38 0 -289.64 ± 14.46
20000 1712 8948 9340 -131.66 ± 2.26 446 6561 2776 217 0 -287.42 ± 6.46

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
445567 ncm-dbt-03 581735 12 2 5 5 -88.66 ± 75.75 0 3 3 0 0 -190.73 ± 238.47
445566 ncm-dbt-04 565941 14 0 7 7 -190.68 ± 7.94 0 7 0 0 0 -1199.83 ± 201.74
445565 ncm-dbt-05 582903 474 45 210 219 -126.21 ± 15.01 12 146 74 5 0 -266.71 ± 39.87
445564 ncm-dbt-01 583824 500 48 212 240 -118.33 ± 14.03 6 160 76 8 0 -258.75 ± 39.42
445563 ncm-dbt-02 584832 500 39 215 246 -127.76 ± 13.57 7 167 71 5 0 -285.49 ± 40.81
445562 ncm-dbt-03 587070 500 42 217 241 -126.97 ± 14.45 11 159 74 6 0 -273.0 ± 39.95
445561 ncm-dbt-04 566099 500 33 230 237 -144.71 ± 13.67 12 176 59 3 0 -330.23 ± 44.94
445560 ncm-dbt-05 581361 500 39 220 241 -131.74 ± 14.88 15 156 74 5 0 -277.93 ± 39.92
445559 ncm-dbt-01 582235 500 47 216 237 -122.24 ± 14.82 12 152 79 7 0 -256.44 ± 38.62
445558 ncm-dbt-02 586901 500 39 214 247 -126.97 ± 14.11 9 163 72 6 0 -277.93 ± 40.53
445557 ncm-dbt-03 584664 500 49 227 224 -129.35 ± 14.24 8 170 64 8 0 -288.06 ± 43.03
445556 ncm-dbt-04 568514 500 51 226 223 -126.97 ± 14.61 9 166 66 9 0 -277.93 ± 42.33
445555 ncm-dbt-05 586139 500 36 241 223 -151.34 ± 14.56 18 172 57 3 0 -336.46 ± 45.77
445554 ncm-dbt-02 587919 500 41 227 232 -135.76 ± 14.12 12 166 68 4 0 -298.62 ± 41.71
445553 ncm-dbt-01 579992 500 41 224 235 -133.34 ± 14.51 13 162 70 5 0 -288.06 ± 41.11
445552 ncm-dbt-03 587409 500 41 233 226 -140.62 ± 14.35 15 165 67 3 0 -306.84 ± 41.99
445551 ncm-dbt-04 569629 500 44 217 239 -125.38 ± 14.63 12 155 77 6 0 -265.78 ± 39.12
445550 ncm-dbt-05 581194 500 45 215 240 -123.02 ± 13.65 6 164 74 6 0 -273.0 ± 39.95
445549 ncm-dbt-02 588430 500 40 221 239 -131.74 ± 13.49 7 172 66 5 0 -298.62 ± 42.41
445548 ncm-dbt-01 579001 500 48 220 232 -124.6 ± 14.47 9 162 71 8 0 -270.57 ± 40.83
445547 ncm-dbt-03 583405 500 41 221 238 -130.94 ± 13.51 5 177 61 7 0 -301.33 ± 44.13
445546 ncm-dbt-04 566099 500 50 214 236 -118.33 ± 15.15 11 152 77 10 0 -247.41 ± 39.15
445545 ncm-dbt-05 579413 500 38 235 227 -144.71 ± 14.04 14 172 61 3 0 -324.17 ± 44.15
445544 ncm-dbt-02 586731 500 45 226 229 -131.74 ± 13.49 10 163 75 2 0 -290.66 ± 39.4
445543 ncm-dbt-01 581028 500 43 230 227 -136.56 ± 13.73 11 168 68 3 0 -304.07 ± 41.65
445542 ncm-dbt-03 587070 500 48 236 216 -137.37 ± 14.95 15 164 65 6 0 -295.94 ± 42.75
445541 ncm-dbt-04 568236 500 38 235 227 -144.71 ± 14.59 17 166 64 3 0 -315.35 ± 43.03
445540 ncm-dbt-05 584369 500 56 223 221 -120.67 ± 14.35 13 144 90 3 0 -249.64 ± 35.69
445539 ncm-dbt-02 585126 500 48 223 229 -126.97 ± 14.28 9 164 70 7 0 -277.93 ± 41.14
445538 ncm-dbt-01 583279 500 46 223 231 -128.55 ± 13.91 11 158 78 3 0 -277.93 ± 38.66
445537 ncm-dbt-03 585632 500 50 231 219 -131.74 ± 14.88 14 159 71 6 0 -280.42 ± 40.83
445536 ncm-dbt-04 572195 500 47 217 236 -123.02 ± 14.16 10 155 80 5 0 -263.42 ± 38.27
445535 ncm-dbt-05 582027 500 42 224 234 -132.54 ± 13.83 10 166 70 4 0 -293.29 ± 41.07
445534 ncm-dbt-01 582903 500 36 216 248 -130.94 ± 13.51 8 168 70 4 0 -293.29 ± 41.07
445533 ncm-dbt-02 587409 500 42 231 227 -138.18 ± 15.26 15 167 60 8 0 -298.62 ± 44.44
445532 ncm-dbt-03 584159 500 38 223 239 -134.95 ± 14.31 9 175 58 8 0 -304.07 ± 45.19
445531 ncm-dbt-04 567759 500 39 227 234 -137.37 ± 13.71 13 163 73 1 0 -301.33 ± 39.86
445530 ncm-dbt-05 583950 500 34 224 242 -138.99 ± 15.08 13 173 55 9 0 -306.84 ± 46.27
445529 ncm-dbt-02 586308 500 36 219 245 -133.34 ± 14.68 11 169 62 8 0 -293.29 ± 43.72
445528 ncm-dbt-03 588302 500 43 214 243 -123.81 ± 14.81 10 160 71 9 0 -265.78 ± 40.81
445527 ncm-dbt-01 582193 500 40 232 228 -140.62 ± 13.99 13 169 65 3 0 -312.48 ± 42.67
445526 ncm-dbt-04 568196 500 42 227 231 -134.95 ± 13.78 11 166 70 3 0 -298.62 ± 41.01

Commit

Commit ID fb2d175f97a12be6464fdcc20293682a192ca156
Author Joost VandeVondele
Date 2021-05-22 05:35:39 UTC
Update default net to nn-7756374aaed3.nnue trained with pytorch using the master branch and recommended settings, same data set as previously used: python train.py ../../all_d9_fishd9_d8_d10_shuffle.binpack ../../all_d9_fishd9_d8_d10_shuffle.binpack \ --gpus 1 --threads 2 --num-workers 2 --batch-size 16384 --progress_bar_refresh_rate 300 \ --smart-fen-skipping --random-fen-skipping 3 --features=HalfKAv2^ --lambda=1.0 \ --max_epochs=400 --seed $RANDOM --default_root_dir exp/run_8 passed STC: LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 21424 W: 2078 L: 1907 D: 17439 Ptnml(0-2): 80, 1512, 7385, 1627, 108 https://tests.stockfishchess.org/tests/view/60a6c749ce8ea25a3ef03f4d passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 67912 W: 2851 L: 2648 D: 62413 Ptnml(0-2): 40, 2348, 28984, 2537, 47 https://tests.stockfishchess.org/tests/view/60a722ecce8ea25a3ef03fb9 closes https://github.com/official-stockfish/Stockfish/pull/3489 Bench: 3779522
Copyright 2011–2025 Next Chess Move LLC