Dev Builds » 20210628-1931

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:58:29 583721 4000 493 1553 1954 -94.32 ± 5.07 28 1110 756 106 0 -198.34 ± 12.39
ncm-dbt-02 06:58:49 586779 4000 479 1549 1972 -95.26 ± 4.91 17 1127 766 89 1 -203.59 ± 12.29
ncm-dbt-03 07:01:04 586395 4016 502 1539 1975 -91.79 ± 5.09 29 1092 774 113 0 -191.77 ± 12.24
ncm-dbt-04 06:59:04 567804 4000 488 1526 1986 -92.27 ± 5.14 36 1076 778 110 0 -191.31 ± 12.21
ncm-dbt-05 06:59:12 580976 3984 515 1554 1915 -92.75 ± 4.99 29 1072 801 89 1 -194.35 ± 12.0
20000 2477 7721 9802 -93.28 ± 2.25 139 5477 3875 507 2 -195.84 ± 5.46

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
453219 ncm-dbt-03 586689 16 3 7 6 -88.68 ± 136.3 1 4 1 2 0 -136.97 ± 398.73
453218 ncm-dbt-05 581361 484 60 178 246 -86.44 ± 14.24 2 127 100 13 0 -181.4 ± 34.14
453217 ncm-dbt-04 569549 500 70 187 243 -82.83 ± 14.14 2 128 105 15 0 -172.78 ± 33.32
453216 ncm-dbt-01 585084 500 66 189 245 -87.26 ± 14.69 4 131 99 16 0 -179.9 ± 34.4
453215 ncm-dbt-02 586604 500 57 200 243 -102.22 ± 13.21 0 152 89 9 0 -226.0 ± 36.29
453214 ncm-dbt-03 587282 500 64 195 241 -93.2 ± 13.6 3 134 104 9 0 -196.45 ± 33.3
453213 ncm-dbt-05 578918 500 59 196 245 -97.69 ± 13.66 4 137 101 8 0 -206.01 ± 33.8
453212 ncm-dbt-04 567205 500 57 184 259 -90.22 ± 15.03 3 140 88 19 0 -189.0 ± 36.45
453211 ncm-dbt-01 583321 500 59 185 256 -89.48 ± 14.88 6 129 100 15 0 -181.7 ± 34.21
453210 ncm-dbt-02 586562 500 65 192 243 -90.22 ± 14.16 5 128 106 11 0 -185.33 ± 33.03
453209 ncm-dbt-03 586774 500 58 192 250 -95.44 ± 13.79 3 138 99 10 0 -202.15 ± 34.28
453208 ncm-dbt-05 581652 500 70 205 225 -96.19 ± 13.8 6 130 107 7 0 -198.34 ± 32.63
453207 ncm-dbt-04 567047 500 67 194 239 -90.22 ± 14.31 7 123 110 10 0 -181.7 ± 32.28
453206 ncm-dbt-01 583070 500 54 192 254 -98.44 ± 14.29 3 145 89 13 0 -209.91 ± 36.34
453205 ncm-dbt-02 587409 500 64 191 245 -90.22 ± 13.7 2 134 103 11 0 -190.85 ± 33.57
453204 ncm-dbt-03 586139 500 63 189 248 -89.48 ± 14.44 2 138 94 16 0 -189.0 ± 35.33
453203 ncm-dbt-05 581070 500 65 200 235 -96.19 ± 14.56 5 138 94 13 0 -200.24 ± 35.32
453202 ncm-dbt-04 567601 500 57 201 242 -102.97 ± 13.54 3 146 93 8 0 -221.9 ± 35.4
453201 ncm-dbt-01 582193 500 60 196 244 -96.94 ± 13.65 2 142 96 10 0 -207.95 ± 34.86
453200 ncm-dbt-02 586139 500 60 192 248 -93.95 ± 13.92 1 143 93 13 0 -202.15 ± 35.52
453199 ncm-dbt-03 586774 500 59 191 250 -93.95 ± 13.92 3 137 99 11 0 -198.34 ± 34.31
453198 ncm-dbt-05 577725 500 68 197 235 -91.71 ± 13.88 4 131 105 10 0 -190.85 ± 33.16
453197 ncm-dbt-04 567126 500 55 179 266 -88.0 ± 14.7 4 132 98 16 0 -181.7 ± 34.58
453196 ncm-dbt-01 582694 500 59 190 251 -93.2 ± 14.36 4 136 97 13 0 -194.57 ± 34.74
453195 ncm-dbt-02 586308 500 57 200 243 -102.22 ± 14.48 3 150 85 11 1 -221.9 ± 37.21
453194 ncm-dbt-03 588856 500 65 185 250 -85.04 ± 14.49 3 130 101 16 0 -176.33 ± 34.04
453193 ncm-dbt-05 583237 500 69 192 239 -87.26 ± 14.69 3 133 99 14 1 -183.51 ± 34.39
453192 ncm-dbt-04 568474 500 64 197 239 -94.69 ± 14.39 5 135 98 12 0 -196.45 ± 34.53
453191 ncm-dbt-02 586858 500 59 199 242 -99.95 ± 13.84 3 144 93 10 0 -213.85 ± 35.47
453190 ncm-dbt-01 583489 500 60 201 239 -100.7 ± 14.77 3 151 80 16 0 -215.85 ± 38.24
453189 ncm-dbt-03 584369 500 63 194 243 -93.2 ± 14.66 6 132 99 13 0 -190.85 ± 34.36
453188 ncm-dbt-05 582235 500 62 191 247 -91.71 ± 14.04 2 138 97 13 0 -194.57 ± 34.74
453187 ncm-dbt-04 564644 500 62 196 242 -95.44 ± 14.99 6 137 92 15 0 -196.45 ± 35.72
453186 ncm-dbt-02 587409 500 58 192 250 -95.44 ± 13.79 3 138 99 10 0 -202.15 ± 34.28
453185 ncm-dbt-01 584706 500 76 203 221 -90.22 ± 14.01 5 127 108 10 0 -185.33 ± 32.63
453184 ncm-dbt-03 584327 500 56 188 256 -93.95 ± 14.82 4 140 90 16 0 -196.45 ± 36.11
453183 ncm-dbt-05 581610 500 62 195 243 -94.69 ± 13.93 3 138 98 11 0 -200.24 ± 34.5
453182 ncm-dbt-02 586943 500 59 183 258 -88.0 ± 13.81 0 138 98 14 0 -189.0 ± 34.56
453181 ncm-dbt-01 585211 500 59 197 244 -98.44 ± 13.98 1 149 87 13 0 -213.85 ± 36.76
453180 ncm-dbt-04 570789 500 56 188 256 -93.95 ± 14.96 6 135 94 15 0 -192.71 ± 35.33
453179 ncm-dbt-03 586350 500 71 198 231 -90.22 ± 15.31 4 139 87 20 0 -187.16 ± 36.61

Commit

Commit ID 49283d3a6676e114b531d6a8b9e5f69000655912
Author SFisGOD
Date 2021-06-28 19:31:58 UTC
Update default net to nn-3475407dc199.nnue Optimization of eight subnetwork output layers of Michael's nn-190f102a22c3.nnue using SPSA https://tests.stockfishchess.org/tests/view/60d5510642a522cc50282ef3 Parameters: A total of 256 net weights and 8 net biases were tuned New best values: The raw values at the end of the tuning run were used (800k games, 5 seconds TC) Settings: default ck value and SPSA A is 30,000 (3.75% of the total number of games) STC: LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 29064 W: 2435 L: 2269 D: 24360 Ptnml(0-2): 72, 1857, 10505, 2029, 69 https://tests.stockfishchess.org/tests/view/60d8ea123beab81350ac9eb6 LTC: LLR: 2.93 (-2.94,2.94) <0.50,3.50> Total: 61848 W: 2055 L: 1884 D: 57909 Ptnml(0-2): 18, 1708, 27310, 1861, 27 https://tests.stockfishchess.org/tests/view/60d8f0393beab81350ac9ec6 closes https://github.com/official-stockfish/Stockfish/pull/3593 Bench: 4770936
Copyright 2011–2026 Next Chess Move LLC