Dev Builds » 20200131-1848

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:26:50 584330 4000 54 2571 1375 -257.16 ± 6.61 599 1320 80 1 0 -671.7 ± 38.66
ncm-dbt-02 06:26:49 585923 4010 52 2576 1382 -257.26 ± 6.33 580 1364 61 0 0 -724.46 ± 44.5
ncm-dbt-03 06:28:13 585544 4004 47 2575 1382 -258.38 ± 6.52 597 1335 69 1 0 -697.39 ± 41.73
ncm-dbt-04 06:26:40 567624 4000 48 2586 1366 -260.2 ± 6.62 609 1322 67 2 0 -697.21 ± 42.34
ncm-dbt-05 06:28:25 580690 3986 54 2590 1342 -261.2 ± 6.68 616 1304 73 0 0 -691.67 ± 40.53
20000 255 12898 6847 -258.84 ± 2.93 3001 6645 350 4 0 -695.72 ± 18.26

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
451921 ncm-dbt-03 585379 4 0 2 2 -190.27 ± 27.79 0 2 0 0 0 -1199.83 ± 312.71
451920 ncm-dbt-02 583992 10 0 7 3 -300.84 ± 179.63 2 3 0 0 0 -1199.83 ± 231.31
451919 ncm-dbt-05 579992 486 2 323 161 -275.75 ± 19.45 82 157 4 0 0 -832.31 ± 243.44
451918 ncm-dbt-04 568951 500 6 316 178 -251.89 ± 18.5 71 169 9 1 0 -659.17 ± 131.36
451917 ncm-dbt-02 586985 500 9 317 174 -249.64 ± 17.67 68 172 10 0 0 -676.04 ± 124.55
451916 ncm-dbt-01 584748 500 8 317 175 -250.76 ± 18.62 71 168 10 1 0 -643.7 ± 122.54
451915 ncm-dbt-03 585295 500 6 332 162 -270.57 ± 20.0 85 156 9 0 0 -694.7 ± 134.18
451914 ncm-dbt-05 579166 500 9 320 171 -253.02 ± 18.37 72 167 11 0 0 -659.13 ± 116.77
451913 ncm-dbt-04 565312 500 6 328 166 -265.77 ± 19.41 81 160 9 0 0 -694.7 ± 134.18
451912 ncm-dbt-02 587877 500 6 323 171 -259.9 ± 17.83 73 171 6 0 0 -766.17 ± 188.02
451911 ncm-dbt-03 585801 500 1 330 169 -274.22 ± 18.96 83 163 4 0 0 -837.28 ± 240.94
451910 ncm-dbt-01 584285 500 7 322 171 -257.59 ± 18.68 75 165 10 0 0 -676.04 ± 124.55
451909 ncm-dbt-05 584159 500 7 326 167 -262.24 ± 18.98 78 163 9 0 0 -694.7 ± 134.18
451908 ncm-dbt-04 567680 500 3 328 169 -269.36 ± 18.38 79 167 4 0 0 -837.28 ± 240.94
451907 ncm-dbt-02 587792 500 5 329 166 -268.16 ± 19.13 81 162 7 0 0 -739.05 ± 163.27
451906 ncm-dbt-01 587070 500 9 320 171 -253.02 ± 18.37 72 167 11 0 0 -659.13 ± 116.77
451905 ncm-dbt-03 585843 500 5 322 173 -259.9 ± 17.83 73 171 6 0 0 -766.17 ± 188.02
451904 ncm-dbt-05 582819 500 3 325 172 -265.77 ± 18.55 78 166 6 0 0 -766.17 ± 188.02
451903 ncm-dbt-04 567720 500 9 335 156 -270.57 ± 21.63 90 147 12 1 0 -616.2 ± 109.19
451902 ncm-dbt-02 585379 500 6 318 176 -254.15 ± 17.68 70 172 8 0 0 -715.51 ± 146.53
451901 ncm-dbt-03 586181 500 4 312 184 -249.64 ± 16.82 65 178 7 0 0 -739.05 ± 163.27
451900 ncm-dbt-01 583196 500 7 325 168 -261.07 ± 18.83 77 164 9 0 0 -694.7 ± 134.18
451899 ncm-dbt-02 585759 500 6 321 173 -257.59 ± 18.12 73 169 8 0 0 -715.51 ± 146.53
451898 ncm-dbt-05 578753 500 8 325 167 -259.9 ± 18.69 76 165 9 0 0 -694.7 ± 134.18
451897 ncm-dbt-04 566888 500 7 321 172 -256.44 ± 18.25 73 168 9 0 0 -694.7 ± 134.18
451896 ncm-dbt-03 584076 500 6 315 179 -250.76 ± 17.81 69 171 10 0 0 -676.04 ± 124.55
451895 ncm-dbt-01 583698 500 6 318 176 -254.15 ± 17.68 70 172 8 0 0 -715.51 ± 146.53
451894 ncm-dbt-02 586646 500 3 323 174 -263.41 ± 17.66 74 172 4 0 0 -837.28 ± 240.94
451893 ncm-dbt-05 583656 500 8 322 170 -256.44 ± 18.8 75 164 11 0 0 -659.13 ± 116.77
451892 ncm-dbt-04 565548 500 8 321 171 -255.29 ± 18.66 74 165 11 0 0 -659.13 ± 116.77
451891 ncm-dbt-03 587367 500 10 309 181 -239.73 ± 16.91 61 177 12 0 0 -643.67 ± 110.29
451890 ncm-dbt-01 584874 500 9 326 165 -259.9 ± 19.78 80 157 13 0 0 -629.41 ± 104.8
451889 ncm-dbt-02 582485 500 10 312 178 -243.0 ± 17.07 63 176 11 0 0 -659.13 ± 116.77
451888 ncm-dbt-05 576823 500 11 326 163 -257.59 ± 19.75 79 157 14 0 0 -616.18 ± 100.06
451887 ncm-dbt-04 570068 500 4 324 172 -263.41 ± 17.97 75 170 5 0 0 -798.18 ± 231.48
451886 ncm-dbt-01 582360 500 4 318 178 -256.44 ± 18.53 74 166 10 0 0 -676.04 ± 124.55
451885 ncm-dbt-03 584495 500 9 327 164 -261.07 ± 20.7 83 153 13 1 0 -603.86 ± 103.96
451884 ncm-dbt-04 568832 500 5 313 182 -249.64 ± 17.11 66 176 8 0 0 -715.51 ± 146.53
451883 ncm-dbt-02 586393 500 7 326 167 -262.24 ± 18.41 76 167 7 0 0 -739.05 ± 163.27
451882 ncm-dbt-01 584411 500 4 325 171 -264.59 ± 19.27 80 161 9 0 0 -694.7 ± 134.18
451881 ncm-dbt-05 580157 500 6 323 171 -259.9 ± 18.69 76 165 9 0 0 -694.7 ± 134.18
451880 ncm-dbt-03 585464 500 6 326 168 -263.41 ± 18.84 78 164 8 0 0 -715.51 ± 146.53

Commit

Commit ID 6ccb1cac5aaaf7337da8b1738448793be63fdfdb
Author Joost VandeVondele
Date 2020-01-31 18:48:44 UTC
Revert 5 recent patches Revert 5 patches which were merged, but lead to a regression test that showed negative Elo gain: http://tests.stockfishchess.org/tests/view/5e307251ab2d69d58394fdb9 This was discussed in depth in: https://github.com/official-stockfish/Stockfish/issues/2531 Each patch was removed and tested as a simplification, full list below, and the whole combo as well. After the revert the regression test showed a neutral result: http://tests.stockfishchess.org/tests/view/5e334851708b13464ceea33c As a result of this experience, the SPRT testing bounds will be made more strict. Reverted patches: 1 Dynamic Complexity 6d0eabd5fe2961551477820ab7619e2c31e01ffd : STC 10+0.1 https://tests.stockfishchess.org/tests/view/5e31fcacec661e2e6a340d08 : LLR: 2.97 (-2.94,2.94) {-1.50,0.50} Total: 38130 W: 7326 L: 7189 D: 23615 Ptnml(0-2): 677, 4346, 8843, 4545, 646 LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e32c18fec661e2e6a340d73 : LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 38675 W: 4941 L: 4866 D: 28868 Ptnml(0-2): 270, 3556, 11429, 3584, 291 3 More bonus for bestMoves on past PV nodes 71e0b5385e2717679a57c6b77d8c7ac5fff3b89f : STC 10+0.1 https://tests.stockfishchess.org/tests/view/5e31fe93ec661e2e6a340d10 : LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 46100 W: 8853 L: 8727 D: 28520 Ptnml(0-2): 796, 5297, 10749, 5387, 813 LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e32c187ec661e2e6a340d71 : LLR: 2.96 (-2.94,2.94) {-1.50,0.50} Total: 16920 W: 2161 L: 2055 D: 12704 Ptnml(0-2): 115, 1498, 5006, 1569, 130 4 Tweak Restricted Piece Bonus 0ae00454ba6928d181b46103e5c83e6d58fcebe5 : STC 10+0.1 https://tests.stockfishchess.org/tests/view/5e31fefaec661e2e6a340d15 : LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 88328 W: 17060 L: 16997 D: 54271 Ptnml(0-2): 1536, 10446, 20169, 10422, 1581 LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e32c17aec661e2e6a340d6f : LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 34784 W: 4551 L: 4466 D: 25767 Ptnml(0-2): 255, 3279, 10061, 3345, 262 5 History update for pruned captures 01b6088af39902001d2d6844561b6a2faa549282 : STC 10+0.1 https://tests.stockfishchess.org/tests/view/5e31ff5eec661e2e6a340d1a : LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 29541 W: 5735 L: 5588 D: 18218 Ptnml(0-2): 483, 3445, 6820, 3469, 545 LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e32c196ec661e2e6a340d75 : LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 22177 W: 2854 L: 2757 D: 16566 Ptnml(0-2): 143, 2005, 6555, 2055, 164 6 Tweak trapped rook penalty 18fc21eba0368fd5e3c4c4b8ee1000c9ac445425 : STC 10+0.1 https://tests.stockfishchess.org/tests/view/5e31ffb1ec661e2e6a340d1c : LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 24476 W: 4727 L: 4569 D: 15180 Ptnml(0-2): 390, 2834, 5659, 2933, 417 LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e32c19eec661e2e6a340d77 : LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 97332 W: 12492 L: 12466 D: 72374 Ptnml(0-2): 690, 9107, 28738, 9034, 720 All 5 as one simplification : LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e334098708b13464ceea330 : LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 7829 W: 1079 L: 964 D: 5786 Ptnml(0-2): 52, 690, 2281, 781, 65 Bench: 5153165
Copyright 2011–2026 Next Chess Move LLC