Dev Builds » 20200225-2010

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	06:26:49	582873	4002	52 2612 1338	-263.23 ± 6.74	631 1298 72 0 0	-694.82 ± 40.82
ncm-dbt-02	06:26:50	586351	4010	62 2615 1333	-261.46 ± 6.8	632 1289 84 0 0	-667.86 ± 37.69
ncm-dbt-03	06:25:31	586300	4000	53 2616 1331	-263.86 ± 6.73	630 1305 63 2 0	-707.46 ± 43.71
ncm-dbt-04	06:26:03	567595	3988	53 2620 1315	-265.59 ± 6.87	645 1278 70 1 0	-694.2 ± 41.42
ncm-dbt-05	06:26:21	581810	4000	71 2605 1324	-259.62 ± 6.87	628 1280 90 2 0	-647.44 ± 36.37
			20000	291 13068 6641	-262.74 ± 3.04	3166 6450 379 5 0	-681.02 ± 17.54

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
451791	ncm-dbt-01	580987	2	0 1 1	-189.7 ± 55.98	0 1 0 0 0	-1129.65 ± 376.02	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1101634065 \ -pgnout ncm-dbt-20200225-2010-042.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451790	ncm-dbt-02	585253	10	0 8 2	-380.95 ± 484.13	3 2 0 0 0	-1199.83 ± 231.31	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2381418589 \ -pgnout ncm-dbt-20200225-2010-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451789	ncm-dbt-04	565863	488	7 331 150	-277.88 ± 20.9	88 148 8 0 0	-711.22 ± 146.49	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 510271361 \ -pgnout ncm-dbt-20200225-2010-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451788	ncm-dbt-05	585970	500	7 318 175	-253.02 ± 18.37	71 170 8 1 0	-676.08 ± 142.43	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2218492528 \ -pgnout ncm-dbt-20200225-2010-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451787	ncm-dbt-03	587409	500	6 320 174	-256.44 ± 17.4	70 174 6 0 0	-766.17 ± 188.02	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1675101047 \ -pgnout ncm-dbt-20200225-2010-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451786	ncm-dbt-01	583489	500	7 330 163	-266.96 ± 19.28	81 161 8 0 0	-715.51 ± 146.53	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2698897920 \ -pgnout ncm-dbt-20200225-2010-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451785	ncm-dbt-02	584076	500	6 328 166	-265.77 ± 19.97	83 156 11 0 0	-659.13 ± 116.77	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1866751559 \ -pgnout ncm-dbt-20200225-2010-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451784	ncm-dbt-04	568395	500	6 335 159	-274.22 ± 19.86	86 157 7 0 0	-739.05 ± 163.27	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2928285406 \ -pgnout ncm-dbt-20200225-2010-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451783	ncm-dbt-05	578547	500	7 343 150	-282.94 ± 21.2	94 148 8 0 0	-715.51 ± 146.53	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2007317538 \ -pgnout ncm-dbt-20200225-2010-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451782	ncm-dbt-02	588728	500	7 338 155	-276.68 ± 20.45	89 153 8 0 0	-715.51 ± 146.53	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1610452824 \ -pgnout ncm-dbt-20200225-2010-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451781	ncm-dbt-01	581943	500	8 317 175	-250.76 ± 17.53	68 173 9 0 0	-694.7 ± 134.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1492228025 \ -pgnout ncm-dbt-20200225-2010-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451780	ncm-dbt-03	585464	500	4 341 155	-284.21 ± 20.75	93 151 6 0 0	-766.17 ± 188.02	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 837584642 \ -pgnout ncm-dbt-20200225-2010-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451779	ncm-dbt-04	569111	500	7 340 153	-279.16 ± 21.04	92 149 9 0 0	-694.7 ± 134.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2738814262 \ -pgnout ncm-dbt-20200225-2010-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451778	ncm-dbt-05	582819	500	7 333 160	-270.57 ± 20.83	88 150 12 0 0	-643.67 ± 110.29	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3859450398 \ -pgnout ncm-dbt-20200225-2010-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451777	ncm-dbt-02	587707	500	7 325 168	-261.07 ± 18.55	76 166 8 0 0	-715.51 ± 146.53	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4215214787 \ -pgnout ncm-dbt-20200225-2010-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451776	ncm-dbt-01	583237	500	6 336 158	-275.44 ± 20.59	89 152 9 0 0	-694.7 ± 134.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2779176617 \ -pgnout ncm-dbt-20200225-2010-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451775	ncm-dbt-03	583698	500	11 331 158	-263.41 ± 19.68	81 158 11 0 0	-659.13 ± 116.77	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3813784266 \ -pgnout ncm-dbt-20200225-2010-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451774	ncm-dbt-04	567680	500	7 331 162	-268.16 ± 20.26	85 154 11 0 0	-659.13 ± 116.77	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 235613900 \ -pgnout ncm-dbt-20200225-2010-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451773	ncm-dbt-05	581693	500	7 328 165	-264.59 ± 19.55	80 162 7 1 0	-694.74 ± 156.93	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2150290333 \ -pgnout ncm-dbt-20200225-2010-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451772	ncm-dbt-02	584958	500	6 326 168	-263.41 ± 18.84	78 164 8 0 0	-715.51 ± 146.53	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1532583918 \ -pgnout ncm-dbt-20200225-2010-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451771	ncm-dbt-01	582819	500	4 321 175	-259.9 ± 17.23	71 175 4 0 0	-837.28 ± 240.94	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2883281093 \ -pgnout ncm-dbt-20200225-2010-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451770	ncm-dbt-03	587834	500	8 323 169	-257.59 ± 19.22	76 164 9 1 0	-659.17 ± 131.36	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3198777405 \ -pgnout ncm-dbt-20200225-2010-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451769	ncm-dbt-04	565902	500	11 323 166	-254.15 ± 19.31	76 160 14 0 0	-616.18 ± 100.06	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2023126559 \ -pgnout ncm-dbt-20200225-2010-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451768	ncm-dbt-05	582110	500	9 309 182	-240.82 ± 18.09	66 168 16 0 0	-592.27 ± 92.24	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1251920152 \ -pgnout ncm-dbt-20200225-2010-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451767	ncm-dbt-01	581402	500	0 329 171	-274.22 ± 18.65	82 165 3 0 0	-887.58 ± 222.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 100239484 \ -pgnout ncm-dbt-20200225-2010-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451766	ncm-dbt-02	583950	500	12 322 166	-251.89 ± 19.28	75 160 15 0 0	-603.84 ± 95.91	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3473639193 \ -pgnout ncm-dbt-20200225-2010-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451765	ncm-dbt-03	586393	500	7 322 171	-257.59 ± 18.68	74 168 7 1 0	-694.74 ± 156.93	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 913810636 \ -pgnout ncm-dbt-20200225-2010-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451764	ncm-dbt-04	569230	500	4 325 171	-264.59 ± 19.27	79 164 6 1 0	-715.55 ± 177.2	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1255312570 \ -pgnout ncm-dbt-20200225-2010-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451763	ncm-dbt-02	588345	500	5 328 167	-266.96 ± 19.84	83 157 10 0 0	-676.04 ± 124.55	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2997233587 \ -pgnout ncm-dbt-20200225-2010-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451762	ncm-dbt-01	585885	500	8 337 155	-274.22 ± 21.0	90 149 11 0 0	-659.13 ± 116.77	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2403034901 \ -pgnout ncm-dbt-20200225-2010-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451761	ncm-dbt-05	580779	500	7 335 158	-272.99 ± 19.72	85 158 7 0 0	-739.05 ± 163.27	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1211075452 \ -pgnout ncm-dbt-20200225-2010-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451760	ncm-dbt-03	587113	500	10 319 171	-250.76 ± 18.88	73 163 14 0 0	-616.18 ± 100.06	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2505439176 \ -pgnout ncm-dbt-20200225-2010-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451759	ncm-dbt-04	565390	500	6 327 167	-264.59 ± 18.98	79 163 8 0 0	-715.51 ± 146.53	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3800500000 \ -pgnout ncm-dbt-20200225-2010-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451758	ncm-dbt-01	584159	500	11 321 168	-251.89 ± 19.28	75 160 15 0 0	-603.84 ± 95.91	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1050155691 \ -pgnout ncm-dbt-20200225-2010-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451757	ncm-dbt-03	586350	500	3 333 164	-275.44 ± 19.41	85 160 5 0 0	-798.18 ± 231.48	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4207845626 \ -pgnout ncm-dbt-20200225-2010-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451756	ncm-dbt-05	579868	500	15 322 163	-248.52 ± 19.35	74 159 17 0 0	-581.38 ± 88.96	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2530307926 \ -pgnout ncm-dbt-20200225-2010-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451755	ncm-dbt-02	586435	500	10 327 163	-259.9 ± 19.51	79 159 12 0 0	-643.67 ± 110.29	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2355801860 \ -pgnout ncm-dbt-20200225-2010-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451754	ncm-dbt-04	569190	500	5 308 187	-244.09 ± 16.1	60 183 7 0 0	-739.05 ± 163.27	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 442237045 \ -pgnout ncm-dbt-20200225-2010-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451753	ncm-dbt-03	586139	500	4 327 169	-266.96 ± 18.4	78 167 5 0 0	-798.18 ± 231.48	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1670773796 \ -pgnout ncm-dbt-20200225-2010-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451752	ncm-dbt-05	582694	500	12 317 171	-246.3 ± 18.56	70 165 15 0 0	-603.84 ± 95.91	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 723495756 \ -pgnout ncm-dbt-20200225-2010-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451751	ncm-dbt-02	587707	500	9 313 178	-245.19 ± 17.63	66 172 12 0 0	-643.67 ± 110.29	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3331067551 \ -pgnout ncm-dbt-20200225-2010-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
451750	ncm-dbt-01	581943	500	8 320 172	-254.15 ± 19.05	75 162 13 0 0	-629.41 ± 104.8	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1798595895 \ -pgnout ncm-dbt-20200225-2010-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200225-2010 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2e1369d0302a87d570e509af7041a1be22b836a0 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15

Commit

Commit ID	2e1369d0302a87d570e509af7041a1be22b836a0
Author	AndyGrant
Date	2020-02-25 20:10:10 UTC
Fix TT write in MultiPV case. fixes an error reported earlier as https://github.com/official-stockfish/Stockfish/issues/2404 by @AndyGrant. MultiPV at root shouldn't write to the TT for later lines, as that is neither the eval nor the bestmove for that position. Fixing this error doesn't matter for playing games (http://tests.stockfishchess.org/tests/view/5dcdbd810ebc590256324a11). However, it can lead to wrong mate announcements as reported by @uriblass. In particular the following testcase gives wrong results for the second search, prior to this patch: ``` setoption name MultiPV value 2 position fen 5R2/2kB2p1/p2bR3/8/3p1B2/8/PPP5/2K5 b - - 0 49 go depth 40 position fen 2B2R2/3r2p1/p1kbR3/8/3p1B2/8/PPP5/2K5 b - - 8 48 go depth 40 ``` fixes https://github.com/official-stockfish/Stockfish/issues/2561 closes https://github.com/official-stockfish/Stockfish/pull/2562 Only affects MultiPV search. Bench: 4697493