Below you can download Jeroen Noomen's "Low Draw Rate Testset" - version 3. Added are the most interesting lines from the TCEC 21 superfinal. A couple of lines by GM Matthew Sadler were selected as well, but these were altered slightly to make them unique.
All lines in this set have a Leela Chess Zero book exit of +0.35 or higher. This is necessary to get interesting games and a reasonable amount of wins. In engine-engine matches both engines have to defend the weaker line, in the return they can try to turn the advantage into a win.
Currently balanced lines and/or top GM lines are not an option anymore for the best engines. Selecting such lines will lead to a result of (close to) 100% draws. And the games will be uninteresting as well. To avoid this, opening lines have to be unbalanced.
Noomen Low Draw Rate Testset v3
donderdag 12 augustus 2021
vrijdag 6 augustus 2021
The TCEC 21 superfinal finished on Saturday, August 7th. Stockfish prolonged its title by beating Leela Chess Zero by 56-44. Stockfish won 19 games, Leela won 7 games and 74 games ended in a draw.
22 lines ended decisive, i.e. in a 1.5-0.5 score. Only 2 lines ended with two wins.
Via the link below you can download the TCEC 21 superfinal opening PGN. The odd numbered lines were selected by GM Matthew Sadler. The even numbered lines were selected by Jeroen Noomen.
TCEC 21 superfinal PGN
dinsdag 1 juni 2021
Here is a new testset for engine-engine testing: Noomen_LowDrawRate_v2. This is a selection of TCEC superfinal opening lines (S9 through S20) with the following criteria:
- Leela Chess Zero book exit of +0.35 or higher
- Good chance of a 1.5-0.5 result between the strongest engines
Using this special book for engine-engine testing will lead to:
- Exciting games
- More decisive results
zaterdag 8 mei 2021
I am excited to announce that the TCEC 21 superfinal book has been made in cooperation between chess Grandmaster Matthew Sadler and myself (Jeroen Noomen). Matthew is a well respected Grandmaster and the co-author of the great book "Game Changer", together with WGM Natasha Regan. It was an honour to get Matthew on board and I am very pleased with the result!
Here is the most important information about our joint effort:
Move length distribution
See also: https://www.chessdom.com/jeroen-noomen-and-gm-matthew-sadler-announce-tcec-s21-superfinal-book-cooperation/
maandag 1 februari 2021
The TCEC 20 superfinal opening PGN is now available for download:
TCEC 20 opening PGN
Stockfish won the superfinal vs Leela Chess Zero by 53-47. Stockfish won 14 games, Leela won 8 games, while 78 games ended in a draw.
Some interesting statistics about the decisive opening pairs that ended 1.5-0.5:
0.36 / 1.05
0.33 / 0.67
0.40 / 0.71
0.40 / 0.91
0.41 / 0.86
0.43 / 0.98
0.42 / 0.79
0.42 / 0.64
0.49 / 1.07
0.65 / 1.15
0.55 / 0.84
0.43 / 1.34
0.52 / 0.90
0.52 / 1.48
These are the book exit evaluations by Leela (mentioned first) and Stockfish (mentioned second) in the opening lines that ended 1.5-0.5. Conclusion can be similar to the S19 superfinal: Leela book exits lower than +0.40 seem to be an almost certain draw. There were only two exceptions, where Leela blundered a drawish position after the book exits had been lower than+0.40.
zaterdag 9 januari 2021
Here are Jeroen Noomen's comments on the opening selection for the TCEC 20 superfinal:
"Here are the most important details regarding my selection of the openings for the TCEC 20 superfinal:
Move length distribution
zaterdag 17 oktober 2020
Jeroen Noomen has made his TCEC 19 superfinal book available for download. His comments:
"The TCEC 19 superfinal ended Friday, October 16th and was won by Stockfish by 54.5-45.5 vs Leela Chess Zero. In wins 18-9, with 73 draws. Just like the S18 superfinal book, the S19 book was way more risky than S16 and before. Nevertheless, the S19 book also had several balanced lines and theoretically interesting lines. Interestingly, all wins were only in (very) dubious openings. Balanced lines and slightly dubious lines had a 100% draw rate. A sign of the times?
You can download the S19 superfinal book from the following location:
Some interesting statistics:
In the Leela wins, the book exit evaluations by Leela were: 0.43 / 0.54 / 0.50 / 0.46 / 0.66 / 0.48 / 0.56 / 0.52 / 0.63
I.e. the lowest book exit that led to a win was 0.43 (which is quite high by Leela standards). All other white Leela games that had lower exits ended in a draw.
In the SF wins, the book exit evaluations by SF were: 1.14 / 0.99 / 0.77 / 0.63 / 0.98 / 1.39 / 1.06 / 1.19 / 1.14 / 1.20 / 0.70 / 0.66 / 1.38 / 1.05 / 0.91 / 1.27 / 1.00 / 0.85 (note: with contempt=24)
I.e. the lowest book exit that led to a win was 0.63. All other white SF games that had lower exits ended in a draw.
1. All balanced lines, slightly unbalanced lines and slightly dubious lines ended in draws => the draw rate for such lines is 100%;
2. The ONLY wins in this superfinal were scored in (very) dubious lines.