Sheets by Cscuile Rating List v4 (Universal Fixed Settings & 1+1) BetaOne/Test40

Engine Elo Dif Performance Notes Steps # of Games Self Elo News: Key: Universal Testing Settings: Glossary of my L.e.e.l.a Docs Hardware and Settings: These settings are used if not listed
BlueFish SFDev 176CPU 3933 50 Current Theoretical Limit To Chess 7-men, Cerebellum... BetaOne Stockfish/Variants Stockfish Nodes 4,000,000 Nodes Per Move [4 Threads] -Main Lists Rating Lists (v1-v4) CPU i7 7700k 4CPU [1] 4000 Steps to GM
asmBrainFish 11 Dev 64CPU (1/10/2019) 3883 67 ☆☆☆ BetaOne Pre-Releases and Updates ☆☆☆ Leela Test40 Stockfish Theoretical Neural Network Nodes 8,000 Nodes Per Move -SF and Leela Scaling GPU (For Leela) GTX 1080 ti Deepmind 5000 TPUs
Stockfish 11 Dev 64CPU (1/10/2019) 3816 26 https://www.patreon.com/BetaOne Leela Test30 AlphaZero Book betaone_exh_openings.pgn -A0 vs SF Scaling Recreation Hash Data 1 GB 16384000 positions per 4000 Steps
Stockfish 10 64CPU 3790 36 Equation Used: 1945 + 74.7 ln(x) [2] Leela Test 0/10/20 Information: These settings are universal meaning final results -20b vs 15b Scaling Book Balsa v2401 (From Perfect2017) 26624000000
pos/second 5000 TPU
Leela 32425 Test30 4TPU (80,000 NPS) 3754 28 Based on Scaling 56,455,471 10547.46 Latest Update: will be the same regardless of hardware. These settings are -List of Resources and other Lists Settings Misc. All Defaults, No Tablebase 0.0006153846154
AlphaZero 2018 4TPU (80,000 NPS) 3726 31 155-6=839 (SF8) +52 Elo 500,000 44,000,000 Leela Test40 ID 42100 adjusted so that they match 1+1 on my lists. -Cscuile -Definitons for Chess Engines Node Ratio 4CPU 863:1 (7,318,351:8,478 NPS)
asmBrainFish 11 Dev 4CPU (1/10/2019) 3695 13 -Home of the AntiFish Neural Network Project LeelaFish Ratio [2048:1] 0.421 LeelaFish Ratio
asmBrainFish 10 4CPU 3682 49 AZ-SF8 Ratio [875:1] 0.987 A0-SF8 Ratio
Leela Test40 ID 42100 (1+1) 3633 5 62.5/119 24-18=77 (SF10 1+1) 1+1 Settings and TC Used 525,000 63,407,472 3181.00 -Rating List of BetaOne Time Control 1+1
Stockfish 11 Dev 4CPU (1/10/2019) 3628 13
Stockfish 10 4CPU 3615 24 179.0/300 83-25=192 (Lc0 11258) To Do: Long Term To Do:
Leela 32425 Test30 Strongest Network 3591 31 54.5/100 25-16-59 (SF9) Strongest T30 ‭606,250‬ 56,455,471 10547.46 -Check to see the Elo difference -Test how Leela's Evaluation Correlates
Stockfish 9 4CPU 3560 5 9449-2917=27634 (SF8 +57 Elo) Fixed to CCRL 40/4 3560 Elo https://docs.google.com/spreadsheets/d/16vwCrq8c9eveF0kGGzn8hP_IFX4rFsfB548aD6QYUhU/htmlview between Fixed Hardware and to human blunders.
AlphaZero 2018 1080TI 3555 15 155-6=839 (SF8) +52 Elo AlphaZero 2018 Papers 44,000,000 Fixed nodes
Leela 11258 Test10 3540 37 141.5/300 37-54=209 47.2% (SF9) Strongest T10 52,030,923 4772.41
Stockfish 8 4CPU 3503 67 5267-881=13852 (SF7 +77 Elo) SF2.3.1 to 9 Tests from FishTest https://docs.google.com/spreadsheets/d/1Mi2qwPCK4aVNt9B8aC-HecIyLJ0BEAPvp63L59DTrY4/edit#gid=952456918
Leela 32089 Test30 45M Games 3436 10 40.5/100 13-32-55 (SF8) 522,250 45,452,403 9571.28
Stockfish 7 4CPU 3426 21 10233-3197=26570 (SF6 +62 Elo)
Leela 31657 Test30 31M Games 3405 34 47.0/100 22-28=50 (SF7) 20x256 31,348,914 8289.68
Leela 31400 Test30 23M Games 3371 7 51.0/100 19-17=64 (SF6) 350,000 23,099,660 6491.30
Stockfish 6 4CPU 3364 14 9633-3723=26644 (SF5 +52 Elo)
Leela 10356 Test10 3350 38 52.0/100 26-22=52 (SF5) 23,071,622 4258.34
Stockfish 5 4CPU 3312 0 11417-5108=23475 (SFDD +55 Elo)
Leela 22160 Test20 3312 3 50.0/100 27-27=46 (SF5) Strongest T20 57,311,716 4194.60
Leela 495 Test0 3309 4 49.5/100 +20-21=59 (SF5) 15x192 Strongest T0 20,833,185 6115.43
Leela 31250 Test30 18M Games 3305 48 49.0/100 22-24=54 (SF5) 312,500 18,293,854 5122.08
Stockfish DD 4CPU 3257 3 11787-4119=24094 (SF4 +67 Elo)
Leela 31000 Test30 11M Games 3254 40 49.5/100 19-20=61 (SFDD) 11,356,411 4378.07
Leela Test40 ID 40446 3214 24 53.5/100 29-22-49 (SF4) 111,500 10,074,740 4034.63
Stockfish 4 4CPU 3190 44 6221-2988=0791 (SF3 +57 Elo)
BetaOne Run #7 (60,000 Steps) 3146 2 LR DROP 0.02 60,000
Leela 30929 Test30 10M Games 3144 11 56.0/100 34-22=44 (SF2.3.1) 232,250 10,205,729 4473.28
Stockfish 3 4CPU 3133 3 4493-2721=12786 (SF2.3.1 +31 Elo)
Leela Test40 ID 40200 3130 28 50,000
Stockfish 2.3.1 4CPU 3102 7 183.5/200 161-1=31 91.8% (SF1)
Leela 9155 Test0 3095 10 49.0/100 23-25-52 (SF2.3.1) 6x64 8,128,000 3696.32
Leela Test40 ID 40122 3085 10 47.5/100 27-32-41 (SF2.3.1) 20x256 SE 30,500 1,910,743 1787.01
BetaOne Run #7 (30,000 Steps) 3075 38
BetaOne Run #4 (72,500/1,000,000 Steps) 3037 52 +126=161-216 (SF2.3.1) 0.3-0.15 LR 72,500
BetaOne Run #4 (48,000/1,000,000 Steps) 2985 15 +6=14-18 (SF2.3.1) 48,000
BetaOne Run #7 (20,000 Steps) 2970 0
BetaOne Run #5 (20,000 Steps) 2970 26
BetaOne Run #7 (10,000 Steps) 2944 52
BetaOne Run #5 (10,000 Steps) 2892 18
BetaOne Run #4 (15,000/1,000,000 Steps) 2874 30 +160=64-35 (SF1) Thank you to akirby83 for the tests 15,000
Leela 30646 Test30 7M Games 2844 112 9-72=19 (SF2.3.1) ‭161,500‬ 7,007,000 3697.95
BetaOne Run #4 (6,000/1,000,000 Steps) 2732 48 +15=6-11 (SF1) 6,000
Stockfish 1 4CPU 2684 224 16.5/200 1-168=31 8.3% (SF2.3.1)
BetaOne Run #4 (5,000/1,000,000 Steps) 2460 606 +4=7-21 (SF1) Grandmaster Level 5,000
Stockfish Dev Level 8 1854 37
Stockfish 10 (25,000 Nodes) 1817 125
Stockfish Dev Level 7 1692 68
BetaOne Run #4 (3,000/1,000,000 Steps) 1624 22 +3=4-13 (SF10 25k Nodes) 3,000
Stockfish Dev Level 6 1602 445
BetaOne Run #4 (2,000/1,000,000 Steps) 11571157 +0=1-21 (SF10 25k Nodes) 2,000
0
index

BetaOne Data
Steps BetaOne AlphaZero 2018 (3555
Leela Elo)
Test40 ID 42100 (3633
Stockfish
Elo) 10 (3615 Elo) Stockfish 8 (3503LR
Elo)
Drops FishTest Stage & LR Drop
0 0 0 3633 3615 3503
1000
2000
3000
4000 411
5000
10000 2944
15000
20000 861
22500
25000
27500
30000 3075 1661
32500
35000
37500
40000 2141
42500
45000
48000
50000 2351
52500
55000
57500
60000 3146 2391
62500
65000
67500
70000 2431
72500
75000
77500
80000 2481
82500
85000
87500
90000 2531
92500
95000
97500
100000 2861 2861
102500
105000
107500
110000 3121
112500
115000
117500
120000 3261
122500
125000
127500
130000 3341
132500
135000
137500
140000 3361
142500
145000
147500
150000 3391
152500
155000
157500
160000 3431
162500
165000
167500
170000 3441
172500
175000
177500
180000 3446
182500
185000
187500
190000 3451
192500
195000
197500
200000 3456
202500
205000
207500
210000 3461
212500
215000
217500
220000 3466
222500
225000
227500
230000 3471
232500
235000
237500
240000 3476
242500
245000
247500
250000 3481
252500
255000
257500
260000 3486
262500
265000
267500
270000 3491
272500
275000
277500
280000 3496
282500
285000
287500
290000 3501
292500
295000
297500
300000 3511 3511
302500
305000
307500
310000 3521
312500
315000
317500
320000 3533
322500
325000
327500
330000 3535
332500
335000
337500
340000 3537
342500
345000
347500
350000 3539
352500
355000
357500
360000 3541
362500
365000
367500
370000 3542
372500
375000
377500
380000 3543
382500
385000
387500
390000 3544
392500
395000
397500
400000 3545
402500
405000
407500
410000 3546
412500
415000
417500
420000 3547
422500
425000
427500
430000 3548
432500
435000
437500
440000 3549
442500
445000
447500
450000 3550
452500
455000
457500
460000 3551
462500
465000
467500
470000 3552
472500
475000
477500
480000 3553
482500
485000
487500
490000 3554
492500
495000
497500
500000 3555 3555
502500
505000
507500
510000 3555
512500
515000
517500
520000 3556
522500
525000
527500
530000 3556
532500
535000
537500
540000 3556
542500
545000
547500
550000 3556
552500
555000
557500
560000 3557
562500
565000
567500
570000 3557
572500
575000
577500
580000 3557
582500
585000
587500
590000 3557
592500
595000
597500
600000 3557
602500
605000
607500
610000 3558
612500
615000
617500
620000 3558
622500
625000
627500
630000 3558
632500
635000
637500
640000 3558
642500
645000
647500
650000 3558
652500
655000
657500
660000 3558
662500
665000
667500
670000 3558
672500
675000
677500
680000 3559
682500
685000
687500
690000 3559
692500
695000
697500
700000 3559
702500
705000
707500
710000 3559
712500
715000
717500
720000 3559
722500
725000
727500
 730000 3559
732500
735000
737500
740000 3560
742500
745000
747500
750000 3560
752500
755000
757500
760000 3560
762500
765000
767500
770000 3560
772500
775000
777500
780000 3560
782500
785000
787500
790000 3560
792500
795000
797500
800000 3560
802500
805000
807500
810000 3560
812500
815000
817500
820000 3560
822500
825000
827500
830000 3560
832500
835000
837500
840000 3560
842500
845000
847500
850000 3560
852500
855000
857500
860000 3560
862500
865000
867500
870000 3560
872500
875000
877500
880000 3560
882500
885000
887500
890000 3560
892500
895000
897500
900000 3560
902500
905000
907500
910000 3560
912500
915000
917500
920000 3560
922500
925000
927500
930000 3560
932500
935000
937500
940000 3560
942500
945000
947500
950000 3560
952500
955000
957500
960000 3560
962500
965000
967500
970000 3560
972500
975000
977500
980000 3560
982500
985000
987500
990000 3560
992500
995000
997500
1000000 3560 3633 3615 3503
Resources 1 1 1 **LcZero ID 5 Long Time Control Tests Complete (15+2) : 3 ELO
2 2 2 https://docs.google.com/spreadsheets/d/1ZAIuHR6n-5JTxKQc0
Leela: 3 3 3
Leela Chess Zero Website L.e.e.l.a Links Quotes: (All by Cscuile) 4 4 4 **LcZero ID 5 Short Time Control Tests Complete (1+1) : 3 ELO
Deepmind's AlphaZero Paper [ALL DOCS] LcZero ELO Estimate List Approximation [L.e.e.l.a] "3600 Elo is the Elo ceiling for chess engines" -Cscuile 2013 5 5 5 https://docs.google.com/spreadsheets/d/1ZAIuHR6n-5JTxKQc0
Test10 & Test20 Full Self-Elo [Public] LcZero ELO Estimate List Approximation [L.e.e.l.a] "32-men positions will be solved by 2050." -Cscuile 2/4/19 11:05 PM EST 6 6 6 Latest Update:
Test30 Full Self-Elo "The Limit of Chess Engine Elo is 4,400 Relative to CCRL 40/4" -Cscuile (11/30/18) 7 7 7 Leela ID 452 LTC
Deepmind Website "I believe 3,900 Elo is the limit of chess engines through human improvement." -Cscuile (11/30/18) 8 8
9 9 8
Stockfish: Shortened Links: goo.gl/hGJ4Jf http://lc0.org/cscuile 10 10 9 Next Test:
Stockfish Website 11 11 10 Leela ID 4?? STC
Spcc Stockfish Testing Perfect 2017 + Balsa Opening Books By: Sedat Canbaz 12 12 11
Fishtest https://sites.google.com/site/computerschess/balsa-opening-test-suite 13 13 12
Ipman Chess Stockfish Testing 14 14 13
CCRL 40/4 15 15 14
16 16 15
17 17 16
Other Leela Rating List Links: Useful Links Discord Links 18 18 17
[Sheet3] Lc0 test30 Elo estimates Hash Formula (T x S / 100) MB Stockfish Discord 19 19 18
LCZ rating list (CCRL Estimate) BrainFish Link Leela Discord 20 20 19
Leela Chess Zero SF vs A0 Simulation Calculator 21 21 * If you have any suggestions or test requests please
20
Leela Chess Zero vs Stockfish 9 22 22 leave a comment 21
LCZero Benchmarks 23 23 Hardware and Settings: 22
LC0 Elo Estimates Summary Main Page Link Misc: 24 24 CPU i7 7700k Important notes: 23
LR drop strengths https://bit.ly/2VxKQn8 500 Elo Barrier (Versions of Stockfish and Elo) 25 25 GPU (For Leela) GTX 1080 ti I am unable to test Stockfish Scaling due to my
24
Leela Training Runs WDL cp = 290.681 * tan(3.0962 * (feval - 0.5)) [3] 26 26 Hash Data 1 GB Hardware limitations. Sorry! 25
TensorBoard 27 27 Book Perfect 2017 I need a minimum of 16 GB Ram on my PC 26
lc0 ELO Ratings - ID Progression 28 28 Time Control 1+1 in order to test it properly at 10+ Billion Nodes27
29 29 28
30 30 Key: 29
31 31 Leela Latest Update Latest Update: 30
32 32 Leela Next Test Leela ID 468 31
33 33 Leela 32
34 34 Leela Test Networks Next Test: 33
35 35 Stockfish/Variants Leela ID 10036 20x256 Net 34
36 36 Stockfish Theoretical 35
37 37 AlphaZero 44 Million Games 36
38 38 37
39 39 Notes: 38
40 40 -Going by the expression "Doubling hardware adds +50 ELO to an engine" Stockfish 8 64 threads ELO39
41 41 should be +150 ELO to an 8 thread CPU Stockfish. 40
42 42 -NOTE this rating list does not factor in the handicaps for Stockfish in the AlphaZero games. 41
43 43 -Lc0 CUDA is now used. 42
44 44 -Lc0 is tested against the version of SF closest to its strength with exceptions due to regression.
43
45 45 44
46 46 Interesting Notes: 45
47 47 6x64 Network Speeds: 86,000 Nodes Per Second 46
48 48 10x128 Network Speeds: 38,000 Nodes Per Second 47
49 49 15x192 Network Speeds: 16,000 Nodes Per Second 48
50 50 20x256 Network Speeds: 7,000 Nodes Per Second 49
51 51 50
52 52 51
53 53 52
54 54 53
55 55 54
56 56 55
57 57 56
58 58 57
59 59 58
https://goo.gl/71pnYs 13 AlphaZero TITAN V [4] 3593 3593 20k NPS 20x256?20k NPS 20x256? 60 60 59
61 61 60
1 4.28 4.28 62 62 61
2 36.63 18.315 63 63 62
4 72.86 18.215 64 64 63
6 114.61 19.10166667 65 65 64
8 145.32 18.165 66 66 65
10 190.37 19.037 67 67 66
12 228.81 19.0675 68 68 67
14 266.69 19.04928571 69 69 68
70 70 69
71 71 70
72 72 71
73 73 72
74 74 73
75 75 74
76 76 75
77 77 76
78 78 77
79 79 78
80 80 79
81 81 80
82 82 81
83 83 82
84 84 83
85 85
86 86
87 87
88 88
89 89
90 90
91 91
92 92
93 93
94 94
95 95
96 96
97 97
98 98
99 99
100 100
101 101
102 102
103 103
104 104
105 105
106 106
107 107
108 108
109 109
110 110
111 111
112 112
113 113
114 114
115 115
116 116
117 117
118 118
119 119
120 120
121 121
122 122
123 123
124 124
125 125
126 126
127 127
128 128
129 129
130 130
131 131
132 132
133 133
134 134
135 135
136 136
137 137
138 138
139 139
140 140
141 141
142 142
143 143
144 144
145 145
146 146
147 147
148 148
149 149
150 150
151 151
152 152
153 153
154 154
155 155
156 156
157 157
158 158
159 159
160 160
161 161
162 162
163 163
164 164
165 165
166 166
167 167
168 168
169 169
170 170
171 171
No easteregg here https://www.strawpoll.me/16093545
Rating List by Cscuile Public Docs Link Chess Engine Definitions
Abreviation Term TLDR See Also Definition
0 Please add or modify definitions as you please! To do so,
6b/10b/20b/40b Residual Block Shorthand for 6/10/20/40 residual blocks just comment and I will add them.
20x256 20b : Shorthand for the size of the NN. 20 residual blocks and 256 filters.
A
A0 Alpha Zero Deepmind's Chess NN
AB Alpha-Beta Search What Stockfish Uses Advanced minimax search. Prunes lines that are probably bad AB Prunning Explained (Youtube Video)
Technical Explanation of Leela Chess Zero
B
Neural network computational backend to use. As a rough guide, use Cuda for modern nvidia
Backend What it runs on GPUs, Opencl for all other GPUs, and Blas if no GPU.
Batch Size How many positions the GPU can train on simultaneously.
Bestmove Picks the move with the most visits. Important:
C Leela UCI Options Definitions
Min-maxing certain nodes (win, loss, tb etc). It leads to much better strength when the net is
Certainty propagation 3 to 10 ply away from transition into tb https://github.com/LeelaChessZero/lc0/wiki/Neural-Net-Training
The largest part of Lc0's NN uses this architecture, which convolves (slides) several 3x3xN
CNN Convolutional Neural Network filters across the entire board.
Cow Moooo Moooooooooooooooooooooooooooooooooooooooo
A constant controlling the "UCT search" algorithm. Higher values promote more
Cpuct exploration/wider search, lower values promote more confidence/deeper search.
D
Depth Average depth Seldepth.
E
Elo A method for calculating the relative skill levels of players in zero-sum games.
F
Unlike filters which only look at a 3x3 area of the board, the FC layer looks at the entire board
FC Layer Fully Connected layer Filters at once. This is used in the policy and value heads.
A 3x3xN pattern. The N means it is looking at several input features. A "20x256" network has
Filters 256 3x3x256 filters in each layer
Normally when a move has no visits, it's eval is assumed to be equal to parent's eval. With
non-zero FPU reduction, eval of unvisited move is decreased by that value, discouraging
FPU First Play Urgency Reduction visits of unvisited moves, and saving those visits for (hopefully) more promising moves.
G

L
How fast the neural net weights are adjusted. Too low and your progress is too slow.
LR Learning Rate How quickly weights change Too high and you can undo what you have already learnt.

M
When the engine cannot gather a large enough batch for immediate use, tries to prefetch
Max Prefetch up to X positions which are likely to be useful soon, and put them into cache.
MCTS Monte Carlo Tree Search
Minibatch Size How many positions the engine tries to batch together for parallel NN computation.
Amount of time, in milliseconds, that the engine subtracts from it's total available time
Move Overhead (to compensate for slow connection, interprocess communication, etc).
One of the terms the NN training process tries to minimise. The NN improves in a feedback
Mean Squared Error of the value (V) NN loop by trying to predict who wins each self-play game. The mean squared error of the
MSE loss: output. predictions is the "loss". See also Policy Loss and Reg Term.
MultiPV UCI Number of game play lines (principal variations) to show in UCI info output.
N
NN Neural Network NN's Explained: 3Blue1Brown
NNCache Stores NN evaluations, which can be reused if the same position is reached by transposition.
A potential game position in the tree of future gameplay. The root node of the tree is the
Nodes current position.
Introduced randomness added to root node prior probabilities according to Dirichlet
distribution. This allows the engine to discover new ideas during training by exploring
Noise moves which are known to be bad. Off by default in regular play.
NP vs. P
including NNCache hits and terminal node hits, but excluding nodes carried over from tree
NPS Nodes per second, How fast it's going reuse. In other words, total playouts generated per second.
O
If the network trains on the same positions too much or with too low learning rate, it may
Overfitting memorise those positions and not generalise well to other similar positions.
P
P Policy Head NN Neural network's raw policy output (probability this is the best move) [5]
Parallelism Number of games to play in parallel
As defined by the Monte Carlo Tree Search, starting from the root node: 1) pick a move to
explore according to the policy and confidence of the choices (PUCT selection algorithm);
2) travel to the resulting game position node; 3) if this child node is already explored at least
once, repeat steps 1) and 2), otherwise; 4) evaluate this node via the neural network,
creating value and policy estimates for this position, and use this new value estimate to
Playouts: update all parent nodes' values. After 4), the playout is complete.
One of the terms the NN training process tries to minimize. The NN improves in a feedback
loop by trying to predict what the self-play games say the policy should be. The amount the
Policy Loss NN differs from the self-play game outputs is the "loss". See also MSE Loss and Reg Term.
Removing illegal moves from consideration without requiring the neural network to assess
Policy Masking them. Not training illegal moves to 0 policy.
Policy Sharpening Exponent applied to visit distribution to emphasize moves with more visits
The moves that would be taken if we chose the node that has the most visits for each level
PV Principal Variation MultiPV (i.e. most playout traversals).
Puct scales the relative contributions of evaluation and policy when choosing where to visit next
Q
Q V Average expected value from all playouts for this move, a value ranging from -1 to 1

R
The L2-norm regularisation term. The feedback training of the NN tries to minimize this
(along with Policy Loss and MSE loss), aiming to improve the generalization of the NN, and
Regularisation Term How far from 0 weights are prevent overfitting.
A residual block is a popular NN architecture that combines two CNN layers with a skip
connection. A "20x256" network has 20 residual blocks. (Note that this is slightly different
Residual Block from the Deepmind paper where a "20x256" network has 19 residual blocks).
S
How many times each position from self-play games is used for training. Too high and your
Sampling Ratio net may overfit. Too low and your progress is too slow.
Score cp Traditional centipawn value where 100 is a one pawn advantage.
SE Networks beter than ResNets Squeeze Excitation Networks
Seldepth Maximum depth
Avoid spending time on the moves which cannot become bestmove given the remaining
time to search. When no other move can overtake the current bestmove, the search stops,
saving time. Values greater than 1 stop less promising moves from being considered even
Smart Pruning Factor earlier. Values less than 1 causes hopeless moves to still have some attention.
Policy softmax temperature Higher values make priors of move candidates closer to each other, widening the search.
Averaging the weights of the
SWA Stochastic Weighted Average most recent runs Stochastic Weight Averaging (Click on me for more information)

T
Reducing Temperature after a certain amount of moves have been played, usually to 0 so
Tempdecay: Temperature Decay that afterwards the engine picks only the best moves to make. Not enabled by default.
A parameter that influences move selection. If equal to 0, the move assessed as "best"
during tree search is always made. Larger values increase the probability of choosing other
moves. Typically on for self-play training games, 0 by default during regular play.
Mathematically, each visit frequency (see MCTS) is exponentiated by 1/tau, where tau is the
temperature, and the sum of the resulting values is normalized to sum to 1.0. The move to
play is then chosen in proportion to this adjusted frequency. For tau=1 for example, this
results in the probability of making each move is proportional to its MCTS visits. As tau->0
the most common visit dominates the transformation and only the single most-visited move
Temperature is ever played.
Terminal node A node that has a game result (checkmate or draw).
Threads Number of (CPU) worker threads to use
TP TP Trade Penalty
Otherwise known as contempt, it modifies evaluations slightly to discourage trades unless
Trade Avoidance they improve the position
NN learning tends to split data into two sets, train and test sets. The train set is used to
improve the NN weights. The test set is used to validate the NN is able to generalise what it
Train/Test Sets learned to positions it has never trained on. This way you can detect if your NN is overfitting.
U
This is the part of the PUCT formula that encourages exploring moves that have not been
UCB Upper Confidence Bound, aka U. searched much yet. See also the other half, Q.
UCT Upper Confidence Bound 1 applied to trees an enhancement to mcts used by alphazero
V
V Value Q Expected Value output of the NN, ranging from -1 to 1
Total number of playouts that have traversed this node. This is equal to the total size of the
tree below this node (unless playouts have hit a terminal node, in which case
n Visits visits = nodes + playouts_that_hit_terminal_node).
W

Z
AntiFish Neural-Network Made by Cscuile The AntiFish Neural Network Project
What is AntiFish? Engine Elo Diff Performance Settings and Info Additional Information # Games Ideas for mass testing:
AntiFish is a Neural Network designed to exploit Stockfish 11 Dev [12/13/18] 3623 8 -3,200,000 vs 3,125 Nodes Fixed
weaknesses within Stockfish. The hope is that one day Stockfish 10 4CPU 3615 55 179.0/300 83-25=192 (Lc0 11258) [6] -0.5+0.06 fixed TC
AntiFish can be used to improve Stockfish itself. Stockfish 9 4CPU 3560 13 9449-2917=27634 (SF8 +57 Elo)
Please join the Stockfish Discord to follow updates: Leela ID 11258 v0.19.2 3547 15 144.5/300 35-46=219 48.2% (SF9) AntiFish's Main Engine to Surpass Main Goal is to Surpass ID 11258's Performance against SF9/Dev. 52,030,923
AntiFish Mark 25 (1+1 Time Control) 3532 29 46.0/100 18-26-56 (SF9) Main List Conditions 1+1 55,861
AntiFish/Stockfish Discord Stockfish 8 4CPU 3503 77 5267-881=13852 (SF7 +77 Elo)
Special thanks to ASilver and Dkappe for helping Stockfish 7 4CPU 3426 62 10233-3197=26570 (SF6 +62 Elo)
me with this project. Without them I could never Stockfish 6 4CPU 3364 52 9633-3723=26644 (SF5 +52 Elo)
do this. Thanks again! Stockfish 5 4CPU 3312 55 11417-5108=23475 (SFDD +55 Elo)
Key: Latest Update: Stockfish Don Dailey (DD) 4CPU 3257 19 11787-4119=24094 (SF4 +67 Elo)
Latest Update AntiFish Mark 16-29 Stockfish 10 (6,400,000 Nodes) 3238 48
AntiFish Stockfish 4 4CPU 3190 57 6221-2988=0791 (SF3 +57 Elo)
AntiFish 2nd Int. In Progress: Stockfish 3 4CPU 3133 16 4493-2721=12786 (SF2.3.1 +31 Elo)
Stockfish 10 (3,200,000 Nodes) 3117 15
Stockfish Stockfish 2.3.1 4CPU 3102 7 183.5/200 161-1=31 91.8% (SF1) Leela Chess Zero 6x64 is around this strength level.
Leela Leela 9155 6x64 Block v19.1 RC2 3095 123 49.0/100 23-25-52 (SF2.3.1) 8,128,000
Engines Stockfish 10 (1,600,000 Nodes) 2972 151
Stockfish 10 (800,000 Nodes) 2821 137
Stockfish 1 4CPU 2684 16 16.5/200 1-168=31 8.3% (SF2.3.1) AntiFish Milestone #2
Stockfish 10 (400,000 Nodes) 2668 105
AntiFish Mark 65 (800N) [10500 Steps] 2563 4 47 - 23 - 30 (SF10 200k) 65,345
AntiFish Mark 25 (800N) [1500 Steps] (400 Games) 2559 0 166 - 74 - 160 (SF10 200k) +/- 26.61 24 Elo Stronger than 11258 against SF at 50k Nodes. 24 Elo Stronger than ID 11258 against SF10 200k 55,861
AntiFish Mark 25 (800N) [1500 Steps] 2559 0 40 - 17 - 43 (SF10 200k) +/- 52.08 55,861
AntiFish Mark 22 (800N) [1125 Steps] 2559 7 41 - 18 - 41 (SF10 200k) +/- 53.09 55,861
AntiFish Mark 29 (800N) [2000 Steps] (400 Games) 2552 3 167 - 83 - 150 (SF10 200k) +/- 27.17 55,861
AntiFish Mark 22 (800N) [1125 Steps] (400 Games) 2549 4 154 - 73 - 173 (SF10 200k) +/- 25.78 55,861
AntiFish Mark 19 (800N) [750 Steps] 2545 0 36 - 17 - 47 (SF10 200k) +/- 49.96 55,861
AntiFish Mark 32 (800N) [3500 Steps] 2545 4 44 - 25 - 31 (SF10 200k) +/- 57.63 55,861
AntiFish Mark 48 Int. #2 (800N) [2000 Steps] 2541 0 40 - 22 - 38 (SF10 200k) (SF10 200k) Duplicate Check 65,345
AntiFish Mark 20 (800N) [875 Steps] 2541 6 37 - 19 - 44 (SF10 200k) +/- 51.45 55,861
Leela ID 11258 v0.19.1.1 (800 Nodes) (400 Games) 2535 3 155 - 90 - 155 (SF10 200k) +/- 26.79 AntiFish Milestone #1 No temp 52,030,923
Leela ID 11258 v0.19.1.1 (800 Nodes) 2532 1 80 - 49 - 71 (SF10 200k) +/- 39.00 52,030,923
AntiFish Mark 15 (800 Nodes) [250 Steps] 2531 0 43 - 28 - 29 (SF10 200k) +/- 58.26 55,861
AntiFish Mark 21 (800N) [1000 Steps] 2531 4 42 - 27 - 31 (SF10 200k) +/- 57.39 55,861
AntiFish Mark 27 (800N) [1750 Steps] 2527 0 38 - 24 - 38 (SF10 200k) +/- 54.20 55,861
AntiFish Mark 41 (800N) [8000 Steps] 2527 4 35 - 21 - 44 (SF10 200k) 55,861
AntiFish Mark 28 (800N) [1875 Steps] 2523 0 41 - 28 - 31 (SF10 200k) +/- 57.29 55,861
AntiFish Mark 34 (800N) [4500 Steps] 2523 0 41 - 28 - 31 (SF10 200k) 55,861
AntiFish Mark 47 (800N) [11000 Steps] 2523 3 38 - 25 - 37 (SF10 200k) 55,861
AntiFish Mark 17 (800N) [500 Steps] 2520 0 37 - 25 - 38 (SF10 200k) +/- 54.14 No temp 55,861
AntiFish Mark 31 (800N) [3000 Steps] 2520 0 40 - 28 - 32 (SF10 200k) +/- 56.81 55,861
AntiFish Mark 39 (800N) [7000 Steps] 2520 7 37 - 25 - 38 (SF10 200k) 55,861
AntiFish Mark 26 (800N) [1625 Steps] 2513 4 35 - 25 - 40 (SF10 200k) +/- 53.18 55,861
AntiFish Mark 33 (800N) [4000 Steps] 2509 3 39 - 30 - 31 (SF10 200k) +/- 57.13 55,861
AntiFish Mark 23 (800N) [1250 Steps] 2506 0 31 - 23 - 46 (SF10 200k) +/- 50.35 55,861
AntiFish Mark 24 (800N) [1375 Steps] 2506 7 39 - 31 - 30 (SF10 200k) +/- 57.53 55,861
AntiFish Mark 18 (800N) [625 Steps] 2499 0 35 - 29 - 36 (SF10 200k) +/- 54.90 55,861
AntiFish Mark 37 (800N) [6000 Steps] 2499 11 33 - 27 - 40 (SF10 200k) 55,861
AntiFish Mark 35 (800N) [5000 Steps] 2488 10 32 - 29 - 39 (SF10 200k) 55,861
Stockfish 10 (200,000 Nodes) 2478 10
AntiFish Mark 49 Int. #2 (800N) [2500 Steps] 2468 26 - 29 - 45
AntiFish Mark 30 (800N) [2500 Steps] 2468 88 30 - 33 - 37 (SF10 200k) +/- 54.42 55,861
AntiFish Mark 16 (800N) [375 Steps] (No Temp) 2380 32 147 - 5 - 48 (SF10 50k) +/- 49.90 55,861
Leela ID 11258 v0.19.1.1 (800 Nodes) (No Temp) 2348 55 752 - 52 - 255 (SF10 50k) +/- 21.13 52,030,923
Stockfish 10 (100,000 Nodes) 2293 27
Stockfish 1 4CPU Weakened 10% 2266 96 16.5/200 2-169-29 8.3% (SF1)
AntiFish Mark 15 (800 Nodes) [250 Steps] (Temp) 2170 33 105 - 50 - 45 (SF10 50k) +/- 43.78 52.5% Wins, 25% Losses, 22.5% Draws 55,861
AntiFish Mark 14 (800 Nodes) [125 Steps] (Temp) 2137 1 97 - 60 - 43 (SF10 50k) +/- 43.39 55,861 Generated 444,139 T10 48.5% Wins, 30% Losses, 21.5% Draws 55,861
Leela ID 11258 v0.19.1.1 (800 Nodes) (Temp) 2136 64 192-119=89 (SF10 50,000) 48% Wins, 29.75% Losses, 22.25% Draws 52,030,923
Stockfish 10 (50,000 Nodes) 2072 224
AntiFish ID 2 v1 (800 Nodes) 1848 31 35 - 161 - 26 (SF10 50k) Only trained on 50k generated
Stockfish 10 (25,000 Nodes) 1817 187
Stockfish 1 4CPU Weakened 1% 1630 81 5.0/200 0-190=10 2.5% (SF1 10%)
Stockfish 10 (12,500 Nodes) 1549 286
Stockfish 10 (6,250 Nodes) 1263 286
Stockfish 10 (3,125 Nodes) 977 229
AntiFish ID 1 v2 (800 Nodes) 748 2 SF10 3125 Generate Games Only
Stockfish 10 (1,600 Nodes) 746 191
Stockfish 10 (800 Nodes) 555 129
Stockfish 10 (400 Nodes) 426 64
Stockfish 10 (200 Nodes) 362 40
Stockfish 10 (100 Nodes) 322 43
Stockfish 10 (50 Nodes) 279 45
Stockfish 10 (25 Nodes) 234 29
Stockfish 10 (16 Nodes) 205 21
Stockfish 10 (8 Nodes) 184 8
Stockfish 10 (4 Nodes) 176 5
Stockfish 10 (2 Nodes) 171 2
Stockfish 10 (1 Nodes) 169 2
BetaOne Neural-Network Made by Cscuile The BetaOne Network Project
What is BetaOne? Engine Elo Diff Performance Settings and Info Additional Information # Games Ideas for mass testing:
BetaOne is a neural network that uses the non-zero Stockfish 11 Dev [12/13/18] 3623 8 -3,200,000 vs 3,125 Nodes Fixed
approach to produce the strongest chess entity possible. Stockfish 10 4CPU 3615 24 179.0/300 83-25=192 (Lc0 11258) [7] -0.5+0.06 fixed TC
Leela 32425 Test30 (1+1 TC) 3591 31 54.5/100 25-16-59 (SF9) Strongest Lc0 Network 56,455,471
Stockfish 9 4CPU 3560 13 9449-2917=27634 (SF8 +57 Elo)
Leela ID 11258 v0.19.2 3547 15 144.5/300 35-46=219 48.2% (SF9) AntiFish's Main Engine to Surpass Main Goal is to Surpass ID 11258's Performance against Dev. 52,030,923
AntiFish Mark 25 (1+1 Time Control) 3532 29 46.0/100 18-26-56 (SF9) Main List Conditions 1+1 55,861
AntiFish/Stockfish Discord Stockfish 8 4CPU 3503 77 5267-881=13852 (SF7 +77 Elo)
Stockfish 7 4CPU 3426 62 10233-3197=26570 (SF6 +62 Elo)
Stockfish 6 4CPU 3364 44 9633-3723=26644 (SF5 +52 Elo)
Stockfish 10 (12,500,000 Nodes) 3320 8
Stockfish 5 4CPU 3312 55 11417-5108=23475 (SFDD +55 Elo)
Key: Latest Update: Stockfish Don Dailey (DD) 4CPU 3257 19 11787-4119=24094 (SF4 +67 Elo)
Latest Update Stockfish 10 (6,400,000 Nodes) 3238 24
AntiFish Leela Test40 ID 40446 3214 24 53.5/100 29-22-49 (SF4) 10,074,740
AntiFish 2nd Int. In Progress: Stockfish 4 4CPU 3190 57 6221-2988=0791 (SF3 +57 Elo)
Stockfish Stockfish 3 4CPU 3133 16 4493-2721=12786 (SF2.3.1 +31 Elo)
Leela Stockfish 10 (3,200,000 Nodes) 3117 15
Engines Stockfish 2.3.1 4CPU 3102 71 183.5/200 161-1=31 91.8% (SF1) Leela Chess Zero 6x64 is around this strength level.
AntiFish Mark 125 [1000 Steps] (3,125 Nodes) 3031 35 54-73-221 (SF10 3.2M) 96,308
Leela ID 32425 20x256 (3,125 Nodes) 2996 24 34 95 114 (SF10 3.2M)
Stockfish 10 (1,600,000 Nodes) 2972 151
Stockfish 10 (800,000 Nodes) 2821 137
Stockfish 1 4CPU 2684 16 16.5/200 1-168=31 8.3% (SF2.3.1) AntiFish Milestone #2
Stockfish 10 (400,000 Nodes) 2668 133
Leela ID 11258 v0.19.1.1 (800 Nodes) (400 Games) 2535 12 155 - 90 - 155 (SF10 200k) +/- 26.79 AntiFish Milestone #1 No temp 52,030,923
AntiFish Mark 125 [1000 Steps] (800 Nodes) 2523 45 41 - 28 - 31 (SF10 200k) Interesting, what this shows is that 800 nodes cannot be used reliably as it doesnt scale to higher TCs 96,308
Stockfish 10 (200,000 Nodes) 2478 10
AntiFish Mark 30 (800N) [2500 Steps] 2468 175 30 - 33 - 37 (SF10 200k) +/- 54.42 55,861
Stockfish 10 (100,000 Nodes) 2293 27
Stockfish 1 4CPU Weakened 10% 2266 194 16.5/200 2-169-29 8.3% (SF1)
Stockfish 10 (50,000 Nodes) 2072 224
AntiFish ID 2 v1 (800 Nodes) 1848 31 35 - 161 - 26 (SF10 50k) Only trained on 50k generated
Stockfish 10 (25,000 Nodes) 1817 187
Stockfish 1 4CPU Weakened 1% 1630 81 5.0/200 0-190=10 2.5% (SF1 10%)
Stockfish 10 (12,500 Nodes) 1549 286
Stockfish 10 (6,250 Nodes) 1263 286
Stockfish 10 (3,125 Nodes) 977 229
AntiFish ID 1 v2 (800 Nodes) 748 2 SF10 3125 Generate Games Only
Stockfish 10 (1,600 Nodes) 746 191
Stockfish 10 (800 Nodes) 555 129
Stockfish 10 (400 Nodes) 426 64
Stockfish 10 (200 Nodes) 362 40
Stockfish 10 (100 Nodes) 322 43
Stockfish 10 (50 Nodes) 279 45
Stockfish 10 (25 Nodes) 234 29
Stockfish 10 (16 Nodes) 205 21
Stockfish 10 (8 Nodes) 184 8
Stockfish 10 (4 Nodes) 176 5
Stockfish 10 (2 Nodes) 171 2
Stockfish 10 (1 Nodes) 169 169
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Leela ID 11248 vs. Stockfish Dev Aug 18 Equal Nodes & Time By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.)

Leela vs Stockfish Scaling

Calculation Time Sec. Calc Nodes [875:1 Ratio] Elo Diff to SF Leela Elo Stockfish Elo SF Elo Diff Performance
10^-4 [0.0001 S] 0.000100 1 vs 742 [Lc0 vs SF] +438.95 -1806.89 -2245.84 19.1 1792-88=120
0.000118 1 vs 875 +363.64 -1863.1 -2226.74 173.22 1664-103=233
0.000216 2 vs 1,600 +438.95 -1614.57 -2053.52 231.45 1792-88=120
0.000421 4 vs 3,125 +275.76 -1546.31 -1822.07 285.97 1567-246=187
0.000843 7 vs 6,250 +98.26 -1437.84 -1536.10 52.98 1106-555=339
10^-3 [0.001 S] 0.001 8 vs 7,418 [Lc0 vs SF] +52.16 -1430.96 -1483.12 233.47 976 - 678 - 346
0.00169 14 vs 12,500 -20.7 -1270.35 -1249.65 267.87 734 - 853 - 413
0.00337 29 vs 25,000 -71.89 -1053.67 -981.78 255.01 554 - 962 - 484
0.00674 57 vs 50,000 -90.78 -817.55 -726.77 106.8 452 - 963 - 585
10^-2 [0.01 S] 0.01 85 vs 74,183 -133.84 -753.81 -619.97 114.34 245-1173=1109
0.0135 114 vs 100,000 -104.87 -610.5 -505.63 184.88 377 - 963 - 660
0.0270 229 vs 200,000 -125.95 -446.7 -320.75 189.69 187 - 639 - 475
0.0539 457 vs 400,000 -137.98 -269.04 -131.06 131.06 117 - 533 - 452
10^-1 [0.1 S] 0.1 848 vs 741,825 -132.54 -132.54 0 22.38 212 - 940 - 848
0.108 914 vs 800,000 -137.17 -114.79 22.38 151.35 201 - 952 - 847
0.216 1,829 vs 1,600,000 -121.43 52.3 173.73 145.13 163 - 766 - 866
0.431 3,657 vs 3,200,000 -87.49 231.37 318.86 121.06 125 - 545 - 1033
0.863 7,314 vs 6,400,000 -53.6 386.32 439.92 13.88 94 - 227 - 548
10^0 [1 S] 1 8,478 & 7,418,250 -53.5 400.3 453.8 71.16 22 - 77 - 261
1.725 14,629 vs 12,800,000 -52.36 472.6 524.96 66.82 19 209 62
3.451 29,257 vs 25,600,000 -15.95 575.83 591.78 48.96 17 - 22 - 70
6.902 58,514 vs 51,200,000 -36.71 604.03 640.74 12.76 9 - 21 - 84
10^1 [10 S] 10 84,780 vs 74,182,500 -34.86 618.64 653.50 15.09 6 - 16 - 78
13.8 117,029 vs 102,400,000 -45.83 622.76 668.59 27.85 7 - 23 - 92

Settings and Details: Additional Information:

-No Book Set 0.1 seconds per move = 0 Elo For strongest opponent
-No Tablebase 1080TI vs i7 7700k [8,478 & 7,418,250 NPS Considered] (Adjusted Value)
-Mate to Win
-875:1 Node Ratio Maintained
-SF Elo relative to
SF Dev Aug 18 Scaling

0 0 1
1.92 1.92 2
6.52 4.6 4
14.56 8.04 8
35.52 20.96 16 Leela ID 11248 vs Stockfish Dev Aug 18
64.55 29.03 25 Nodes Elo Perfoirmance
109.71 45.16 50
152.22 42.51 100 1 vs 1 694.74 +/- 48.63 1942-14=44
192.13 39.91 200 2 vs 1,600 2 vs 2 919.54 +/- 125.31990-0=10
256.08 63.95 400 4 vs 3,125 4 vs 4
385.03 128.95 800 7 vs 6,250 8
576.34 191.31 1600 14 vs 12,500
807.79 231.45 3125 29 vs 25,000 16
1093.76 285.97 6250 57 vs 50,000 25
1380.21 286.45 12500 114 vs 100,000 50
1648.08 267.87 25000 229 vs 200,000
1903.09 255.01 50000 457 vs 400,000 100
2124.23 221.14 100000 914 vs 800,000 200
2309.11 184.88 200000 1,829 vs 1,600,000
400
2498.8 189.69 400000 3,657 vs 3,200,000
800
2652.24 153.44 800000 7,314 vs 6,400,000
1600
2803.59 151.35 1600000 14,629 vs 12,800,000
3125
2948.72 145.13 3200000 29,257 vs 25,600,000
6250
3069.78 121.06 6400000 58,514 vs 51,200,000
3154.82 85.04 12800000 117,029 vs 102,400,000
3221.64 66.82 25600000
3270.6 48.96 51200000 423.1 1777-99=124
3298.45 27.85 102400000 342.04 1628-118=254
3394.64 96.19 204800000
3443.6 48.96 409600000
3460.99 17.39 819200000

Calculation TimeSec. Calc Nodes [875:1 Ratio]

Elo Diff to SF Leela Elo Stockfish Elo
0.0539 457 vs 400,000 -137.98 -269.04 -131.06
10^-1 [0.1 S] 0.1 848 vs 741,825 -132.54 -132.54 0
0.108 914 vs 800,000 -137.17 -114.79 22.38
0.216 1,829 vs 1,600,000
-121.43 52.3 173.73
0.431 3,657 vs 3,200,000
-87.49 231.37 318.86
0.863 7,314 vs 6,400,000
-53.6 386.32 439.92
10^0 [1 S] 1 8,478 & 7,418,250-53.5 400.3 453.8
1.725 14,629 vs 12,800,000
-52.36 472.6 524.96
3.451 29,257 vs 25,600,000
-15.95 575.83 591.78
6.902 58,514 vs 51,200,000
-36.71 604.03 640.74
10^1 [10 S] 10 84,780 vs 74,182,500
-34.86 618.64 653.50
13.8 117,029 vs 102,400,000
-45.83 622.76 668.59

Leela vs Stockfish Scaling AlphaZero vs SF8 Hardware 80k vs 70M Nodes

Calculation Time
Sec. Calc Nodes [875:1 Ratio]
Leela Elo Stockfish Elo Elo Dif (Leela) Performance
1 vs 742 [Lc0 vs -1806.89
SF] -2245.84 +438.95 1792-88=120
1 vs 875 -1863.1 -2226.74 +363.64 1664-103=233
2 vs 1,600 -1614.57 -2053.52 +438.95 1792-88=120
4 vs 3,125 -1546.31 -1822.07 +275.76 1567-246=187
10^-4 [0.0001 S] 7 vs 6,250 -1437.84 -1536.10 +98.26 1106-555=339
8 vs 7,418 [Lc0 vs
-1430.96
SF] -1483.12 +52.16 976 - 678 - 346
14 vs 12,500 -1270.35 -1249.65 -20.7 734 - 853 - 413
29 vs 25,000 -1053.67 -981.78 -71.89 554 - 962 - 484
57 vs 50,000 -817.55 -726.77 -90.78 452 - 963 - 585
10^-3 [0.001 S] 85 vs 74,183 -753.81 -619.97 -133.84 245-1173=1109
114 vs 100,000 -610.5 -505.63 -104.87 377 - 963 - 660
229 vs 200,000 -446.7 -320.75 -125.95 187 - 639 - 475
457 vs 400,000 -269.04 -131.06 -137.98 117 - 533 - 452
10^-2 [0.01 S] 848 vs 741,825 -132.54 0 -132.54 212 - 940 - 848
914 vs 800,000 22.38
1,829 vs 1,600,000 173.73
3,657 vs 3,200,000
7,314 vs 6,400,000
10^-1 [0.1 S] 0.1 8,478 & 7,418,250 +125.51 397 - 50 - 555
14,629 vs 12,800,000
29,257 vs 25,600,000
58,514 vs 51,200,000 -36.71 9 - 21 - 84
10^0 [1 S] 1 84,780 vs 74,182,500 -34.86 6 - 16 - 78
117,029 vs 102,400,000 -45.83 7 - 23 - 92

10^1 [10 S]
A 40 block (Layer) Network will be the new SFDev of chess.
Stockfish 9 Scaling By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.) In Progress... This might take even longer than Lc0 Scaling

Stockfish Dev. August 18 Scaling Cost in Google Cloud Credits: $200

Stockfish Dev. August 18 Nodes vs. Delta Elo

For some reason Arena will keep calculating forever when I set SF weakened to 50%. Does anyone know how do fix this? Testing is unable to continue because of this weird glitch. Nodes Log [8]Elo Delta Elo Diff Info. Performance Notes Elo 25M [9]Elo Δ Draw %
1 0.000 0.00 0 540,000 Games 1 vs 1
2 0.301 1.92 1.92 540,000 Games [10]
260382-257398=22220 2 vs 1 4.11%
Clever, you looked behind the charts. This is another easteregg in my docs. 4 0.602 6.52 4.60 8,000 Games 3906-3800=294 4 vs 2 3.68%
Tell someone about it! 8 0.903 14.56 8.04 8,000 Games 3917-3732=351 8 vs 4 4.39%
16 1.204 35.52 20.96 8,000 Games 4067-3585=348 16 vs 8 4.35%
25 1.398 64.55 29.03 8,000 Games 4126-3459=415 25 vs 16 5.19%
50 1.699 109.71 45.16 8,000 Games 4292-3258=450 50 vs 25 5.63%
100 2.000 152.22 42.51 8,000 Games 4228-3254=518 100 vs 50 6.48%
200 2.301 192.13 39.91 8,000 Games 4237-3322=441 200 vs 100 5.51%
400 2.602 256.08 63.95 8,000 Games 4566-3110=324 400 vs 200 4.05%
800 2.903 385.03 128.95 8,000 Games 5206-2466=228 800 vs 400 2.85%
1,600 3.204 576.34 191.31 8,000 Games 5865-1857=278 1,600 vs 800 3.48%
3,125 3.495 807.79 231.45 8,000 Games 6127-1437=436 3,125 vs 1,600 5.45%
6,250 3.796 1,093.76 285.97 8,000 Games 6373-959=668 6,250 vs 3,125 8.35%
12,500 4.097 1,380.21 286.45 4,000 Games 3098-388=514 12,500 vs 6,250 12.85%
25,000 4.398 1,648.08 267.87 4,000 Games 2967-377=656 25k vs 12.5k 16.40%
50,000 4.699 1,903.09 255.01 2,000 Games 1408-157=435 50k vs 50k 21.75%
100,000 5.000 2,124.23 221.14 2,000 Games 1282-157=561 100k vs 50k 28.05%
200,000 5.301 2,309.11 184.88 1,000 Games 565-78=357 200k vs 100k 35.70%
400,000 5.602 2,498.80 189.69 400 Games 220-21=159 400k vs 200k 39.75%
800,000 5.903 2,652.24 153.44 200 Games 91-8=101 800k vs 400k 50.50%
1,600,000 6.204 2,803.59 151.35 200 Games 93-11=96 1.6M vs 800k 48.00%
3,200,000 6.505 2,948.72 145.13 200 Games 84-5=111 3.2M vs 1.6M 55.50%
6,400,000 6.806 3,069.78 121.06 200 Games 75-8=117 6.4M vs 3.2M 58.50%
12,800,000 7.107 3,154.82 85.04 200 Games 55-7=138 12.8M vs 6.4M 69.00%
25,600,000 7.408 3,221.64 66.82 100 Games 21-2=77 3 Sec. Per Move [11]
0 0 77.00%
51,200,000 7.709 3,270.60 48.96 100 Games 18-4=78 51.2M vs 25.6M 48.96 48.96 78.00%
102,400,000 8.010 3,298.45 27.85 100 Games 11-3=86 102M vs 51M 76.81 27.85 86.00%
204,800,000 8.311 3,394.64 96.19 100 Games 28-1=71 204M vs 102M 173 96.19 71.00%
409,600,000 8.612 3,443.60 48.96 100 Games 15-1=84 409M vs 204M 221.96 48.96 84.00%
819,200,000 8.913 3,460.99 17.39 100 Games 10-5-85 819M vs 409M 239.35 17.39 85.00%
1,638,400,000 9.214
3,276,800,000 9.515
6,553,600,000 9.816
13,107,200,000 10.118
26,214,400,000 10.419
52,428,800,000 10.720
104,857,600,000 11.021 100.00%

MORE INFO. BELOW Key:

Stockfish Latest Update
Notes: Stockfish
-Hash: 10 GB (Maxes out Nodes according
to the formula (T x S / 100) MB
-Special Thanks to Scs-ben for helping me
get Cutechess-cli setup!
-Book 2moves_LT_1000.pgn
-Both sides play same opening
-

Nodes Elo
25,600,000 3,221.64
51,200,000 3,270.60
102,400,000 3,298.45
204,800,000 3,394.64
409,600,000 3,443.60
819,200,000 3,460.99
1,638,400,000

Currently in progress...
This might take even Stockfish 9 Nodes vs. Delta ELO
longer than Lc0 Scaling Nodes Log10(Nodes)=X
Elo Delta ELO Diff. Info. Notes
50,000 4.699 0 0 100 Games 50,000 vs. 50,000
Key: 100,000 5.000 263 263 100 Games 100,000 vs. 50,000
Stockfish Latest Update 200,000 5.301 454 191 100 Games 200,000 vs. 100,000
Stockfish 400,000 5.602 622 168 100 Games 400,000 vs. 200,000
800,000 5.903 818 196 100 Games 800k vs. 400k
1,600,000 6.204 100 Games
3,200,000 6.505 100 Games
6,400,000 6.806 100 Games
12,800,0007.107 100 Games
25,600,0007.408 100 Games (3 Seconds per Move)
51,200,0007.709 100 Games
102,400,000
8.010 100 Games
204,800,000
8.311 100 Games
409,600,000
8.612 100 Games
819,200,000
8.913 100 Games
1,638,400,000
9.214
3,276,800,000
9.515
6,553,600,000
9.816
13,107,200,000
10.118
26,214,400,000
10.419
52,428,800,000
10.720
104,857,600,000
11.021

Notes:
-3 GB of Hash Data per opponent
is all I can manage with my hardware.
These eastereggs are out of control Note to self- Add a link later
Leela vs. Stockfish Scaling By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.) In Progress... This might take even longer than Lc0 Scaling MORE INFO. BELOW

Leela ID 10480 (Temp) vs. Stockfish Dev. August 18

Introducing the LeelaFish Ratio: 2048:1
Lc0 Nodes vs Delta ELO Stockfish Dev. August 18 Nodes vs. Delta ELO Stockfish Dev Aug.
Lc018Nodes vs Delta ELO
Nodes Log [12]
Node Calc [13]
Elo Elo Dif
Elo 50k [14]
Elo Dif Elo Elo DifElo 25M [15]Elo Dif Node Calc [16] Node Calc Stockfish Dev
Leela
Aug.ID
1810480 20x256
1 0.000 0.0001180 0 0 0.00 0 0.0000001554 0 0 0
2 0.301 0.0002359 139 139 1.92 1.92 0.0000003108 0 1.92 139
4 0.602 0.0004718 156 17 6.52 4.60 0.0000006217 0 6.52 156
8 0.903 0.0009436 191 35 14.56 8.04 0.0000012434 0 14.56 191
16 1.204 0.0018872 322 131 35.52 20.96 0.0000024868 0 35.52 322
25 1.398 0.0029488 469 147 64.55 29.03 0.0000038856 0 64.55 469
50 1.699 0.0058976 662 193 109.71 45.16 0.0000077712 0 109.71 662
100 2.000 0.0117952 824 162 152.22 42.51 0.0000155424 0 152.22 824
200 2.301 0.0235905 967 143 192.13 39.91 0.0000310849 0 192.13 967
400 2.602 0.0471809 1120 153 256.08 63.95 0.0000621698 0 256.08 1120
800 2.903 0.0943619 1218 98 385.03 128.95 0.0001243395 0 385.03 1218
1,600 3.204 0.1887238 1361 143 576.34 191.31 0.0002486791 0 576.34 1361
3,125 3.495 0.3686011 1488 127 807.79 231.45 0.0004857013 0 807.79 1488
6,250 3.796 0.7372022 1548 60 1,093.76 285.97 0.0009714027 0 1093.76 1548
12,500 4.097 1.474 1637 89 1,380.21 286.45 0.0019428054 0 1380.21 1637
25,000 4.398 2.949 1715 78 0 0 1,648.08 267.87 0.0038856107 0 1648.08 1715
50,000 4.699 5.898 1764 49 49 49 1,903.09 255.01 0.0077712215 0 1903.09 1764
100,000 5.000 11.8 1792 28 77 28 2,124.23 221.14 0.0155424429 0 2124.23 1792
200,000 5.301 23.6 1823 31 108 31 2,309.11 184.88 0.0310848858 0 2,309.11 1823
400,000 5.602 47.2 1823 0 108 0 2,498.80 189.69 0.0621697717 0 2,498.80 1823
800,000 5.903 94.4 2,652.24 153.44 0.1243395433 0 2,652.24
1,600,000 6.204 188.7 2,803.59 151.35 0.2486790866 0 2,803.59
3,200,000 6.505 377.4 2,948.72 145.13 0.4973581733 0 2,948.72
6,400,000 6.806 754.9 3,069.78 121.06 0.9947163465 1 3,069.78
12,800,000 7.107 1,509.8 3,154.82 85.04 1.989 2 3154.82
25,600,000 7.408 3,019.6 3,221.64 66.82 0 0 3.979 4 3,221.64
51,200,000 7.709 6,039.2 3,270.60 48.96 48.96 48.96 7.958 8 3,298.45
102,400,000 8.010 12,078.3 3,298.45 27.85 76.81 27.85 15.9 16 3,394.64
204,800,000 8.311 24,156.6 3,394.64 96.19 173 96.19 31.8 32 3,443.60
409,600,000 8.612 48,313.3 3,443.60 48.96 221.96 48.96 63.7 64 3,460.99
819,200,000 8.913 96,626.6 3,460.99 17.39 239.35 17.39 127.3 127
1,638,400,000 9.214 193,253.1 254.6 255
3,276,800,000 9.515 386,506.3 509.3 509
6,553,600,000 9.816 773,012.5 1,018.6 1,019
13,107,200,000 10.118 1,546,025 2,037.2 2,037
26,214,400,000 10.419 3,092,050 4,074.4 4,074
52,428,800,000 10.720 6,184,100 8,148.7 8,149
104,857,600,000 11.021 12,368,200 16,297.4 16,297
i7 7700k = 8,478 NPS
1080TI = 6,433,995 NPS
Stockfish Dev
Leela
Aug.ID
1810480 20x256
Notes: 0 0 3
-Hash: 10 GB (Maxes out Nodes according Key: 48.96 49 6
to the formula (T x S / 100) MB Stockfish Latest Update 76.81 77 12
-Special Thanks to Scs-ben for helping me Stockfish 173 108 24
get Cutechess-cli setup! 221.96 108 48
This column shows ELO relative to the time spent calculating nodes. 239.35 96
192
The following hardware is considered with their respected Nodes Per Second at the starting position of a game.

Stockfish Dev Aug. 18

0
1.92
Leela ID 10480 20x256 4.6
Node Calc 0 8.04
0.0000001554244291 0 139 20.96
0.0000003108488583 1.92 17 29.03
0.0000006216977166 6.52 35 45.16
0.000001243395433 14.56 131 42.51
0.000002486790866 35.52 147 39.91
0.000003885610729 64.55 193 63.95
0.000007771221457 109.71 162 128.95
0.00001554244291 152.22 143 191.31
0.00003108488583 192.13 153 231.45
0.00006216977166 256.08 98 285.97
0.0001243395433 385.03 143 286.45
0.0002486790866 576.34 127 267.87
0.0004857013411 807.79 60 255.01
0.0009714026822 1093.76 89 221.14
0.001942805364 1380.21 78 184.88
0.003885610729 1648.08 49 189.69
0.007771221457 1903.09 28 153.44
0.01554244291 2124.23 31 151.35
0.03108488583 2309.11 0 145.13
0.06216977166 2498.8 121.06
0.1243395433 2652.24 85.04
0.2486790866 2803.59 66.82
0.4973581733 48.96
0.9947163465 27.85
1.989432693 96.19
3.978865386 48.96
7.957730772 17.39
15.91546154
31.83092309
63.66184618 Nodes Stockfish Dev Aug. 18
127.3236924 1 0.00
254.6473847 2 1.92
509.2947694 4 6.52
1018.589539 8 14.56
2037.179078 16 35.52
4074.358155 25 64.55
8148.716311 50 109.71
16297.43262 100 Leela ID 10480 20x256 152.22
0.0001179523473 0 200 0 192.13
0.0002359046945 139 400 139 256.08
0.000471809389 156 800 156 385.03
Lc0 Nodes vs Delta ELO 0.000943618778 191 1,600 191 576.34
Nodes
Log10(Nodes)=X
Elo Delta ELO Diff.
Elo 50k [17]
ELO Diff.Info. Notes 0.001887237556 322 3,125 322 807.79
1 0.000 0 0 200 Games
1 vs 1 0.002948808681 469 6,250 469 1,093.76
2 0.301 139 139 200 Games
2 vs 1 0.005897617363 662 12,500 662 1,380.21
4 0.602 156 17 200 Games
4 vs 2 0.01179523473 824 25,000 824 1,648.08
8 0.903 191 35 200 Games
8 vs 4 0.02359046945 967 50,000 967 1,903.09
16 1.204 322 131 200 Games
16 vs 8 0.0471809389 1120 100,000 1120 2,124.23
25 1.398 469 147 200 Games
25 vs 16 0.0943618778 1218 200,000 1218 2,309.11
50 1.699 662 193 200 Games
50 vs 25 0.1887237556 1361 400,000 1361 2,498.80
100 2.000 824 162 200 Games
100 vs 50 0.3686010852 1488 800,000 1488 2,652.24
200 2.301 967 143 200 Games
200 vs 100 0.7372021703 1548 1,600,000 1548 2,803.59
400 2.602 1120 153 200 Games
400 vs 200 1.474404341 1637 3,200,000 1637 2,948.72
800 2.903 1218 98 200 Games
800 vs 400 2.948808681 1715 6,400,000 1715 3,069.78
1,600 3.204 1361 143 200 Games
1,600 vs 800 5.897617363 1764 12,800,000 1764 3,154.82
3,125 3.495 1488 127 100 Games
3,125 vs 1,600 11.79523473 1792 25,600,000 1792 3,221.64
6,250 3.796 1548 60 100 Games
6,250 vs 3,125 23.59046945 1823 51,200,000 1823 3,270.60
12,500 4.097 1637 89 100 Games
12,500 vs 6,250 47.1809389 1823 102,400,000 1823 3,298.45
25,000 4.398 1715 78 0 0 100 Games
3 Sec. Per Move 94.3618778 204,800,000 3,394.64
50,000 4.699 1764 49 49 49 100 Games
50k vs 25k 188.7237556 409,600,000 3,443.60
100,000 5.000 1792 28 77 28 100 Games
100k vs 50k 377.4475112 819,200,000 3,460.99
200,000 5.301 1823 31 108 31 100 Games
200k vs 100k 754.8950224 1,638,400,000
400,000 5.602 1823 0 108 0 100 Games
400k vs 200k 1509.790045 3,276,800,000
800,000 5.903 50 Games
800k vs 400k 3019.58009 6,553,600,000
1,600,000 6.204 50 Games
1.6M vs 800k (1.6M vs 50k Results=Similar) 6039.160179
3,200,000 6.505 50 Games
3.2M vs 800k 12078.32036
6,400,000 6.806 24156.64072
12,800,000 7.107 48313.28143
25,600,000 7.408 96626.56287
51,200,000 7.709 193253.1257
386506.2515
773012.5029
1546025.006
3092050.012
6184100.024
12368200.05
Stockfish Dev. August 18 Nodes vs. Delta ELO
Nodes Log [18]
Elo Delta ELO Diff.Info. Perf. NotesElo 25M [19]Elo Δ
1 0.000 0.00 0540,000 Games 1 vs 1
2 0.301 1.92 540,000
1.92 Games [20] 2 vs 1
260382-257398=22220
4 0.602 6.52 4.608,000 Games
3906-3800=294
4 vs 2
8 0.903 14.56 8.048,000 Games
3917-3732=351
8 vs 4
16 1.204 35.52 20.96
8,000 Games
4067-3585=348
16 vs 8
25 1.398 64.55 29.03
8,000 Games
4126-3459=415
25 vs 16
50 1.699 109.71 45.16
8,000 Games
4292-3258=450
50 vs 25
100 2.000 152.22 42.51
8,000 Games
4228-3254=518
100 vs 50
200 2.301 192.13 39.91
8,000 Games
4237-3322=441
200 vs 100
400 2.602 256.08 63.95
8,000 Games
4566-3110=324
400 vs 200
800 2.903 385.03 128.95
8,000 Games
5206-2466=228
800 vs 400
1,600 3.204 576.34 191.31
8,000 Games
5865-1857=278
1,600 vs 800
3,125 3.495 807.79 231.45
8,000 Games
6127-1437=436
3,125 vs 1,600
6,250 3.796 1,093.76 285.97
8,000 Games
6373-959=668
6,250 vs 3,125
12,500 4.097 1,380.21 286.45
4,000 Games
3098-388=514
12,500 vs 6,250
25,000 4.398 1,648.08 267.87
4,000 Games
2967-377=656
25k vs 12.5k
50,000 4.699 1,903.09 255.01
2,000 Games
1408-157=435
50k vs 50k
100,000 5.000 2,124.23 221.14
2,000 Games
1282-157=561
100k vs 50k
200,000 5.301 2,309.11 184.88
1,000 Games
565-78=357200k vs 100k
400,000 5.602 2,498.80 189.69
400 Games
220-21=159400k vs 200k
800,000 5.903 2,652.24 153.44
200 Games
91-8=101 800k vs 400k
1,600,000 6.204 2,803.59 151.35
200 Games
93-11=96 1.6M vs 800k
3,200,000 6.505 100 Games 3.2M vs 1.6M
6,400,000 6.806 100 Games 6.4M vs 3.2M
12,800,000 7.107 100 Games
25,600,000 7.408 100 Games 3 Sec. Per
0 Move 0
51,200,000 7.709 100 Games
102,400,000 8.010 100 Games
204,800,000 8.311 100 Games
409,600,000 8.612 100 Games
819,200,000 8.913 100 Games
1,638,400,000 9.214
3,276,800,000 9.515
6,553,600,000 9.816
13,107,200,000 10.118
26,214,400,000 10.419
52,428,800,000 10.720
104,857,600,000 11.021

Lc0 Nodes vs Delta ELO

Nodes Log10(Nodes)=X
Elo DeltaELO Diff.
Elo 50k [21]
ELO Diff. Info. Notes
1 0.000 0 0 200 Games
1 vs 1
2 0.301 139 139 200 Games
2 vs 1
4 0.602 156 17 200 Games
4 vs 2
8 0.903 191 35 200 Games
8 vs 4
16 1.204 322 131 200 Games
16 vs 8
25 1.398 469 147 200 Games
25 vs 16
50 1.699 662 193 200 Games
50 vs 25
100 2.000 824 162 200 Games
100 vs 50
200 2.301 967 143 200 Games
200 vs 100
400 2.602 1120 153 200 Games
400 vs 200
800 2.903 1218 98 200 Games
800 vs 400
1,600 3.204 1361 143 200 Games
1,600 vs 800
3,125 3.495 1488 127 100 Games
3,125 vs 1,600
6,250 3.796 1548 60 100 Games
6,250 vs 3,125
12,500 4.097 1637 89 100 Games
12,500 vs 6,250
25,000 4.398 1715 78 0 0 100 Games
3 Sec. Per Move
50,000 4.699 1764 49 49 49 100 Games
50k vs 25k
100,000 5.000 1792 28 77 28 100 Games
100k vs 50k
200,000 5.301 1823 31 108 31 100 Games
200k vs 100k
400,000 5.602 1823 0 108 0 100 Games
400k vs 200k
800,000 5.903 50 Games
800k vs 400k
1,600,000 6.204 50 Games
1.6M vs 800k (1.6M vs 50k Results=Similar)
3,200,000 6.505 50 Games
3.2M vs 800k
6,400,000 6.806
12,800,000 7.107
25,600,000 7.408
51,200,000 7.709

Lc0 Nodes vs Delta ELO Stockfish Dev. August 18 Nodes vs. Delta ELO
Nodes Log [22]
10^x Seconds
Elo Delta
ELO Diff.
Elo 50k [23]
ELO Diff.Nodes Log [24] 10^x Seconds
Elo Delta ELO Diff. Elo 25M [25] ELO Diff.
1 0.000 0 0 1 0.000 0.00 0
2 0.301 139 139 2 0.301 1.92 1.92
4 0.602 156 17 4 0.602 6.52 4.60
8 0.903 191 35 8 0.903 14.56 8.04
16 1.204 322 131 16 1.204 35.52 20.96
25 1.398 469 147 25 1.398 64.55 29.03
50 1.699 662 193 50 1.699 109.71 45.16
100 2.000 824 162 100 2.000 152.22 42.51
200 2.301 967 143 200 2.301 192.13 39.91
400 2.602 1120 153 400 2.602 256.08 63.95
800 2.903 1218 98 800 2.903 385.03 128.95
1,600 3.204 1361 143 1,600 3.204 576.34 191.31
3,125 3.495 1488 127 3,125 3.495 807.79 231.45
6,250 3.796 1548 60 6,250 3.796 1,093.76 285.97
12,500 4.097 1637 89 12,500 4.097 1,380.21 286.45
25,000 4.398 1715 78 0 0 25,000 4.398 1,648.08 267.87
50,000 4.699 1764 49 49 49 50,000 4.699 1,903.09 255.01
100,000 5.000 1792 28 77 28 100,000 5.000 2,124.23 221.14
200,000 5.301 1823 31 108 31 200,000 5.301 2,309.11 184.88
400,000 5.602 1823 0 108 0 400,000 5.602 2,498.80 189.69
800,000 5.903 800,000 5.903 2,652.24 153.44
1,600,000 6.204 1,600,000 6.204 2,803.59 151.35
3,200,000 6.505 3,200,000 6.505
6,400,000 6.806 6,400,000 6.806
12,800,000 7.107 12,800,0007.107
25,600,000 7.408 25,600,0007.408 0 0
51,200,000 7.709 51,200,0007.709
102,400,0008.010
204,800,0008.311
409,600,0008.612
819,200,0008.913
1,638,400,000
9.214
3,276,800,000
9.515
6,553,600,000
9.816
13,107,200,000
10.118
26,214,400,000
10.419
52,428,800,000
10.720
104,857,600,000
11.021
These eastereggs are out of control Note to self- Add a link later
Leela Chess Zero Rating List By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.) Leela Stream Link: (Online)
Work in progress https://www.twitch.tv/cscuile * If you have any suggestions or test requests
please leave a comment
RANK Name/Engine Elo Points & Perf. Self-Play ELO ELO Diff. ID/Version # Of Games Notes Hardware and Settings:
1 asmBrainFish 10 Dev (TCEC Hardware) 3846 20 Theoretical Estimates CPU i7 7700k 4CPU [26] Whenever you see a black triangle hover over [27]
2 asmBrainFish 10 Dev (64 Threads) 3826 52 18061321 Theoretical Estimates GPU (For Leela) GTX 1080 ti the cell for important information.
3 AlphaZero 4TPU 3774 7 44,000,000 80k NPS 20x256? Hash Data 1 GB Hover over me. [28] Leela Stream Link: (Offline)
4 Stockfish 10 Dev (64 Threads) [7/31/18] 3767 33 [7/31/18] Theoretical Estimates Book Perfect 2017 Leela Stream Link: (Live)
5 Leela ID 10751 4TPU 3734 [29] 4658.14 5 ID 10751 35,749,831 Theoretical Estimates Time Control 1+1
6 Stockfish 9 (64 Threads) 3729 53 Theoretical Estimates
7 asmBrainFish 10 Dev 4CPU 3676 2 18061321 Key:
8 Stockfish 8 (AlphaZero) [30] 3674 28 Latest Update: Leela Latest Update ```Leela Test Network ID 105 20x256 = 3 ELO```
9 asmBrainFish 9 4CPU [31] 3646 17 Leela ID 1250 Leela Next Test
10 Brainfish 9 4CPU [32] 3629 3 Leela
11 asmFish 10 Dev 4CPU 3626 4 Next Test: Leela Test Networks
12 Stockfish 10 Dev 4CPU [8/18/18] 3622 1 [8/18/18] 800M Scaling in Progress... (66/100) Stockfish/Variants
13 Stockfish 10 Dev 4CPU [8/14/18] 3621 4 [8/14/18] Stockfish Dev Aug 18 Scaling in Progress... Stockfish Theoretical
14 Stockfish 10 Dev 4CPU [7/31/18] 3617 8 [7/31/18] Leela 20x256 Scaling in Progress... AlphaZero **LcZero ID 12 Short Time Control Tests Complete (1+1) : 3 ELO**
15 Stockfish 10 Dev 4CPU [18061321] 3609 10 18061321 https://docs.google.com/spreadsheets/d/1ZAIuHR6n-5JTxKQc0XUSx1jyUrgVEcj8DNL
16 AlphaZero 1080 TI [Scaled from Lc0 10480] 3599 (Hover over for more info) [33] 3 44,000,000 Theoretical Estimates News: MORE INFO. TO THE RIGHT
17 asmFish 9 4CPU 3596 17 Stockfish Dev Scaling is currently taking a very
18 Stockfish 9 4CPU 3579 20 long time. **LcZero ID 1058 Short Time Control Tests Complete (1+1) : 3 ELO**
19 Leela ID 10751 20x256 3559 55.0/100 +23-13=64 (SF8) 4658.14 1 ID 10751 35,749,831 Stockfish 8 Surpassed!!! [34] However it will be worth it in the end! !sheet2
20 Leela ID 1058 3558 46.5/100 +11-18=71 (SF9) 4731.27 8 ID 1058 45,603,122
21 Leela ID 1250 3550 60.5/132 +18-29=85 (SF9) [35] 4759.29 2 ID 1250 51,743,683 45.8/100%
22 Leela ID 10765 20x256 3548 39.0/100 +7-29=64 (SFDev 8/14) 4637.21 11 ID 10765 36,202,970
23 Leela ID 1176 3537 44.0/100 10-22-68 (SF9) 4847.29 11 ID 1176 46,177,383
24 Leela ID 1036 3526 42.5/100 +12-27=61 (SF9) 4742.74 2 ID 1036 44,895,382 44+ Million Games Reached Notes: Notes 2:
25 Stockfish 8 4CPU [36] 3524 7 Fixed to 3524 ELO -Going by the expression "Doubling hardware adds +50 ELO to an engine" Stockfish 8 64 threads ELO -Leela Scaling has been the absolute worst and most time consuming thing I've ever done with a GPU.
26 Leela Test Network ID 10616 20x256 3517 49.0/100 +20-22=58 (SF8) 4423.24 7 ID 10616 31,434,670 should be +150 ELO to an 8 thread CPU Stockfish. It has taken me weeks of non-stop testing, and I'm only starting 1.6M Nodes per Move. I likely will not go above
27 Leela ID 10654 20x256 3510 48.0/100 +15-19=66 (SF8) 4419.98 3 ID 10654 32,646,948 -NOTE this rating list does not factor in the handicaps for Stockfish in the AlphaZero games. 3.2M as I would lose ELO accuracy due to the small sample sizes thanks to longer time controls.
28 Leela ID 10676 20x256 3507 47.5/100 +12-17=71 (SF8) 4471.03 0 ID 10676 33,347,802 -Lc0 CUDA is now used. I will however estimate 3.2M+ NPM's relative ELO based on the equation I get from the prior data points.
29 Leela Test Network ID 10578 20x256 3507 47.5/100 +16-21=63 (SF8) 4318.61 10 ID 10578 30,215,712 -Lc0 is tested against the version of SF closest to its strength with exceptions due to regression. -So a good rule of thumb with Lc0 is that Doubling Hardware Increases Playing Strength by 60 ELO
30 Leela Test Network ID 10480 20x256 3497 56.0/100 +21-9=70 (SF7) 4311.35 7 ID 10480 27,079,110 Wow, Stockfish 7 Surpassed -Hover over me to learn how I scaled AlphaZero 1080 TI. [37]
31 Leela ID 10859 20x256 3490 37.5/100 +8-33=59 (SF9) 4564.26 0 ID 10859 39,206,005 -3.00 Adjudicate to Resign.
32 Leela Test Network ID 10529 20x256 3490 55.0/100 +26-16=58 (SF7) 4320.3 3 ID 10529 28,636,970 -Leela Ratio 759:1 6,433,995 vs 8,478 Nodes Per Second [Starting Position Stockfish 8] NOTE This
33 Leela ID 10979 20x256 3487 37.0/100 +7-33=60 (SF9) 4734.74 1 ID 10979 43,045,752 Ratio will change significantly 2-5 moves into the game.
34 Leela ID 10924 20x256 3486 36.5/100 +5-32=63 (SF9) 4515.21 3 ID 10924 41,267,871
35 Leela ID 1000 3483 36.5/100 +11-38=51 (SF9) 4678.62 4 ID 1000 43,045,752 Interesting Notes:
36 Leela ID 10885 20x256 3479 36.0/100 +7-35=58 (SF9) 4474.06 3 ID 10885 40,024,064 All NPS are calculated from the starting position.
37 Ethereal 10.81 4CPU 3476 47.0/100 +20-26=54 (480) 1 10.81 [6x64] Network Speed: 76,047 Nodes Per Second
38 Leela ID 10695 20x256 3475 43.0/100 +8-22=70 (SF8) 4596.04 2 ID 10695 33,958,169 [10x128] Network Speed: 37,440 Nodes Per Second
39 Leela Test Network ID 10522 20x256 3473 54.0/100 +22-14=64 (SF7) 4304.59 2 ID 10522 28,414,632 [15x192] Network Speed: 15,771 Nodes Per Second
40 Fire 7.1 4CPU 3471 13 7.1 TCEC Div. P Strength [20x256] Network Speed: 8,478 Nodes Per Second
41 Leela Test Network ID 10504 20x256 3458 50.5/100 +18-17=65 (SF7) 4236.94 3 ID 10504 27,850,614 [40x256] Network Speed: 2,166 Nodes Per Second
42 Stockfish 7 4CPU 3455 7 Stockfish Dev Modern Aug 18 4 CPU: 6,433,995 Nodes Per Second
43 Leela Test Network ID 10444 20x256 3448 49.0/100 +16-18=66 (SF7) 4360.86 20 ID 10444 25,873,856 Stockfish Dev Haswell Aug 18 4 CPU: 7,048,370 Nodes Per Second
44 Leela Test Network ID 10395 20x256 3428 53.5/100 +22-15=63 (SF6) 4298.06 1 ID 10395 24,314,466 Stockfish 6 Surpassed!!!! Stockfish Dev Haswell Aug 18 16 CPU: 12,659,505 Nodes Per Second
45 Leela Test Network ID 10431 20x256 3427 46.0/100 +17-25=58 (SF7) 4304.48 3 ID 10431 25,465,785 Stockfish Dev Haswell Aug 18 24 CPU: 18,732,181 Nodes Per Second
46 Leela Test Net ID 10469 [No Adjudication] [38] 3424 45.5/100 +9-18=73 (SF7) 4325.85 17 ID 10469 26,661,915
47 Leela Test Network ID 10413 20x256 3407 50.5/100 +19-18=63 (SF6) 4306.22 3 ID 10413 24,894,625
48 Stockfish 6 4CPU 3404 54
49 Leela Test Network ID 10356 20x256 3350 52.0/100 +26-22=52 (SF5) 4258.34 14 ID 10356 23,071,622 SF5 Surpassed!!!!!!!!
50 Stockfish 5 4CPU 3336 3
51 Leela ID 495 3333 49.5/100 +20-21=59 (SF5) 6115.43 18 ID 495 20,833,185 6100 Self-Play ELO!
52 Leela ID 531 3315 47.0/100 +17-23=60 (SF5) 6216.3 3 ID 531 22,268,862
53 Leela ID 510 3312 46.5/100 +21-28=51 (SF5) 6115.32 0 ID 510 21,432,606
54 Leela ID 492 3312 36.5/100 +12-39=49 (SF6) 6099.57 11 ID 492 20,715,105
55 Leela ID 528 3301 45.0/100 +18-28=54 (SF5) 6186.37 3 ID 528 22,147,552
56 Leela ID 524 3298 44.5/100 +18-29=53 (SF5) 6155.62 11 ID 524 21,989,020
57 Leela ID 475 3287 43.0/100 +15-29=56 (SF5) 6047.08 0 ID 475 20,034,642
58 Leela ID 468 3287 42.5/100 +12-27=41 (SF5) 6010.17 3 ID 468 19,453,488
59 Stockfish DD 4CPU 3284 0
60 Leela ID 449 3237 5978.26 0 ID 449 18,994,340
61 Leela ID 461 3230 51.0/100 +27-25=48 (SF4) 6035.37 7 ID 461 19,475,428
62 Stockfish 4 4CPU 3223 0
63 Gull 3.1 4CPU 3223 21 3.1 TCEC Div. 1 Strength
64 Leela ID 465 3202 47.0/100 +22-28=50 (SF4) 6015.5 7 ID 465 19,634,452
65 Leela ID 439 3195 5934.04 7 ID 439 18,594,478
66 Leela ID 446 3188 5989.62 14 ID 446 18,875,091
67 Leela ID 457 3174 42.5/100 +17-32=51 (SF4) 6025.57 46 ID 457 19,314,795
68 Stockfish 3 4CPU 3128 13
69 Leela ID 452 3115 35.0/100 +15-45=40 (SF4) 6002.18 19 ID 452 19,114,975 First ID to reach 6000 ELO
70 Leela Test Network ID 10105 20x256 3096 57.0/100 +36-22=42 (SF2) 3854.13 49 ID 10105 6,862,408
71 Stockfish 2 4CPU 3047 142
72 Stockfish 1 4CPU 2905 42
73 Leela Test Network ID 10036 20x256 2863 44.0/100 +33-45=22 (SF1) 3356.83 340 ID 10036 2,176,981
74 Leela Test Network ID 10011 20x256 2523 10.0/100 +4-84=12 (SF1) 2609.24 0 ID 10011 675,649 First 20x256 Block Test
75
76
77
78
79
80
81
82
83

MORE INFO. Down

 check back here later...
716/18

Easter egg? You found one! Note to self: Add a link here later.
Rating List by Cscuile Leela Chess Zero Rating List (1+1 Time Control)
Work in Progress! 66960278 124271994 57311716
RANK Name/Engine Elo Dif Performance Notes # of Games Self Elo News: Hardware and Settings:
1 asmBrainFish 10 Dev 64CPU [10/14/18] 3851 66 Based on Scaling Equation CPU i7 7700k 4CPU [39]
2 Stockfish 10 64CPU 3785 11 Theoretical Est. (Hover for Equation) [40] GPU (For Leela) GTX 1080 TI **Leela ID 21727: 3247 Elo** https://docs.google.com/spreadsheets/d/1ZAIuHR6n-5JTxKQc0XUSx1
3 AlphaZero 4TPU [41] 3774 43 28-0=72 (SF8 AlphaZero) Upperbound Highest Elo Possible 44,000,000 Hash Data 1 GB
4 Stockfish 9 64CPU (AlphaZero) 3731 5 (SF9 +57 Elo to SF8) Book Balsa v2401 (From Perfect2017)
5 AlphaZero 2018 4TPU 3726 40 155-6=839 (SF8) +52 Elo Settings Misc. All Defaults, No Tablebase
6 AlphaZero 4TPU [No Handicaps] [42] 3686 10 <- Hover Over Me for more Info. Includes: TB, Book, Hash Node Ratio 4CPU 863:1 (7,318,351:8,478 NPS)
7 asmBrainFish 10 Dev 4CPU [10/14/18] 3676 2 Have any requests? Feel free to leave a comment (#Cscuile0044) LeelaFish Ratio [2048:1] 0.421 LeelaFish Ratio
8 Stockfish 8 64CPU (AlphaZero) [43] 3674 17 Calibrated from SF Dev Scaling NOTE: Dependant on Time Control AZ-SF8 Ratio [875:1] 0.987 A0-SF8 Ratio
9 BrainFish 10 Dev 4CPU [9/27/18] 3657 30 Latest Update: Time Control 1+1
10 asmBrainFish 9 4CPU 3627 3 Leela Test30 ID 32483 AND 32426
11 asmFish 10 Dev 4CPU [9/27/18] 3624 1 Google Groups Box:
12 Stockfish 11 Dev [12/13/18] 3623 8 In Progress:
13 Stockfish 10 4CPU 3615 4 179.0/300 83-25=192 (Lc0 11258) [44] +68 Elo to Leela ID 11258
14 AlphaZero 1080TI 3611 1 Hover over me: Based on Lc0 Scaling [45]44,000,000
15 BrainFish 9 4CPU 3610 19
16 Leela Test30 ID 32425 3591 10 54.5/100 25-16-59 (SF9) Impressive. 56,455,471 10547.46 Key:
17 Leela Test30 ID 32483 3581 4 53.0/100 28-22=50 (SF9) Leela Latest Update
18 asmFish 9 4CPU 3577 14 Leela Test30
19 Leela Test30 ID 32406 3563 0 50.5/100 16-15-69 (SF9) 55,848,193 10591.50 Leela Test10
20 Stockfish 9 4CPU 3560 10 9449-2917=27634 (SF8 +57 Elo) Fixed to CCRL 40/4 3560 Elo Leela Test 20
21 AlphaZero 2018 1080TI [46] 3555 5 155-6=839 (SF8) +52 Elo AlphaZero 2018 Papers Stockfish/Variants Tests to do:
22 Leela 11248 128x10 SE Distilled CCRL 3550 3 48.5/100 14-17-69 (SF9) NOTE: Loses Elo at higher TCs Stockfish Theoretical -ID 11258 vs SF5
23 Leela ID 11258 v0.19.2 3547 1 144.5/300 35-46=219 48.2% (SF9) 52,030,923 4772.41 AlphaZero -Stockfish 10 vs Stockfish 1
24 Leela Test30 ID 32395 3546 1 48.0/100 21-25-54 (SF9) AntiFish
25 Leela Test30 ID 32406 (SF10) 3545 0 40.0/100 10-30-60 (SF10 -70 Elo) 55,848,193 10591.50
26 AlphaZero 1080TI [No Handicaps] 3545 3 Includes: Book, Hash 44,000,000
27 AlphaZero 2018 1080TI TCEC Openings 3542 2 17-8=75 (SF8) +39 Elo AlphaZero with TCEC Openings Glossary of my L.e.e.l.a Docs
28 Leela ID 11258 v0.18.0 3540 5 141.5/300 37-54=209 47.2% (SF9) 52,030,923 4772.41 -Main Lists Rating Lists (3)
29 Leela ID 11248 3535 2 139.5/300 37-58=205 46.5% (SF9) 51,680,094 4785.12 -SF and Leela Scaling
30 Leela ID 11250 3533 1 138.5/300 42-65=193 46.2% (SF9) 51,743,683 4759.29 -A0 vs SF Scaling Recreation
31 Leela 11248 Boosted CCRL 3532 0 46.0/100 13-21-66 (SF9) Net by Dockoan -20b vs 15b Scaling
32 Leela Test30 ID 32353 3532 0 46.0/100 13-21-66 (SF9) 54,148,131 10415.42 -List of Resources and other Lists
33 AntiFish Mark 25 3532 0 46.0/100 18-26-56 (SF9) 55,861 -Definitons for Chess Engines
34 Leela ID 11246 3532 2 138.0/300 31-55=214 46% (SF9) 51,619,693 4762.59 [ALL SHEETS] LcZero ELO Estimate List Approximation [L.e.e.l.a]
35 Leela ID 11249 3530 6 91.5/200 30-47=123 45.8% (SF9) 51,716,692 4768.46 [Public] LcZero ELO Estimate List Approximation [L.e.e.l.a]
36 Leela ID 11254 3524 4 134.5/300 33-64=203 44.8% (SF9) 51,965,907 4737.53 -Home of the AntiFish Neural Network Project
37 Leela ID 11089 3520 17 89.5/202 18-41=143 44.3% (SF9) 46,598,129 4678.12
38 Stockfish 8 4CPU 3503 10 5267-881=13852 (SF7 +77 Elo) SF2.3.1 to 9 Tests from FishTest Interesting Notes:
39 Leela Test30 ID 32426 3493 25 40.5/100 10-29=61 (SF9) Important Notes: All NPS are calculated from the starting position.
40 Leela Test30 ID 31751 3468 7 45.0/100 14-24=62 (SF8) 8534.38 -Elo Scaling will be different at higher TC since at higher [6x64] Network Speed: 76,047 Nodes Per Second
41 Leela Test30 ID 31703 3461 25 55.0/100 24-14=62 (SF7) 8416.63 Nodes you have less area to improve, thus Elo gain decreases. [10x128] Network Speed: 37,440 Nodes Per Second
42 Leela Test30 ID 32089 3436 3 40.5/100 13-32-55 (SF8) Over 9000!!! 45,452,403 9571.28 -NOTE All settings are default, I do not alter any settings [15x192] Network Speed: 15,771 Nodes Per Second
43 Leela Test30 ID 31811 3433 7 40.0/100 9-29=62 (SF8) 8609.08 for my tests unless otherwise tested. [20x256] Network Speed: 8,478 Nodes Per Second
44 Stockfish 7 4CPU 3426 21 10233-3197=26570 (SF6 +62 Elo) -Ordo's Elo Error bars differ significantly from what is [40x256] Network Speed: 2,166 Nodes Per Second
45 Leela Test30 ID 31657 3405 3 47.0/100 22-28=50 (SF7) 31,348,914 8289.68 measured.
46 Leela Test30 ID 31559 3402 4 46.5/100 14-21=65 (SF7) 7966.85 -Elo Error Bars heavily vary based on Engine SF Dev Modern Aug 18 4 CPU: 6,433,995 Nodes Per Second
47 Leela Test30 ID 31474 3398 7 46.0/100 13-21=66 (SF7) v19 Used 7090.42 Settings and Hardware relative to Time Control SF Dev Haswell Aug 18 4 CPU: 7,048,370 Nodes Per Second
48 Leela Test30 ID 31437 3391 10 45.0/100 15-25=60 (SF7) 6849.57 SF Dev Haswell Aug 18 16 CPU: 12,659,505 Nodes Per Second
49 Leela Test30 ID 31510 3381 10 43.5/100 16-29=55 (SF7) 7579.10 Notes: SF Dev Haswell Aug 18 24 CPU: 18,732,181 Nodes Per Second
50 Leela Test30 ID 31400 3371 6 51.0/100 19-17=64 (SF6) 23,099,660 6491.30 -70 Moves Avg
51 Leela Test30 ID 31332 3365 1 57.5/100 26-11=63 (SF5) Test20, SF5, and SF6 Surpassed! 20,919,833 6065.85 -2.8 Seconds Per Move Avg. SF9 Popcnt 8CPU: 10,643,211 NPS 1255:1 to 1080 TI
52 Stockfish 6 4CPU 3364 38 9633-3723=26644 (SF5 +52 Elo) -1945 + 74.7 ln(x) is the equation used to estimate theoretical SF9 Popcnt 6CPU: 9,959,519 NPS
53 Leela Test30 ID 31363 3326 14 44.5/100 14-25=61 (SF6) 6229.05 engines. SF9 Popcnt 4CPU: 7,318,351 NPS
54 Stockfish 5 4CPU 3312 0 11417-5108=23475 (SFDD +55 Elo) -4CPU refers to Logical Cores (Threads) SF9 Bmi2 4CPU: 6,888,716 NPS
55 Leela 22160 3312 7 50.0/100 27-27=46 (SF5) 57,311,716 4194.60 -All games after 20776 and 11248 will use mirrored openings SF9 x64 4CPU: 6,394,606 NPS
56 Leela Test30 ID 31250 Policy Sharp 3305 10 49.0/100 22-24=54 (SF5) 18,293,854 5122.08 with Perfect 2017's Balsa PGN! SF9 x32 4CPU: 4,740,987 NPS
57 Leela Test30 ID 31093 3295 7 55.5/100 27-16=57 (SFDD) 4556.09 http://lc0.org/cscuile
58 Leela Test30 ID 31290 3288 0 46.5/100 19-26=55 (SF5) 5543.47
59 Leela Test30 ID 31117 3288 0 93.0/200 36-50=114 (SF5) 4693.56
60 Leela 22088 LR Drop 3288 3 46.5/100 21-28=51 (SF5) 55,018,019 4240.88
61 Leela 21959 3285 4 54.0/100 30-22=48 (SFDD) 50,894,006 4269.27
62 Leela Test30 ID 31215 3281 24 45.5/100 19-28=53 (SF5) 4951.00
63 Stockfish Don Dailey (DD) 4CPU 3257 3 11787-4119=24094 (SF4 +67 Elo) In Memory of Komodo's Author
64 Leela Test30 ID 31000 3254 5 49.5/100 19-20=61 (SFDD) 11,356,411 4378.07
65 Leela 22022 3249 2 41.0/100 15-33=52 (SF5)
66 Leela 21727 3247 7 48.5/100 23-26=51 (SFDD)
67 Leela 21680 3240 14 47.5/100 23-28=49 (SFDD)
68 Leela 21628 3226 5 45.5/100 27-36=37 (SFDD)
69 Leela Test30 ID 30943 3221 9 54.5/100 30-21=49 (SF4) v18 Used 4517.43
70 Leela Test30 ID 31058 3212 1 43.5/100 19-32=49 (SFDD) 4476.68
71 Leela 21544 3211 21 53.0/100 31-25=44 (SF4)
72 Stockfish 4 4CPU 3190 1 6221-2988=0791 (SF3 +57 Elo)
73 Leela 21455 3189 9 58/100 38-22=40 (SF3) 34,287,692 4439.11
74 Leela 21471 3180 36 48.5/100 29-32=39 (SF4)
75 Leela Test30 ID 30929 3144 11 56.0/100 34-22=44 (SF2.3.1) 10,205,729 4473.28
76 Stockfish 3 4CPU 3133 17 4493-2721=12786 (SF2.3.1 +31 Elo)
77 Leela 21358 3116 14 91.5/176 53-46=77 (SF2.3.1) 31,723,779 4237.95
78 Stockfish 2.3.1 4CPU 3102 7 183.5/200 161-1=31 91.8% (SF1)
79 Leela 9155 6x64 Block v19.1 RC2 3095 1 49.0/100 23-25-52 (SF2.3.1) AlphaZero Cpuct Formula 8,128,000
80 Leela Test30 ID 30899 3094 20 48.5/100 26-29-45 (SF2.3.1)
81 Leela 9155 6x64 Block v19 3074 10 46.0/100 23-31-46 (SF2.3.1) Main Leela ID to Surpass 8,128,000
82 Leela 20683 3064 18 44.5/100 26-37=37 (SF2.3.1) 19,005,573 4052.65
83 Leela Test30 ID 30861 SWA + LR Drop 3046 7 42.0/100 21-37=42 (SF2.3.1) 9,064,627 4087.42
84 Leela 20776 3039 4 41.0/100 26-44=30 (SF2.3.1) 20,895,367 4039.08
85 Leela 20735 3035 48 40.5/100 22-41=37 (SF2.3.1) 20,242,296 4103.17
86 Leela Test30 ID 30763 2987 23 34.0/100 14-46=40 (SF2.3.1)
87 Leela 20710 2964 13 32.0/100 19-55=26 (SF2.3.1) 19,845,332 4113.77
88 Leela 20698 2951 5 29.5/100 15-56=29 (SF2.3.1) 19,476,722 4132.28
89 Leela 20904 2946 4 29.0/100 18-60=22 (SF2.3.1) 22,542,690 4157.50
90 Leela Test30 ID 30679 SWA 2942 5 28.5/100 13-56=31 (SF2.3.1)
91 Leela 20633 2937 93 24.5/100 10-61=29 (SF3) 17,378,264 3899.50
92 Leela Test30 ID 30646 2844 160 9-72=19 (SF2.3.1) 7,007,000 3697.95
93 Stockfish 1 4CPU 2684 418 16.5/200 1-168=31 8.3% (SF2.3.1)
94 Stockfish 1 4CPU Weakened 10% 2266 636 16.5/200 2-169-29 8.3% (SF1)
95 Stockfish 1 4CPU Weakened 1% 1630 5.0/200 0-190=10 2.5% (SF1 10%)
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
[1] 4 Core, 8 Threads

[2] SF10 64 CPU

+175 Elo to SF10 4CPU
asmBrainFish 10
+67 Elo to SF10

[3] # cp = 162 * tan(3.14 * (feval - 0.5))

import math
cp = input("Enter Centipawn: ")

#cp = 290.681 * tan(3.0962 * (feval - 0.5));

cp = (int(cp) / 290.680623072)

cp = (math.atan(cp))

cp = (cp / 3.0962)

cp = (cp + 0.5)

cp = cp * 100
print(cp)

win = 0
draw = 0
loss = 0

if cp > 50:
win = (cp - 50) * 2
draw = 100 - win
loss = 0

elif cp == 50:
draw = 100

else:
win = 0
loss = (50 - cp) * 2
draw = 100 - loss

print('Win: %.2f%% - Draw: %.2f%% - Loss: %.2f%%' % (win, draw, loss))

[4] Scaling based off of LCZ rating list (CCRL Estimates)

This Estimate scales a 20k nps Titan V to Deepmind's 80k nps on 4 TPUs. 1+1 Time Control is used, with
an average game length being 40 moves.

[5] policy loss is cross entropy

for each possible output the partial cross entropy is the target probability times the log of 1/(network output
probability)
the sum of those is the cross entropy -Tilps

[6] Link to Games PGN Download: https://drive.google.com/file/d/1nE-f-SuizjdWElAAyysLr0CIpSL2G-

tb/view?usp=sharing
[6] Link to Games PGN Download: https://drive.google.com/file/d/1nE-f-SuizjdWElAAyysLr0CIpSL2G-
tb/view?usp=sharing

[7] Link to Games PGN Download: https://drive.google.com/file/d/1nE-f-SuizjdWElAAyysLr0CIpSL2G-

tb/view?usp=sharing

[8] Log10(Nodes)=X

[9] 25.6M vs 25.6M Nodes Per Move is set to 0 ELO.

[10] Five-Hundred Forty-Thousand to one. Lucky you, ta ta. Some may get this reference.

Note: I needed this many games in order to minimize the ELO error bar.

[11] 25.6M vs 12.8M

[12] Log10(Nodes)=X

[13] This column shows ELO relative to the time spent calculating nodes.

The following hardware is considered with their respected Nodes Per Second at the starting position of a
game.

i7 7700k = 8,478 NPS

1080TI = 6,433,995 NPS

[14] 50,000 vs. 50,000 Nodes per Move is set as 0 ELO

[15] 25.6M vs 25.6M Nodes Per Move is set to 0 ELO.

[16] This column shows ELO relative to the time spent calculating nodes.

The following hardware is considered with their respected Nodes Per Second at the starting position of a
game.

i7 7700k = 8,478 NPS

1080TI = 6,433,995 NPS

[17] 50,000 vs. 50,000 Nodes per Move is set as 0 ELO

[18] Log10(Nodes)=X

[19] 25.6M vs 25.6M Nodes Per Move is set to 0 ELO.

[20] Five-Hundred Forty-Thousand to one. Lucky you, ta ta. Some may get this reference.

Note: I needed this many games in order to minimize the ELO error bar.

[21] 50,000 vs. 50,000 Nodes per Move is set as 0 ELO

[22] Log10(Nodes)=X

[23] 50,000 vs. 50,000 Nodes per Move is set as 0 ELO

[24] Log10(Nodes)=X
[25] 25.6M vs 25.6M Nodes Per Move is set to 0 ELO.

[26] 4 CPU

[27] This is an example

[28] If you have any test requests such as "What's Leela's ELO ran on x10 Nvidia Tesla v100's" just post a
comment. You can find the comment button on the top right corner of the screen.

[29] Equation Used: (8/11/18)

-3.36 + 169ln(x)

[30] Stockfish 8 under Deepmind Settings

[31] asmFish with the Cerebellum Opening Library

[32] Brainfish uses the Cerebellum Book Library

[33] AlphaZero 1080TI is scaled against Leela ID 10480 20x256 Network Architecture. You can find 20
Block Scaling information on the "Lc0 Scaling [20x256]" Doc to the right.
Equation Used: (8/11/18)
-3.36 + 169ln(x)

[34] This is quite the milestone! Leela ID 10751 ran on a 1080TI is stronger than Stockfish 8 ran on a 4 core
i7 7700k

[35] 45.8%/100%

[36] Stockfish 8 4CPU 8 Threads under normal hardware and setting conditions.

[37] AlphaZero 1080TI is scaled against Leela ID 10480 20x256 Network Architecture. You can find 20
Block Scaling information on the "Lc0 Scaling [20x256]" Doc to the right.
Equation Used: (8/11/18)
-3.36 + 169ln(x)
Avg, 2.5 seconds per move

[38] Each engine must mate in order to win. There is no longer a win margin. IE: No more -3.00 =
Adjudicated to Win

[39] 4 Core, 8 Threads

[40] Equation Used: 1945 + 74.7 ln(x)

[41] Estimates based on Stockfish Dev Aug 18 Scaling

[42] Stockfish 8 [With 32 GB Hash, BOOK, 7-Men Tablebase]:

22 (TB) + 36 (Book) + 30 (Hash) = 88 Elo to SF8 (AlphaZero)

Stockfish: +88 Elo (Minimum)

AlphaZero: +12 Elo to SF8

--Stockfish 8 [7-Men TB]:

+22 Elo

--Stockfish 8 [BOOK]:
Stockfish: +88 Elo (Minimum)

AlphaZero: +12 Elo to SF8

--Stockfish 8 [7-Men TB]:

+22 Elo

--Stockfish 8 [BOOK]:
+36 Elo

(Lc0 (No Book 3540 Elo) vs SF8 (No Book 3560 Elo) 157.0/300 51-37=212 (+16 Elo)

--Stockfish 8 [32 GB Hash]

+30-50 Elo

(Estimates, this is very difficult to test due to the very high node counts and my hardware hash limitations)

[43] Calibration of SF8 (A0) from SF Dev Aug 18 Scaling (1+1):

Stockfish (AlphaZero)

2.8 Seconds per Move Average

2.8 x 70,000,000 = 196,000,000 (64 CPU As per Deepmind Papers)

2.8 x 6,433,995 = 19,735,436 (4CPU)

Equation Used: 1945 + 74.7 ln(x)

4 CPU: 1945 + 74.7 ln(19,735,436) = 3199.81

64 CPU (AlphaZero): 1945 + 74.7 ln(196,000,000) = 3371.29

3371.29 - 3199.81
= 171 Elo Difference

[44] Link to Games PGN Download: https://drive.google.com/file/d/1nE-f-SuizjdWElAAyysLr0CIpSL2G-

tb/view?usp=sharing

[45] Calibration of AlphaZero on a 1080TI

Equation Used: 937 + 72.7 ln(x)

From Leela ID 480 Scaling

2.8 x 80,000 = 224,000 (AlphaZero 4TPU)

2.8 x 8,478 = 23,738 (AlphaZero 1080TI)

937 + 72.7 ln(224,000) = 1832.60 Elo

937 + 72.7 ln(23,738) = 1669.44 Elo

1832.60 - 1669.44 = 163 Elo

[46] 3 Hour Matches