chessgod101
Please login to view all of the forum content.

TOP 3 testing

View previous topic View next topic Go down

TOP 3 testing

Post  maelic on Sun Dec 22, 2013 8:55 am

Hi,
I tested top 3 engines - Houdini 4 Pro x64 A v1x, Komodo TCEC 64-bit and Stockfish 191213 64 SSE4.2
Test was under LittleBlitzer program.

Round robin
1500 games
128 MB hash
Time conrol: 100ms/move
No book

Results
--------------
Spoiler:
Games Completed = 1500 of 1500 (Avg game length = 19.855 sec)
Settings = RR/128MB/100ms per move/M 1000cp for 12 moves, D 150 moves/
Time = 15787 sec elapsed
1.  Stockfish 191213         529.0/1000 358-300-342   (L: m=148 t=0 i=0 a=152) (D: r=222 i=68 f=16 s=7 a=29) (tpm=122.8 d=16.78 nps=1228579)
2.  Komodo TCEC               486.5/1000 321-348-331   (L: m=289 t=0 i=0 a=59) (D: r=181 i=95 f=15 s=10 a=30) (tpm=128.2 d=12.96 nps=1107529)
3.  Houdini 4 Pro             484.5/1000 301-332-367   (L: m=183 t=0 i=0 a=149) (D: r=259 i=55 f=19 s=7 a=27) (tpm=149.0 d=13.83 nps=1376099)

Result Columns
--------------
Spoiler:
After the engine names, there will be 5 groups of columns with data.

For example:
1.  LittleThought v1.06.72   11989.0/23644 11023-10689-1932   (L: m=5083 t=198 i=0 a=5408) (D: r=1018 i=511 f=225 s=87 a=91) (tpm=112.4 d=10.2 nps=827951)

1. Score (points/games played)
    e.g. score of 11989 over 23644 games
2. Score Breakdown (wins-losses-draws)
    e.g. 11023 wins, 10689 losses, 1932 draws
3. Loss reasons (m = mated, t = timed out, i = illegal moves, a = adjudication)
    e.g. 5083 mated, 198 timeouts, 0 illegal moves, 5408 adjudicated losses
4. Draw reasons (r = repetition, i = insufficient material, f = 50 moves, s = stalemate, a = adjudication)
    e.g. 1018 repetitions, 511 insufficient material, 225 50-moves, 87 stalemates, 91 adjudicated draws
5. Engine stats (tpm = avg time per move, d = avg depth, nps = avg nps)
    e.g. 112.4 ms/move, 10.2 ply, 827951 nps


Best regards
maelic

maelic

Posts : 212
Points : 282
Reputation : 42
Join date : 2012-11-03
Age : 22
Location : Czech Republic

View user profile

Back to top Go down

Re: TOP 3 testing

Post  maelic on Sun Dec 22, 2013 10:53 am

I forgot to post game database for this tournament.
Here it goes:
Code:
https://mega.co.nz/#!YFMCjI5S!EQbkWWNmYHRkPQjKcl4eF3UXRGYyBpbrLfxfcnBvn6s

best regards
maelic

maelic

Posts : 212
Points : 282
Reputation : 42
Join date : 2012-11-03
Age : 22
Location : Czech Republic

View user profile

Back to top Go down

Re: TOP 3 testing

Post  maelic on Sun Dec 22, 2013 2:16 pm

And another one.
Top 3 engines - Houdini 4 Pro x64 A v1x, Komodo TCEC 64-bit and Stockfish 191213 64 SSE4.2
Test was under LittleBlitzer program.

Round robin
1500 games
128 MB hash
Time conrol: 100ms/move
No book

Results
--------------
Spoiler:
Games Completed = 2000 of 2000 (Avg game length = 19.295 sec)
Settings = RR/128MB/100ms per move/M 1000cp for 12 moves, D 150 moves/
Time = 34303 sec elapsed, 0 sec remaining
1.  Stockfish 191213         707.0/1334 479-399-456   (L: m=197 t=0 i=0 a=202) (D: r=304 i=87 f=19 s=9 a=37) (tpm=120.9 d=16.72 nps=1182938)
2.  Komodo TCEC               647.0/1333 428-467-438   (L: m=385 t=0 i=0 a=82) (D: r=251 i=116 f=18 s=13 a=40) (tpm=126.7 d=12.84 nps=1055356)
3.  Houdini 4 Pro             646.0/1333 406-447-480   (L: m=256 t=0 i=0 a=191) (D: r=351 i=65 f=23 s=8 a=33) (tpm=145.1 d=13.76 nps=1348426)

Result Columns
--------------
Spoiler:
After the engine names, there will be 5 groups of columns with data.

For example:
1.  LittleThought v1.06.72   11989.0/23644 11023-10689-1932   (L: m=5083 t=198 i=0 a=5408) (D: r=1018 i=511 f=225 s=87 a=91) (tpm=112.4 d=10.2 nps=827951)

1. Score (points/games played)
   e.g. score of 11989 over 23644 games
2. Score Breakdown (wins-losses-draws)
   e.g. 11023 wins, 10689 losses, 1932 draws
3. Loss reasons (m = mated, t = timed out, i = illegal moves, a = adjudication)
   e.g. 5083 mated, 198 timeouts, 0 illegal moves, 5408 adjudicated losses
4. Draw reasons (r = repetition, i = insufficient material, f = 50 moves, s = stalemate, a = adjudication)
   e.g. 1018 repetitions, 511 insufficient material, 225 50-moves, 87 stalemates, 91 adjudicated draws
5. Engine stats (tpm = avg time per move, d = avg depth, nps = avg nps)
   e.g. 112.4 ms/move, 10.2 ply, 827951 nps

Game database PNG
Code:
https://mega.co.nz/#!oBlVHAhQ!G8U2AE84kHKPeVa8BB_FJUq8NaB7VDsj5sSfwm0EsVI


Best regards
maelic

maelic

Posts : 212
Points : 282
Reputation : 42
Join date : 2012-11-03
Age : 22
Location : Czech Republic

View user profile

Back to top Go down

Re: TOP 3 testing

Post  Sponsored content Today at 4:44 pm


Sponsored content


Back to top Go down

View previous topic View next topic Back to top

- Similar topics

Permissions in this forum:
You cannot reply to topics in this forum