chessgod101
Please login to view all of the forum content.

SCCT - Tactical Test Suite's Results

View previous topic View next topic Go down

SCCT - Tactical Test Suite's Results

Post  gary on Sun Aug 30, 2015 9:47 am

SCCT - Tactical Test Suite's Results

Update - 30.08.2015:

Code:
Engine                    : Points
Stockfish 170815 x64      : 309
Synapse RZ4 WSET Tact x64 : 301
KingAsad D100815 x64      : 301
SugaR PrO v1.0 64         : 300
DeathDanger 3 x64         : 298
Komodo 9.2 x64            : 291
Ginko 1.2 x64             : 216
Andscacs 0.82 x64         : 191
Tornado 7 x64             : 116
Arminius 060815 x64       :  97
Giraffe 280815 x64        :  93

More Details
TTs official ranking includes only (since 30.08.2015):
1) Public and strongest versions
2) Engines, which are up to 55% similarity (+56% out)
* Exception there will be for:
- Private engine, in case of better performance than the leader (Houdini 4 tactical)
- For derivative engines: in case of +20 points better than based original engine
- For clone engines: in case of +100 points better than based original engine
* Houdini 4 Tactical (based mainly on Rybka) managed to do that...why not other engine?!
* Otherwise, TTs rankings will be based mainly on Stockfish/Rybka derivatives or clones
* Thanks for your understanding !

A few notes more,
Stockfish 170815 performed better than all previous SF development versions
*But however, even this new SF release could not do better than Stockfish 6
Synapse RZ4 WSET Tactical x64 has been tested with 'Tactical mode' enabled
Ginko 1.2 x64 performed 14 points better than previous Ginkgo 1.0e x64
Giraffe 280815 x64 performed 29 points better than Giraffe 010815 x64
Congrats to all engine authors who managed to improve their engines...

Unexpected and disappointed tactical results by some newer versions:
- Komodo 9.2 x64 (17 points less than Komodo 9.01 x64)
- Tornado 7 x64 (12 points less than Tornado 5 x64)
- Andscacs 0.82 x64 (8 points less than Andscacs 0.81 x64)
- Arminius 060815 x64 (1 point less than Arminius 2014 x64)

Some new engines which have analyze bugs:
Alfil 15.8 and Fizbo 1.5 have the same analyze bug as Protector 1.8 and Stockfish 5
I don't know exactly, but it seems some authors copy or study also the bad parts...
Also since today,
I will not use any polyglot adapter for those buggy UCI engines, due to we are in 2015

And I hope the newer versions can analyze and to be better in tactics !)

SCCT - TTs (3 seconds per position) - All Versions:
Code:
https://sites.google.com/site/computerschess/tts-3sec

SCCT - TTs Conditions/Rules:
Code:
https://sites.google.com/site/computerschess/tts-3sec-conditions


Thanks to Sedat cheers  New site link:
Code:
https://sites.google.com/site/computerschess/

gary

Posts : 229
Points : 543
Reputation : 124
Join date : 2011-02-05
Location : Somewhere Out There

View user profile

Back to top Go down

View previous topic View next topic Back to top

- Similar topics

Permissions in this forum:
You cannot reply to topics in this forum