chessgod101
Please login to view all of the forum content.

Stockfish Testing

View previous topic View next topic Go down

Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 3:29 am

Intel(R) Core(TM) i7 990 x6 3.47 GHz @ 4.53 GHz 12.00 MB
Windows 7 Professional (Build 7600)
Fritz Benchmarks:
Speed: 39.34
KNS: 18885
GUI: CB- Fritz 13
Book: Baracuda 2013-7 move
Hash:2048
CONTEMPT:0
GTB-TB-RB: ON
Ponder: OFF
Time: Blitz 5m 0
Code:
1  Stockfish 241113SL 64 SSE4.2  +14/=72/-14 50.00%  50.0/100  2500.00
2  Houdini 4 Pro x64            +14/=72/-14 50.00%  50.0/100  2500.00

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 3:31 am

i7-3930K SSD 3.20Ghz @ 4.70 GHz 16.0 GB RAM
Windows 7 Professional SP 1
Fritz Benchmark:
Speed: 42.96
KNS: 20619
GUI: CB-Fritz 13
Book: Baracuda 2013-7 moves
Hash:2048
CONTEMPT:0
GBT-RB-TB: ON
Ponder: OFF
Time: Blitz 5m 0
Code:
1  Stockfish 241113SL 64 SSE4.2    +3  +20/=61/-19 50.50%  50.5/100
2  Houdini 4 Pro x64              -3  +19/=61/-20 49.50%  49.5/100

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 3:33 am

i7 Q-870-XPS SSD @2.93 GHz 8.00 GB RAM
Windows7.x64 Professional
Fritz Benchmarks:
Speed: 19.22
KNS: 9225
GUI: Fritz 13
HASH: 1024
CONTEMPT:0
SLOW MOVER:55
BOOK: Immortal 2012a-7 moves
GTB-RB-GTB: ON
PONDER: OFF
Time: Blitz 5m 0
Code:
1  Houdini 4 Pro x64              +4  +15/=61/-14 50.56%  45.5/90
2  Stockfish 281113SL 64 SSE4.2    -4  +14/=61/-15 49.44%  44.5/90

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 3:33 am

i5 Q-750 SSD @2.67 GHz 12.00 GB Memory
Windows 7.x64 Professional (Build 7600)
Fritz Benchmarks:
Speed:16.84
KNS: 8082
GUI: CB - Fritz 13
Hash: 2048
Book: Baracuda 2013-7 moves
GTB,RB,TB: ON
Ponder: OFF
Time: Blitz 5m 0

Code:
1  Stockfish 281113SL 64 SSE4.2    +9  +42/=70/-38 51.33%  77.0/150
2  Houdini 4 Pro x64              -9  +38/=70/-42 48.67%  73.0/150

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 3:34 am

AMD II X6 1090T x6 SSD @3.80 GHz 8.00 GB Memory
Windows 7 Professional.x64 Service Pack 1
Fritz Benchmark:
Speed: 27.61
KNS: 13252
GUI: CB- Fritz 13
Book: Baracuda 2013-7 moves
Hash: 2048
GTB-TB-RB: ON
Ponder: OFF
Time: Blitz 5m 0

Code:
1  Stockfish 281113SL 64  +16  +36/=85/-29 52.33%  78.5/150
2  Houdini 4 Pro x64A      -16  +29/=85/-36 47.67%  71.5/150

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 3:35 am

AMD II X6 1090T. x6 SSD @ 3.20 GHz - 8.00MB Memory
Windows 7 Home Edition (Build 7600)
Fritz Benchmark:
Speed: 23.33
KNS: 11196
GUI: CB- Fritz 13
Book: Baracuda 2013 -7 moves
Hash: 2048
GTB-TB-RB : ON
Ponder: OFF
Time: Blitz 5m 0
Code:
1  Stockfish 281113SL 64    +7  +38/=77/-35 51.00%  76.5/150
2  Houdini 4 Pro x64A      -7  +35/=77/-38 49.00%  73.5/150


Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 3:36 am

i7-3930K SSD 3.20Ghz @ 4.70 GHz 16.0 GB RAM
Windows 7 Professional SP 1
Fritz Benchmark:
Speed: 42.96
KNS: 20619
GUI: CB-Fritz 13
Book: Baracuda 2013-7 moves
Hash:2048
CONTEMPT:0
GBT-RB-TB: ON
Ponder: OFF
Time: Blitz 5m 0

Code:
1  Houdini 4 Pro x64              +26  +15/=56/-9 53.75%  43.0/80
2  Stockfish 281113SL 64 SSE4.2  -26  +9/=56/-15 46.25%  37.0/80

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 3:38 am

2 x E5-2687W 8 core @ 3.1 GHz (3.8 GHz Turbo Boost)
SSD -32 GB RAM Memory
Win Pro 7 SP1 X64
Houdini 3 benchmark:
30306 KNS
GUI: CB-Fritz 13
Book: Baracuda 2013-7 move
Hash:2048
GBT-RB-TB: ON
16 cores per engine
Ponder: OFF
Time: Blitz 5m 0

1 Stockfish 091213SL 64 SSE4.2 +9 +27/=100/-23 51.33% 77.0/150
2 Houdini 4 Pro x64 -9 +23/=100/-27 48.67% 73.0/150
Code:
1  Stockfish 091213SL 64 SSE4.2    +9  +27/=100/-23 51.33%  77.0/150
2  Houdini 4 Pro x64              -9  +23/=100/-27 48.67%  73.0/150

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 3:38 am

SYSTEM----i3 M380|2 Cores@2.53|Win7(64bit)|6GB RAM
FMARK-----Speed 4.82/Kns 2313
TB'S-------None
PONDER----Off
GUI--------Little Blitzer 2.74

Looks like Ipman's still has a slight edge at this ultrafast time. I will give them a bit more time and retry. The 6-7 elo gain from this version should be stronger than the 2-3 gain from LP's...I do not use TB's

Code:
Games Completed = 200 of 200 (Avg game length = 29.424 sec)
Settings = Gauntlet/64MB/10000ms+100ms/M 6500cp for 4 moves, D 150 moves/EPD:C:\Users\Paul\Documents\ChessBase\Testsets\EPD Test Suites\5000 8 move.epd(4962)
Time = 3073 sec elapsed, 0 sec remaining
 1.  Stockfish 191213           98.5/200   40-43-117     (L: m=0 t=0 i=0 a=43)   (D: r=88 i=17 f=8 s=0 a=4)   (tpm=236.2 d=15.94 nps=969680)
 2.  Stockfish 151213IP         101.5/200   43-40-117     (L: m=0 t=1 i=0 a=39)   (D: r=88 i=17 f=8 s=0 a=4)   (tpm=229.9 d=16.18 nps=993142)

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 3:58 am

E6400
Fritz bench : R.speed: 6.21 , KNS:2980
2CPU , PON : Off , TB : Off
512MB hash
Shredder GUI
Baracuda2013b bkt
4min per engine


Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 4:00 am

SYSTEM---i3 M380|2 Cores@2.53|Win7(64bit)|6GB RAM
FMARK-----Speed 4.82/Kns 2313
TB'S-------None
PONDER----Off
GUI--------Deep Fritz 14(64 Bit)
HASH------256 MB
BOOK------SalvoSuite50(8 move reversing)
CONTEMPT-Houdini=0
TIME------4 min + 2 sec

Now they are even closer. in summary no matter what flavor of Blitz (games under 1 hour) we play these guys are close. They are even close at LTC.
I don't remember a time when the top 3 engines were this close, and I have been at this for a long, long time.
All the tests that are being run here with less than 10,000 games are all within error bars or are statistical noise. The ELO's are so close it takes many thousands of games to have any level of confidence, this is why one tester finds one thing another has a different outcome, but all are within the error bars.

http://i57.fastpic.ru/big/2013/1217/b2/4e6adbb5bee90a32325e00b8ac77e4b2.png

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 4:00 am

Author: Ronald de Man
Date: Wed Dec 18 00:21:31 2013 +0100
Timestamp: 1387322491

New option SyzygyProbeDepth.
The tables are only probed at nodes with remaining depth >= SyzygyProbeDepth.
The default value is 1, which corresponds to the old behaviour.
Set it to a higher value if probing affects nps too much.


http://www.abrok.eu/stockfish_syzygy/

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 4:02 am

E6400
Fritz bench : R.speed: 6.21 , KNS:2980
2CPU
512MB hash
Shredder GUI
Baracuda2013b bkt
5min per engine

games

http://limelinx.com/ebuny

My rating list 4minutes per engine - 2hours per engine ( best versions + Houdini 3 )

all games from this test added to rating list

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 4:03 am

E6400
Fritz bench : R.speed: 6.21 , KNS:2980
2CPU , PON : Off , TB : Off
512MB hash
Shredder GUI
Baracuda2013b bkt
4min per engine

games

http://limelinx.com/euiqe

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 4:03 am

tc 2sec/move, no books, only rdm bases
Code:
Engine                                Score  St St St Cr Ho Fi Fi    S-B
1: Stockfish 151213IP v2 x64 sse42 2CPU  8.5/12 ·· == 1= 11 1= =0 11  46,25
2: Stockfish 13121007 x64 sse42 2CPU    8.5/12 == ·· == 10 11 1= 11  44,00
3: Stockfish 13121801 rdm x64 sse42 2CPU 7.5/12 0= == ·· == 1= 1= 11  38,25
4: Critter 1.6a x64 2CPU                5.0/12 00 01 == ·· =0 1= 01  28,00
5: Houdini 3.0 std x64 2CPU              5.0/12 0= 00 0= =1 ·· =1 ==  25,00
6: Fire 3.0 x64 sse42 2CPU              4.0/12 =1 0= 0= 0= =0 ·· =0  27,50
7: Firenzina 2.4 x64 popcnt 2CPU        3.5/12 00 00 00 10 == =1 ··  16,00

Stockfish 13121801 rdm x64 sse42 games:

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Mohamed Nayeem on Fri Dec 20, 2013 4:05 am

SYSTEM---i3 M380|2 Cores@2.53|Win7(64bit)|6GB RAM
FMARK-----Speed 4.82/Kns 2313
TB'S-------None
PONDER----Off
GUI--------Deep Fritz 14(64 Bit)
HASH------256 MB
BOOK------SalvoSuite50(8 move reversing)
CONTEMPT-Houdini=0
TIME------1 min + 1 sec

So very close, hard to tell with error bars...


Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

TESTING STOCKFISH 151213 IPMAN LARGE PAGES= 480 GAMES.

Post  Mohamed Nayeem on Fri Dec 20, 2013 4:05 am

TESTING STOCKFISH 151213 IPMAN LARGE PAGES= 480 GAMES.

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages= Allowed
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control= 4+0.

Stockfish 151213IP 64 SSE4.2L - Houdini 4 x64_st_X6_CT0 21.5 - 18.5 +9/=25/-6 53.75%
Stockfish 151213IP 64 SSE4.2L - Komodo 6 64-bitNOBx6 21.5 - 18.5 +10/=23/-7 53.75%
Stockfish 151213IP 64 SSE4.2L - Critter 1.6a 64-bitX6_NOB 26.0 - 14.0 +16/=20/-4 65.00%

Time Control= 2+2

Stockfish 151213IP 64 SSE4.2L - Houdini 4 x64_st_X6_CT0 20.5 - 19.5 +9/=23/-8 51.25%
Stockfish 151213IP 64 SSE4.2L - Komodo 6 64-bitNOBx6 28.0 - 12.0 +19/=18/-3 70.00%
Stockfish 151213IP 64 SSE4.2L - Critter 1.6a 64-bitX6_NOB 25.5 - 14.5 +13/=25/-2 63.75%

Score using 6 cores= 143.0 – 97.0 = 59.58%
240 Games= http://www.mediafire.com/view/yykurj...P_240games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages= Allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control= 4+0

Stockfish 151213IP 64 SSE4.2L - Houdini 4 x64xCT0 23.0 - 17.0 +13/=20/-7 57.50%
Stockfish 151213IP 64 SSE4.2L - Komodo 6 64-bitx4 25.5 - 14.5 +16/=19/-5 63.75%
Stockfish 151213IP 64 SSE4.2L - Critter 1.6a 64-bitnob 22.5 - 17.5 +11/=23/-6 56.25%

201312SF151213_LP_IP_55_2+2 2013

Stockfish 151213IP 64 SSE4.2L - Houdini 4 x64xCT0 22.5 - 17.5 +12/=21/-7 56.25%
Stockfish 151213IP 64 SSE4.2L - Komodo 6 64-bitx4 25.5 - 14.5 +15/=21/-4 63.75%
Stockfish 151213IP 64 SSE4.2L - Critter 1.6a 64-bitnob 24.0 - 16.0 +10/=28/-2 60.00%
Score using 4 Cores= 143.0 – 97.0 = 59.58%
240 Games= http://www.mediafire.com/view/tch539...4_240games.pgn

Segmenting by Time Control:

Fixed TC = 140.0 – 100.0 = 58.33%
Incremental TC = 146.0 – 94.0 = 60.83%

Global Score= 286.0 – 194.0 = 59.58%

Against : Houdini 4.0 St. Ct0 (3233) = 54.69% ; Komodo 6 (3162) = 60.31% ; Critter 1.6a (3093) = 61.25%

Average Estimated Elo Opponents = 3163
Estimated Elo Performance= 3230

This is clearly the best Stockfish I have tested so far. Very similar strength to Houdini 4.0 Standard A Contempt 0, the best Houdini 4.0 in my computer. Well done, Ipman!!.

Regards,

Tom.

Mohamed Nayeem

Posts : 73
Points : 110
Reputation : -1
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Stockfish Testing

Post  Sponsored content Today at 1:07 pm


Sponsored content


Back to top Go down

View previous topic View next topic Back to top

- Similar topics

Permissions in this forum:
You cannot reply to topics in this forum