chessgod101
Please login to view all of the forum content.

Houdini 4 vs Houdini 3 vs Komodo TCEC

View previous topic View next topic Go down

Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  Zirie on Mon Dec 09, 2013 7:21 pm

This was run on a 4m+2s time setting, with each engine running on 4 cores, using Perfect2012t as common opening book and Nunn's opening test as opening starting point, playing both colors.



I am surprised H4 has scored lower than H3. Any ideas?

Zirie

Posts : 49
Points : 65
Reputation : 6
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  Bacolod Chess on Tue Dec 10, 2013 3:39 am

I'm currently running 1,000 game test with H4 and H3 now. I have had the same initial results before 36 games where h3 leads by about two to three points. but as I reach nearly 100 games, H4 took the by ten points now. in my experience, short games to test engines will give you inadequate result. had you continue it up to 100 games, maybe H4 will get the lead.

I'll post my result soon

Bacolod Chess

Posts : 244
Points : 346
Reputation : 49
Join date : 2013-10-08
Age : 10
Location : Bacolod, Philippines

View user profile

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  Zirie on Tue Dec 10, 2013 3:41 am

Bacolod Chess wrote:I'm currently running 1,000 game test with H4 and H3 now. I have had the same initial results before 36 games where h3 leads by about two to three points. but as I reach nearly 100 games, H4 took the by ten points now. in my experience, short games to test engines will give you inadequate result. had you continue it up to 100 games, maybe H4 will get the lead.

I'll post my result soon

I think you are right. I started running the 100 game thing only between H3 and H4, and H4 had an advantage of 2 games after about 15 games. This is all in Blitz.

Zirie

Posts : 49
Points : 65
Reputation : 6
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  Bacolod Chess on Tue Dec 10, 2013 3:44 am

cool. post your results when you're done.

Bacolod Chess

Posts : 244
Points : 346
Reputation : 49
Join date : 2013-10-08
Age : 10
Location : Bacolod, Philippines

View user profile

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  chessgod101 on Tue Dec 10, 2013 8:47 am

Yes, running a test with such a small number of games leaves a lot of room for statistical noise. I am sure when the 100 game and 1000 game tests are complete, they will be more conclusive. Thank you very much for running the tests. I am excited to see the results, gentlemen. Smile

chessgod101

Posts : 561
Points : 1133
Reputation : 154
Join date : 2009-12-29
Age : 25

View user profile http://www.chessgod101.com

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  XsupremeX on Tue Dec 10, 2013 2:18 pm

I wanna see a day stockfish surpass houdini 3 and 4 at all.  Twisted Evil 

XsupremeX

Posts : 387
Points : 605
Reputation : 38
Join date : 2012-03-10
Location : Vitória - Brazil

View user profile

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  Bacolod Chess on Tue Dec 10, 2013 3:46 pm

XsupremeX wrote:I wanna see a day stockfish surpass houdini 3 and 4 at all. Twisted Evil
it already did in the strongest engines tournament, the TCEC

Bacolod Chess

Posts : 244
Points : 346
Reputation : 49
Join date : 2013-10-08
Age : 10
Location : Bacolod, Philippines

View user profile

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  Zirie on Wed Dec 11, 2013 2:09 am

I must be configuring Houdini wrong, because Houdini 3 keeps outplaying Houdini 4 in my computer. I'm running a new 100 game match, 4+2, with autotune, etc. H3 is ahead by three games before game 10. Actually, these are the first three games, which it won in a row.

Does anybody have experience configuring Houdini, who can lend me a hand?

Zirie

Posts : 49
Points : 65
Reputation : 6
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  Bacolod Chess on Wed Dec 11, 2013 4:08 am

Zirie wrote:I must be configuring Houdini wrong, because Houdini 3 keeps outplaying Houdini 4 in my computer. I'm running a new 100 game match, 4+2, with autotune, etc. H3 is ahead by three games before game 10. Actually, these are the first three games, which it won in a row.

Does anybody have experience configuring Houdini, who can lend me a hand?

it really happens in initial result. i'm game 700 now of my 1,000 game test. And initially before game number ten, Houdini 3 also leads by several points ahead. but as the tournament progresses on, it seems that Houdini 4 is leading with a big lead in points.

As long as you configure the two engines equally, then the result would not be biased. give h3 and h4 the same settings. perhaps leaving them to their default engines parameter would be the best.

Bacolod Chess

Posts : 244
Points : 346
Reputation : 49
Join date : 2013-10-08
Age : 10
Location : Bacolod, Philippines

View user profile

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  Zirie on Wed Dec 11, 2013 10:05 pm

Bacolod Chess wrote:had you continue it up to 100 games, maybe H4 will get the lead.

So, I did that. I autotuned both H3 and H4, and had them play 100 games at 4+2.

The result is a validation of Mr Houdart's claim that H4 is about 50 ELO points higher than H3.


I want to test now the claim by some in this forum that Komodo TCEC is stronger than H4 in LTC>

Zirie

Posts : 49
Points : 65
Reputation : 6
Join date : 2013-12-09

View user profile

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  Bacolod Chess on Thu Dec 12, 2013 6:54 am

^ cool zerie. as I told you, Houdini 4 will take the lead after 100 games. Smile

Bacolod Chess

Posts : 244
Points : 346
Reputation : 49
Join date : 2013-10-08
Age : 10
Location : Bacolod, Philippines

View user profile

Back to top Go down

Houdini 4 pro 64 contre Stockfish 101213 64

Post  demonjojo on Fri Dec 13, 2013 3:13 pm

GUI : Fritz 13
5mn/partie
256mb ram
Perfect book 2012t

PC Intel core I5 Windows 7 64bit

Aprés 300 jeux Voici les résultat
Houdini 4 Pro x64 - Stockfish 101213 64 SSE4.2; 300 Parties, +66 =153 -81, 47.5%, TP=-17 Elo, 68%->[-37,-6], 95%->[-56,+6], 99.7%->[-76,+17], predicted moves=58.1%

Stockfish déja plus fort que H4 pro 64A (Cracker) bounce bounce

demonjojo

Posts : 15
Points : 16
Reputation : 1
Join date : 2012-09-11
Age : 54
Location : Bourgogne

View user profile

Back to top Go down

Re: Houdini 4 vs Houdini 3 vs Komodo TCEC

Post  Sponsored content Today at 3:16 pm


Sponsored content


Back to top Go down

View previous topic View next topic Back to top

- Similar topics

Permissions in this forum:
You cannot reply to topics in this forum