Sunday, October 16, 2011

Tournament preparations

I ran tournaments between different versions of the same engine to determine which one would be their representative. Below I show the results of a fast round-robin tournaments using Chess for Android on a Nexus One, Nexus S, and Galaxy Tab with, where applicable, 8MB hash table and 1MB tablebases cache (Nalimov, Gaviota, Scorpio, and Robbobases reside on SD card). Each version played each other version from both sides of the Nunn opening suite.

The number one engine will play in the longer time control tournament (which is not always the latest version; engine authors let me know if you prefer otherwise since some results were pretty close). Also, Pablo Vazquez and Jim Ablett kindly worked together to fix the issue in the sungorus. It now runs correctly and will participate in the tournament.


1   BikJump v2.1P       10.5/20
2   BikJump v1.8         9.5/20


1   Diablo 0.5.1b JA    17.5/20
2   Diablo 0.5.1         2.5/20
                 
1   DoubleCheck 1.3     13.5/20
2   DoubleCheck 1.2      6.5/20


1   gaviota v0.84       47.5/80
2   gaviota v0.83.0.3   45.0/80
3   gaviota v0.83       41.0/80
4   gaviota v0.80.0.107 37.5/80
5   gaviota v0.82-beta2 29.0/80


1   GNU Chess 5.07.153.3b 20.5/40
2   GNU Chess 5.07.170.7b 20.0/40
3   GNU Chess 5.07.173b   19.5/40
                                 
1   IvanHoe-Beta v999947c-rob 10.0/20
2   IvanHoe-Beta v999947c     10.0/20
                           
1   Jazz v5.01 JA       14.0/20
2   Jazz v444 JA         6.0/20


1   Komodo32 2AB       60.0/100
2   Komodo32 2.03 AB   59.0/100
3   Komodo32 2.01 AB   58.5/100
4   Komodo32 2.03 JA   58.0/100
5   Komodo32 3 AB      34.5/100
6   Komodo32 1.3 JA    30.0/100
                 
1   RedQueen 0.9.8 JA  24.5/40
2   RedQueen 0.9.8     19.0/40
3   RedQueen 0.9.5     16.5/40
                         
1   RobboLito 0.085g3l 10.5/20
2   RobboLito 0.085e4l  9.5/20
             
1   Rotor 0.6a         16.0/20
2   Rotor 0.4           4.0/20


1   Stockfish 2.1.1 JA 77.0/120
2   Stockfish 2.1      68.5/120
3   Stockfish 2.1 JA   65.5/120
4   Stockfish 1.8      62.0/120
5   Stockfish 2.0      60.0/120
6   Stockfish 1.9      59.0/120
7   Crab 1.0 beta      28.0/120