On the Road to Perfection? Evaluating Leela Chess Zero Against Endgame Tablebases

• Author / Creator

  Haque, Rejwana

• Board game research has pursued two distinct but linked objectives: solving games, and strong play using heuristics. In our case study in the game of chess, we analyze how current AlphaZero type architectures learn and play late chess endgames, which are solved. We study the open-source program Leela Chess Zero in three, four and five piece chess endgames. We quantify the program's move decision errors for both an intermediate and a strong version, and for both the raw policy network and the full MCTS-based player. We relate strong network performance to depth and sample size. We discuss a number of interesting types of errors by using examples, explain how they come about, and present evidence-based conjectures on the types of positions that still cause problems for these impressive engines. We show that our experimental results are scalable by demonstrating the experiments on samples from the five piece tablebase of KQRkq, the difficult endgame of king, queen and rook against king and queen.

• Subjects / Keywords

  • AlphaZero learning
  • Computer chess
  • Leela Chess Zero

• Graduation date

  Spring 2022

• Type of Item

  Thesis

• Degree

  Master of Science

• DOI

  https://doi.org/10.7939/r3-5s4k-q622

• License

  This thesis is made available by the University of Alberta Libraries with permission of the copyright owner solely for non-commercial purposes. This thesis, or any portion thereof, may not otherwise be copied or reproduced without the written consent of the copyright owner, except to the extent permitted by Canadian copyright law.