Language Models that Play Chess and Explain Their Moves

One-line takeaway

Queen is a 4B chess-language model that explains its moves and plans while playing at typical Grandmaster level, connecting a chess encoder to an instruction-tuned LM via cross-attention and training with a QA curriculum and iterative distillation.

Queen 是一个 40 亿参数的国际象棋语言模型，能边下棋边解释着法和计划，棋力达到一般特级大师水平；它通过交叉注意力把象棋编码器接到指令微调语言模型上，并用问答课程和迭代蒸馏训练。