arXiv 2610.28474 · cs.CV · 2026-10-20
Answering in the User's Variety: Calibrated Accommodation Pairs for Post-Training
Zhizhuo Kou, Heming Li, Jian Yang, Junyu Luo, Jingshu Peng, Sirui Han, Yike Guo
Affiliation unverified
One-line takeaway
CAP enables dialect-aware responses while preserving Standard English, revealing hidden biases in uniform model outputs.
论文提出校准适应配对(CAP)方法,通过偏好数据让模型在保持标准英语的同时更准确匹配用户方言,发现传统训练方式会无意识偏向特定拼写,且统一回复掩盖了训练中的选择性偏见。
Key points
Chat models often ignore user dialects, producing uniform Standard English responses. This paper shows that post-training stages introduce hidden biases favoring certain spellings like British or Australian over AAE or Singlish. The authors propose Calibrated Accommodation Pairs (CAP), a preference data method that rewards dialect matching without compromising standard English for standard users. Experiments across 10 model lines show CAP improves adaptation to non-standard features while preserving instruction-following and avoiding unintended dialect imposition.
- Models favor British/Australian spelling over AAE/Singlish despite user dialect diversity.
- CAP pairs reward dialect density matching while preserving Standard English for standard users.
- CAP improves adaptation to non-standard features without increasing dialect use or harming instruction following.
- Uniform outputs mask selective training biases; audits must examine both output and update process.
Written only from the official arXiv abstract by an open-source model, then checked automatically (every number and name must appear in the abstract). The paper is authoritative.
Read on arXiv PDF Hugging Face discussion Code
Topics & disciplines
More on Alignment
- Memadapter: Counterfactual Adaptation Against Memory-induced Sycophancy ▲62
- onPanda: Efficient Annotation of On-Policy Alignment Data for LLMs and Agents via Token-Level Correction ▲55
- Source Preference in the Wild: How LLM Agents Favor Items by Source, and How to Reduce It ▲47
- Diffusion Reward Models ▲35
More on Reinforcement learning
- False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents 2026-09-30 · ▲642
- The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation 2026-09-29 · ▲511
- Player-1: Learning to Play from Synthetic Experience 2026-10-14 · ▲347
- Scaling Properties of Same-Family On-Policy Distillation 2026-09-26 · ▲327
- DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Models 2026-10-08 · ▲325
About this data
Metadata from the arXiv API (verified); upvotes from Hugging Face Daily Papers; citations from Semantic Scholar. Last refreshed 2026-10-20.
The takeaway is written by AIMap from the abstract; the abstract itself is not reproduced — read the original.