arXiv 2610.30932 · cs.IR · 2026-10-22
UserArena: Benchmarking Interactive User Simulation for Long-Horizon Shopping Agents
Jujia Zhao, Jiakai Tang, Jing Yu, Wen Chen, Jian Wu, Han Zhu, Fei Sun, Suzan Verberne and 1 more
alibaba
One-line takeaway
UserArena introduces a real-world interactive shopping benchmark with 64k trajectories and proposes OPTD to enhance simulator fidelity in long-horizon interactions.
UserArena 构建了包含6.4万条真实购物会话的基准数据集，结合交互环境支持多层级评估，并提出OPTD方法提升模拟器在长周期交互中的拟真度。
Quick look: the first sentence of the official arXiv abstract (Chinese is machine-translated). Key points are being written; read the original for details.
Read on arXiv PDF Hugging Face discussion Code Project page
Topics & disciplines
More on Benchmarks & data
- RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversations ▲287
- PremiseCheck: Efficient Fact-Checking of Human and AI Peer Reviews ▲210
- DecisionPivot: A Diagnostic Benchmark for Decision Models in LLM Systems ▲74
- GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay ▲73
- More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models ▲65
More on Agents
- Raven: The Harness of Harnesses for Composable Agentic Intelligence 2026-09-27 · ▲748
- False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents 2026-09-30 · ▲642
- Omni-IO Skills: Harnessing Your Agent Omni-Native 2026-09-25 · ▲485
- BizAgentBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World Business 2026-10-14 · ▲388
- Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation 2026-10-14 · ▲364
More from alibaba
- SWIFT: Self-guided Weak-to-strong dIFfusion models via Target extrapolation 2026-10-19
- Urbex: Agentic Spatial Grounding for City-Scale 3D Scenes 2026-10-13
- Scaling Agentic Data for Long-Horizon Terminal Intelligence 2026-10-09
- Learning Representations to Guide Pixel Diffusion Transformers 2026-10-09
- Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States 2026-10-01
About this data
Metadata from the arXiv API (verified); upvotes from Hugging Face Daily Papers; citations from Semantic Scholar. Last refreshed 2026-10-22.
The takeaway is written by AIMap from the abstract; the abstract itself is not reproduced — read the original.