arXiv 2610.30181 · cs.IR · 2026-10-19
Deep Search in Real-World Web Environments
Xiaomin Yu, Hongliang Chen, Zhe Huang, Shilin Yan, Shao-Rong Su, Xuqiao Ma, Feiyang Wang, Jiayu Chen 等 25 人
机构待核实
在最新榜 #83 本站收录于 2026-10-24
一句话要点
OpenDS-World 在真实开放网络上评测深度搜索 agent：200 道经人工核验、答案唯一的难题，跨多种模态、文件格式和需要交互才能访问的页面。在统一工具环境下测了 12 个前沿模型，最好的准确率 39.0%；人类 1000 次独立作答为 21.1%。分析显示各模型的搜索策略差异很大，工具协调和长程搜索仍是难点。
OpenDS-World evaluates deep-search agents on the live open Web: 200 human-verified tasks with unique answers spanning modalities, file formats and interactive access. Among 12 frontier models in one tool environment the best reaches 39.0% accuracy, versus 21.1% for humans over 1,000 attempts; tool coordination and long-horizon search remain hard.
阅读 arXiv 原文 PDF Hugging Face 讨论 代码仓库
主题与学科
同主题：智能体
- Raven: The Harness of Harnesses for Composable Agentic Intelligence ▲748
- False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents ▲642
- Omni-IO Skills: Harnessing Your Agent Omni-Native ▲485
- BizAgentBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World Business ▲388
- Player-1: Learning to Play from Synthetic Experience ▲347
同主题：评测与数据
- Spectral-Spatial Interpretation 2026-10-15 · ▲753
- StreamEval: Evaluating Interactive Streaming Video Generation Models 2026-10-20 · ▲649
- Has GPT-6-Astra Achieved Embodied Intelligence? 2026-10-15 · ▲421
- RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversations 2026-10-01 · ▲287
- FDE-Gym: The Last Mile of AI Delivery 2026-10-15 · ▲270
数据说明
元数据来自 arXiv API（已核实）；点赞来自 Hugging Face 每日论文；引用来自 Semantic Scholar。最近刷新 2026-10-26。
要点由本站根据摘要自写，不转载摘要原文，请阅读原文。