arXiv 2610.04184 · cs.AI · 2026-10-03
EvalResearchBench: Can AI Agents Build Their Own Feedback for Recursive Self-Improvement?
Yaolun Zhang, Tianyi Xu, Yujie Zhao, Jishen Zhao, Qingyun Wu, Huazheng Wang
AG2AI
在最新榜 #359 本站收录于 2026-10-26
一句话要点
EvalResearchBench 测试 AI 智能体能否在固定时间和 API 预算下自己设计评测：挑选或合成任务、写评分器并试运行后冻结；对比 14 个目标基准，最好的评测器能正确排出约 75% 的候选模型对。
EvalResearchBench tests whether agents can design their own evaluators under fixed time and API budgets by selecting or synthesizing tasks and writing graders; compared against 14 target benchmarks, the best evaluators order about 75% of candidate pairs correctly.
阅读 arXiv 原文 PDF Hugging Face 讨论 代码仓库 项目页
主题与学科
同主题：评测与数据
- RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversations ▲287
- PremiseCheck: Efficient Fact-Checking of Human and AI Peer Reviews ▲210
- DecisionPivot: A Diagnostic Benchmark for Decision Models in LLM Systems ▲74
- GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay ▲73
- More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models ▲65
同主题：智能体
- Raven: The Harness of Harnesses for Composable Agentic Intelligence 2026-09-27 · ▲748
- False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents 2026-09-30 · ▲642
- Omni-IO Skills: Harnessing Your Agent Omni-Native 2026-09-25 · ▲485
- BizAgentBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World Business 2026-10-14 · ▲388
- Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation 2026-10-14 · ▲364
数据说明
元数据来自 arXiv API（已核实）；点赞来自 Hugging Face 每日论文；引用来自 Semantic Scholar。最近刷新 2026-10-26。
要点由本站根据摘要自写，不转载摘要原文，请阅读原文。