arXiv 2610.24087 · · 2026-10-16
OR-License: Evaluating LLM Agents as Real-World Operations Research Practitioners
Peisong Wang, Feixue Liu, Yize Meng, Bowen Liu, Ruoyu Chen, Gaoyang Dai, Xing He, Aiqian Li 等 19 人
Data Science & Artificial Intelligence Lab at HKUST
在最新榜 #64 2026-W43 第 6 名(进行中) 本站收录于 2026-10-21
一句话要点
OR-License 用 31 个真实付费运筹咨询项目的原始材料,测试大模型智能体能否直接交付专家级运筹方案。
OR-License benchmarks whether LLM agents can turn original client materials from 31 paid operations-research engagements into expert-grade solutions.
阅读 arXiv 原文 PDF Hugging Face 讨论 代码仓库 项目页
主题与学科
同主题:评测与数据
- PremiseCheck: Efficient Fact-Checking of Human and AI Peer Reviews ▲727
- RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversations ▲287
- GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay ▲73
- More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models ▲65
- Science or Slop?: Benchmarking and Mitigating Scientific Slop in AI-Generated Papers ▲63
数据说明
元数据来自 arXiv API(已核实);点赞来自 Hugging Face 每日论文;引用来自 Semantic Scholar。最近刷新 2026-10-22。
要点由本站根据摘要自写,不转载摘要原文,请阅读原文。