arXiv 2610.24087 · · 2026-10-16
OR-License: Evaluating LLM Agents as Real-World Operations Research Practitioners
Peisong Wang, Feixue Liu, Yize Meng, Bowen Liu, Ruoyu Chen, Gaoyang Dai, Xing He, Aiqian Li and 11 more
Data Science & Artificial Intelligence Lab at HKUST
In latest · #64 2026-W43 #6 (in progress) Added on 2026-10-21
One-line takeaway
OR-License benchmarks whether LLM agents can turn original client materials from 31 paid operations-research engagements into expert-grade solutions.
OR-License 用 31 个真实付费运筹咨询项目的原始材料,测试大模型智能体能否直接交付专家级运筹方案。
Read on arXiv PDF Hugging Face discussion Code Project page
Topics & disciplines
More on Benchmarks & data
- PremiseCheck: Efficient Fact-Checking of Human and AI Peer Reviews ▲727
- RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversations ▲287
- GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay ▲73
- More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models ▲65
- Science or Slop?: Benchmarking and Mitigating Scientific Slop in AI-Generated Papers ▲63
About this data
Metadata from the arXiv API (verified); upvotes from Hugging Face Daily Papers; citations from Semantic Scholar. Last refreshed 2026-10-22.
The takeaway is written by AIMap from the abstract; the abstract itself is not reproduced — read the original.