arXiv 2609.26550 · cs.AI · 2026-09-22
JEV-as-a-Judge: Accept When Confident, Escalate When Unsure
Yubo Li, Yidi Miao, Ramayya Krishnan, Rema Padman
Carnegie Mellon University
In latest · #105 Added on 2026-10-21
One-line takeaway
Uses a decision-only judge as a cheap first pass and escalates to stronger judges only when unsure.
用只做决策的轻量评审模型做第一轮打分，没把握时再升级给大模型，成本仅为后者的零头。
Read on arXiv PDF Hugging Face discussion Project page
Topics & disciplines
More on Benchmarks & data
- PremiseCheck: Efficient Fact-Checking of Human and AI Peer Reviews ▲727
- OR-License: Evaluating LLM Agents as Real-World Operations Research Practitioners ▲291
- RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversations ▲287
- GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay ▲73
- More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models ▲65
About this data
Metadata from the arXiv API (verified); upvotes from Hugging Face Daily Papers; citations from Semantic Scholar. Last refreshed 2026-10-22.
The takeaway is written by AIMap from the abstract; the abstract itself is not reproduced — read the original.