arXiv 2610.07557 · cs.SE · 2026-10-06
CheckerBench: Can Long-Horizon Agents Synthesize Static-Analysis Checkers?
Hang He, Li Wang, Hao Chen, Yuchen Shao, Yuling Shi, Lisheng Wang, Peiyang Liu, Goose Lin and 4 more
Humanlaya Data Lab
In latest · #215 Added on 2026-10-21
One-line takeaway
CheckerBench tests whether long-horizon agents can build working static-analysis checkers, with 300 tasks from 297 CVEs.
CheckerBench 用源自 297 个 CVE 的 300 个任务，测智能体能否在真实仓库写出静态分析检查器。
Read on arXiv PDF Hugging Face discussion Code
Topics & disciplines
More on Code & SWE
- CodeMidas: Scaling Agentic Coding RL Environments from Code Itself ▲138
- AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards ▲137
- LEGO-Anything: Coding Agents for 3D Scene Reconstruction ▲129
- 3DCodeVerse: Exploring 3D Worlds as Code ▲117
- Groupwise Agentic Grading and Advantage Redistribution for Code Agent RL ▲95
About this data
Metadata from the arXiv API (verified); upvotes from Hugging Face Daily Papers; citations from Semantic Scholar. Last refreshed 2026-10-22.
The takeaway is written by AIMap from the abstract; the abstract itself is not reproduced — read the original. Takeaway revised on 2026-10-21.