Long-Horizon-Terminal-Bench 2.0: Automating Diverse Task Construction and Measuring Sustained Agent Progress
Zongxia Li‡, Zhongzhi Li‡, Yucheng Shi‡, Ruhan Wang, Junyao Yang, Chengsong Huang, Zhichao Liu, Xiyang Wu, Anhao Li, Yue Yu, Ergan Shang, Fuxiao Liu, Tong Zheng, Ninghao Liu, Lichao Sun, Haitao Mi, Leowei Liang
‡ Core contribution (marked † in the source paper)
LHTB 2.0 expands process-aware terminal evaluation to 77 tasks across 13 domains, including systematically reconstructed scientific and engineering workflows. Three-hour runs and verifier checkpoints measure sustained progress rather than only binary final outcomes.