RobotAgentBench: Towards Open-world Robot Autonomy
Lingjun Mao*, Jinglin Cao*, Lukun He*, Wenpeng Xu, Yuchen Yan, Hengyu Jin, Zijun Zhang, Jinzhou Tang, Songyao Jin, Ziche Liu, Yifei Shao, Junbo Huang, Fang Nan, Ruobing Han, Ziqiao Xi, Ziming Xu, Shuang Liang, Sibo Zhu, Wenyi Wu, Xinyue Wang, Yiming Huang, Xinkai Zou, Gao Zhu, Kun Zhou, Biwei Huang
(*=Equal Contribution)
preprint
Paper/
Project/
Code
TL;DR: We introduce RobotAgentBench, a benchmark spanning 50 household layouts that evaluates robot agents on task discovery, contextual reasoning, manipulation, failure recovery, and robustness, from individual tasks to open-ended scenarios.