Skip to content
arXiv 人工智能· Haixin Wang, Jianheng Hou, Hongyu Shen, Wenzhe Fan, Wei-Chieh Huang, Qianyu Zhu, Weichen Li, Taoran Li, Yuhang Yao, Ruohan Wang, Zhejian Peng, Wanting Jiang, Yifan Chen, Shushu Liang, Haoming Li, Defu Cao, Xu Hu, Siyang Wu, Chen Yang, Haodi Hu, Haichao Zhang, Cong Wang, Zhiyuan Yu, Weizhi Zhang, Yifan Wang, Jintao Huang, Yizhou Sun, Yijun Wang, Yuexing Hao, Xiaomin Li·· 11 hours agoAI score40

PersonaCodeBench:在画像驱动人机交互会话中评估代码智能体

PersonaCodeBench: Evaluating Coding Agents in Persona-driven Human-Interactive Sessions

Not yet translated; shown in Chinese.

AI guide

研究人员提出 PersonaCodeBench 评测基准,用于在用户画像驱动的多轮人机交互会话中评估代码智能体。该基准通过控制器动态管理模拟用户的响应与渐进式需求披露,并由完成验证器和个性化验证器分别检验代码原生正确性与画像要求达成度。团队评测了主流前沿智能体并建立了综合排行榜。

Source:arXiv 人工智能 · arxiv.org