Papers

Filtered to multilingual benchmarks · clear filter

Browse by term

continual learning 86reinforcement learning 48benchmarking 13large language models 12benchmarks 11vision-language models 10language models 9robotics 7world models 7natural language processing 6recursive self-improvement 6generative models 5on-policy distillation 5video generation 5attention mechanisms 4coding agents 4LLMs 4multi-agent systems 4multimodal learning 4multimodal models 4self-distillation 4self-supervised learning 4transformers 4vision-language-action models 4world modeling 4agent-based systems 3agentic models 3agentic search 3agents 3autonomous systems 3

Matching papers

SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring

115 upvotes · 10 AUG 2026 · Yuling Shi, Jinghan Xu, Kelin Fu et al.

This paper introduces SWE-Bench ProMax, a new benchmark for testing AI coding agents on large-scale multilingual code refactoring tasks, which is designed to be more realistic and challenging than existing benchmarks. Practitioners can care about this paper because it provides a rigorous evaluation of current AI coding agents' capabilities on a more representative set of tasks.

AI coding agentscode refactoringmultilingual benchmarkssoftware engineeringprogramming languages