Papers

Filtered to web application generation · clear filter

Browse by term

continual learning 33reinforcement learning 21large language models 9vision-language models 8language models 6benchmarking 5autoregressive models 4diffusion transformers 4generative models 4multimodal learning 4robotics 4video generation 4benchmarks 3computer vision 3policy optimization 3self-distillation 3vision-language-action models 3world modeling 3agent-based systems 2autonomous agents 2calibration 2coding agents 2diffusion models 2foundation models 2image synthesis 2in-context learning 2knowledge graphs 2LLMs 2multimodal evaluation 2multimodal large language models 2

Matching papers

UI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generation

2 upvotes · 7 JUL 2026 · Grace Man Chen, Litao Guo, Yifan Wu et al.

This paper introduces UI2App, a benchmark to evaluate the ability of large language models to infer interaction behavior from screenshots of web applications, which is crucial for real-world development workflows. Practitioners might care about this research because it highlights the limitations of current visual-driven approaches and the need for better interaction inference capabilities in web application generation.

web application generationvisual interaction inferencecontinual learningbenchmarksvision-language models