HuggingFace Daily Papers（社区热门论文）· HuggingFace Daily Papers（社区热门论文）·· 10 天前AI 评分41
CaptchaArena：面向交互式 CAPTCHA 的大规模细粒度计算机使用智能体训练数据集
AI 导读
CaptchaArena 是首个面向交互式 CAPTCHA 求解的大规模细粒度训练数据集，包含 20 种 CAPTCHA 类型、5 种交互模式共 50K 道题，每道题的解均经执行验证。
正文
Abstract:Interactive CAPTCHAs remain challenging for computer-use agents, while existing datasets face trade-offs among type coverage, interaction fidelity, and trajectory supervision. To address these gaps, we present CaptchaArena, the first large-scale, fine-grained training dataset for interactive CAPTCHA solving. It contains 50K puzzles across 20 CAPTCHA types and 5 interaction modes, with every solution verified through execution. CaptchaArena provides 50K screenshot-action trajectories, including 46K with step-by-step reasoning annotations. It also includes fine-grained pixel-mask annotations for irregular targets. Using CaptchaArena, we train CaptchaAgent, a single 9B policy for all 20 CAPTCHA types, with supervised fine-tuning followed by reinforcement learning. The environment verifier directly provides the RL reward. Supervised fine-tuning reaches 70.5 Pass@1, and reinforcement learning further improves it to 71.7, while also improving performance on two external benchmarks. These results demonstrate the value of large-scale, fine-grained computer-use supervision for training interactive CAPTCHA agents. We release CaptchaArena and CaptchaAgent at this https URL.
| Comments: | 30 pages, 4 figures, 16 tables. Code and data: this https URL |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2609.31957 [cs.CV] |
| (or arXiv:2609.31957v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2609.31957 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Zhenhao Zhang [view email]
[v1]
Fri, 25 Sep 2026 20:04:24 UTC (14,258 KB)
来源：HuggingFace Daily Papers（社区热门论文） · arxiv.org