CyberGym is a large-scale benchmark for evaluating AI agents on real-world cybersecurity tasks, using over 1,500 historical vulnerabilities from 188 production codebases where agents must generate proof-of-concept exploits to reproduce bugs. It emphasizes realistic, execution-based evaluation and demonstrates both the difficulty of vulnerability analysis and agents’ emerging ability to discover new security flaws.