Web Agent

I present WebJudge Green Agent, a vision-based evaluator for generalist web navigation agents based on the Online-Mind2Web benchmark. Unlike traditional DOM-based evaluators that break with UI updates, our system utilizes a neuro-symbolic 3-step pipeline (Key Point Extraction, Visual Filtering, Verdict Generation) powered by GPT-4o Vision to evaluate agent trajectories on live websites. The project features: A fully Dockerized environment compliant with the AgentBeats A2A protocol. A dynamic task generation system with a diverse dataset (Shopping, Travel, Finance). An intelligent judging engine capable of analyzing screenshots to verify task completion strictly and fairly.

green agent evaluates WebShop shopping tasks in a text‑only Gym environment. It orchestrates episodes by resetting the environment, sending observations to the purple agent, executing returned actions (search/click/buy), and collecting programmatic rewards. It reports structured JSON artifacts containing total reward, success, and per‑step traces. This provides a reproducible benchmark for instruction following in e‑commerce search and product selection without an LLM judge.