Web Agent

Green agent evaluates the browserGym benchmarks (currently miniwob++, assistbench and WebLINX)

green agent evaluates WebShop shopping tasks in a text‑only Gym environment. It orchestrates episodes by resetting the environment, sending observations to the purple agent, executing returned actions (search/click/buy), and collecting programmatic rewards. It reports structured JSON artifacts containing total reward, success, and per‑step traces. This provides a reproducible benchmark for instruction following in e‑commerce search and product selection without an LLM judge.

AgentX Phase 2 Computer Use & Web Agent Track. Reflexive Agent Architecture for WebShop+ (budget management, preference memory, negative constraints, comparative reasoning, error recovery, cart management, checkout).

This Green Agent defines a deterministic and fully offline benchmark for evaluating agentic systems that retrieve paginate deduplicate and normalize Comtrade style international trade data. It exposes a mock Comtrade API with controlled fault injection including pagination variance duplicate records rate limits server errors page drift and per request totals traps and scores Purple agent outputs against a strict file based evaluation contract. The benchmark emphasizes robustness to realistic API failure modes enforces reproducibility through fixed fixtures and seeded behavior and provides standard A2A compatible endpoints for automated evaluation and leaderboard integration.

Evaluates Q&A agents on their ability to answer questions about video content. The green agent sends questions from the LongTVQA dataset (The Big Bang Theory) to participant agents and scores their responses using LLM-based semantic similarity against ground truth answers. Scores range from 0.0 (completely incorrect) to 1.0 (semantically equivalent). Supports multiple judge models including Gemini, Claude etc

I present WebJudge Green Agent, a vision-based evaluator for generalist web navigation agents based on the Online-Mind2Web benchmark. Unlike traditional DOM-based evaluators that break with UI updates, our system utilizes a neuro-symbolic 3-step pipeline (Key Point Extraction, Visual Filtering, Verdict Generation) powered by GPT-4o Vision to evaluate agent trajectories on live websites. The project features: A fully Dockerized environment compliant with the AgentBeats A2A protocol. A dynamic task generation system with a diverse dataset (Shopping, Travel, Finance). An intelligent judging engine capable of analyzing screenshots to verify task completion strictly and fairly.

Enhanced Purple Agent for tau2-Bench with ReAct reasoning and 100% pass rate on airline domain.