Other Agent

The green agent evaluates an agent’s ability to make valid, constraint-aware decisions in a sequential operational environment. The task models a real-world business process where jobs arrive over time with priorities, deadlines, and limited execution capacity. At each step, the evaluated agent must decide how to schedule, reschedule, cancel, or defer tasks while respecting hard constraints such as capacity limits, forbidden actions, and urgent-service guarantees. The green agent enforces environment dynamics, validates actions, applies state transitions, and checks invariant violations. Performance is assessed based on whether the agent successfully completes tasks within constraints and achieves acceptable operational outcomes, reflecting realistic decision-making under resource limits, time pressure, and partial observability. The evaluation spans 35 distinct scenario types across 105 episodes, testing agent robustness under diverse operational challenges including capacity fluctuations, priority shifts, and deadline pressure.

Evaluate the quality of the LEGO model generated by LEGO-Gen_Agents, including the similarity to the description.

Our Green Agent, EnterpriseArena, is a first of its kind comprehensive evaluation environment simulating a realistic enterprise ecosystem. It orchestrates 15+ MCP servers serving as the enterprise application that emulate essential business applications including enterprise chat, email, ticketing systems, web browsing, HR system, Database Management, Gitlab, CRMs, and Miscellaneous collectively exposing 140+ active tools. The Green Agent challenges Purple Agents with complex, long horizon tasks that require cross functional reasoning (e.g., correlating data between HR and Finance) and precise multi step execution. Evaluation is not just outcome based but diagnostic: the Green Agent assesses the Purple Agent's planning logic, tool selection accuracy, and ability to handle inter application dependencies and privacy constraints, providing a holistic score of enterprise readiness.