The Green Agent - that's our evaluator. The Green Agent loads the 1000+ test tasks from our dataset and the 100 home configurations from our home data file. When an evaluation starts, the Green Agent sends each task to the Purple Agent being tested. Now, critically, the Purple Agent receives three pieces of information: the natural language instruction, a complete list of available devices in that specific home, and the current state of those devices. The Purple Agent, which is the agent under evaluation, uses its LLM to reason about the instruction, check which devices are available, and generate the appropriate device operations in the correct API format. It responds with a JSON array of operations. The Green Agent then compares this response against the expected ground truth operations and computes accuracy metrics.