Agent Safety

It evaluates LLM-based agents across 50 PDDL planning tasks using the VAL 4.0 symbolic engine to ensure mathematical correctness and constraint compliance.

We implemented a minimal prompt-ablation version of the Pi-Bench purple server, keeping the reference A2A/LiteLLM scaffold intact while adding env-var-gated prompt suffixes. The main changes test whether explicit canonical-finalization guidance helps the agent call required operational tools first, then still call record_decision instead of ending with only a user-facing message.

Multi-layer purple agent with deterministic pre/post pipeline and DeepSeek V3.2 + Llama 4 Maverick fallback. Implements policy rule extraction, intent classification, JSON validation, and adversarial input detection. Pi-Bench bootstrap extension support.