Multi-agent Evaluation

Code Translator Judge - Task Description The Code Translator Judge (green agent) evaluates the quality of code translation performed by participant agents (purple agents). What it evaluates: The green agent sends code snippets in a source programming language (e.g., Python) to participant agents and asks them to translate the code into a target programming language (e.g., JavaScript). It then evaluates the translations across four key metrics: Execution Correctness (0-10) - Does the translated code produce the same output/behavior as the original? Style Score (0-10) - Does the code follow idiomatic conventions of the target language? Conciseness (0-10) - Is the translation efficient without unnecessary verbosity? Relevance (0-10) - Does the translation accurately preserve the original code's intent and logic? Sample tasks: Translate a recursive factorial function from Python to JavaScript Convert a Fibonacci class with memoization from Python to JavaScript Transform regex parsing functions between languages Overall scoring: The agent calculates an overall score as the average of the four metrics, providing a comprehensive assessment of translation quality.