This is a reproduction of the LINGOLY benchmark. The benchmark consists of 204 questions with 1,133 subquestions pulled from the UK Linguistics Olympiad (UKLO) and is meant to test reasoning capabilities by asking about grammatical and linguistic patterns in low-resource languages. The green agent is a test administrator who provides questions and then scores them deterministically using 4 metrics: exact matching, BLEU, ROUGE, and CHRF. The test taker is a single purple agent that can respond to natural language requests.