AI-1338 - USA (Virgina) - Evaluating Large Language Models Solution - Deadline October 30,2026

– Vendor needs to provide evaluating Large Language Models (LLMs) solution. – Provide development of a robust, actuarially grounded benchmarking framework designed to evaluate modern large language models (LLMs).– Framework for evaluating LLMs on problems with objectively measurable, reproducible answers (e.g., claims triage, underwriting decisions, fraud flagging, rating plans, regulatory issues, risk management, reserving, credibility). – Design a fixed, versioned suite of evaluation tasks that can be efficiently re–run as new models are released, allowing to track performance over time.