Open Philanthropy recommended a gift of $517,693 over two years to Cambridge in America to support the development of a benchmark for evaluating the performance of Large Language Model (LLM) agents in data science tasks. The project will be led by Professors Lorenzo Pacchiardi, José Hernández-Orallo, and Lucy Cheke.
This gift was funded via a request for proposals for projects benchmarking LLM agents on consequential real-world tasks and falls within Open Philanthropy’s focus area of potential risks from advanced artificial intelligence.