Open Philanthropy recommended a gift of $739,866 to UC Berkeley to support Professor Koushik Sen and his team in developing a software engineering benchmark, using their Repository2Environment framework.
This grant was funded via a request for proposals for projects benchmarking LLM agents on consequential real-world tasks. This falls within Open Philanthropy’s focus area of potential risks from advanced artificial intelligence.