Graham Neubig is a co-founder and Chief Scientist of All Hands AI, and an Associate Professor at the Language Technologies Institute at Carnegie Mellon University. One of the leading academic voices in AI agents and natural language processing, Graham has been responsible for core advances in the field — including foundational work on open-source large language models for code and among the first agents designed to complete tasks on the open web.
AI coding agents are becoming more capable, but evaluating them is harder than it looks. Most benchmarks focus on a single dimension of agent capabilities; for instance, the popular SWE-Bench benchmark only ...
