EVENT DETAILS
Title: Six Principles For Evaluating Cognitive Capabilities in AI Models - Reiss Lecture
Speaker: Melanie Mitchell, Santa Fe Institute
Abstract: Modern AI systems have exceeded human performance on many benchmarks meant to evaluate general cognitive capacities. However, it is often the case that benchmark performance does a poor job of predicting general capacities in real-world settings. In this article I describe several issues related to evaluation that can cause this mismatch, and propose six principles, inspired by developmental and comparative psychology, that need to be adopted to enable rigorous evaluation for AI systems. These principles are illustrated by case studies from the psychology and AI literature.
Zoom: https://northwestern.zoom.us/j/96257055494
-----
To subscribe to the Applied Mathematics Colloquia List send a message to LISTSERV@LISTSERV.IT.NORTHWESTERN.EDU with the command:
SUBSCRIBE esam-seminar FirstName LastName
TIME Thursday May 14, 2026 at 11:15 AM - 12:15 PM
LOCATION M416, Technological Institute map it
ADD TO CALENDAR&group= echo $value['group_name']; ?>&location= echo htmlentities($value['location']); ?>&pipurl= echo $value['ppurl']; ?>" class="button_outlook_export">
CONTACT Noor Kaur noor.kaur@northwestern.edu
CALENDAR McCormick-Engineering Sciences and Applied Mathematics (ESAM)