Workshop on Cognitive-AI Benchmarking
What are the current limits of AI models as explanatory models of human behavior?
How might the cognitive sciences drive the development of more robust and reliable AI systems?
The goal of this workshop is bring together researchers across cognitive science and artificial intelligence (AI) to engage with these questions and identify opportunities to work together to advance progress in both fields. In particular, we propose Cognitive-AI Benchmarking as a particularly promising strategy --- that is, the community-coordinated establishment of common benchmarks, tools, and best practices for model-human comparisons across diverse and ecologically relevant domains and tasks. We will host a combination of talks, panel discussion, and breakout activities to: highlight past successes in Cognitive-AI Benchmarking and limitations of current approaches, share tools and best practices, and outline future challenges and goals for the field. At CogSci 2023, we bring these perspectives together.
Organizers
