The Tatort Test of Intelligence: Towards Narrative Comprehension as a Benchmark for AI

We propose—somewhat tongue-in-cheek, yet with serious implications—a new test for artificial intelligence: the ability to watch a 90-minute episode of the long-running German crime drama Tatort, and to explain every relevant detail. This involves reconstructing the evolving social network of characters, identifying their beliefs, desires, and intentions, and, crucially, determining who committed the crime. We argue that this task integrates narrative understanding, common-sense reasoning, social cognition, and theory of mind—and thus provides a uniquely challenging benchmark for AI.

Authors

• Stefan Kramer Johannes Gutenberg-Universität Mainz
• Lennart Baur Johannes Gutenberg University Mainz
• Lars Reinhardt Johannes Gutenberg University Mainz

Keywords

No keywords are indexed for this paper.