Designed and built with care, filled with creative elements

Top

ENS-Data Science colloquium – Alexander Mathis (EPFL) : Hierarchy and the body: what do multimodal models understand about behavior?

Amphi Jean Jaurès 29 rue d'Ulm, PARIS

Behavior is how brains act on the world, and measuring it precisely is central to neuroscience, medicine and many other fields. Deep learning has made tracking bodies in video routine, yet most behavioral models still map short clips to a fixed set of labels at a single timescale. This misses two defining properties of behavior. It is embodied: the body shapes how every action unfolds. And it is hierarchical: movements nest within actions, and actions within activities. In this talk, I will present our work on learning and benchmarking these […]