MultiMediate: Multi-modal Group Behaviour Analysis for Artificial Mediation

For this years’ multi-domain engagement estimation task, you need NoXi and NoXiJ as a training dataset. This dataset is fully available and you can start implementing and training your approaches now. Subsequently we will make available validation sets for MPIIGroupInteraciton which you can use for monitoring your performance on these out-of-domain evaluation tasks, as well as for few-shot domain adaptation.

MPIIGroupInteraction (MultiMediate'21-'25)

Needed for:

  • Bodily behaviour recognition
  • Backchannel detection
  • Agreement estimation from backchannels
  • Eye contact detection
  • Next speaker prediction
  • Multi-Domain Engagement Estimation

NoXi (MultiMediate'23-'25)

Training set for Multi-Domain Engagement Estimation

NoXi+J (MultiMediate'25)

Japanese and Chinese training set for Multi-Domain Engagement Estimation