Jim Tørresen

Jim Tørresen

Professor, Department for Informatics, University of Oslo

MishMash role: Member · WP1 , WP3 , WP7

Informatics

Other projects

Latest results

Type

Book chapter

  2. Book chapter, 2026

    Reducing Robot Vulnerabilities Through Joint Regulatory Assessment and User-Centered Development and Testing

    Jim Tørresen ; Diana Saplacan Lindblom ; Adel Baselizadeh ; Tobias Mahler ; Lee Andrew Bygrave

  5. Book chapter, 2026

    "There’s something human about it!” - Exploring users’ perception of nonverbal communication of robotic furniture

    Claudia Magdalena Sikora ; Marieke van Otterdijk ; Rebekka Soma-Jestilä ; Jim Tørresen ; Diana Saplacan Lindblom

    Non-anthropomorphic robots are integrating into our homes. People attribute human-like characteristics to these robots, although they do not resemble humans. This raises the question of whether similar processes would occur when people interact with robot furniture. Thus, the presented exploratory pilot study investigates how users intuitively interpret and perceive the non verbal communication of such robots. In an instrumental case study, we had eleven participants interacting with the T-ABLE robot through expressive behavior. Participants were interviewed about their experience. Our findings indicate that the participants use their associations between behavior and prior to similar experiences to attribute personality to the robot table. These findings provide insights for theorizing the intuitive comprehension of the behavior of non-anthropomorphic robots.

Journal article

  2. Journal article, 2026

    Investigating Auditory–Visual Perception Using Multi-Modal Neural Networks with the SoundActions Dataset

    Open access

    Jinyue Guo ; Jim Tørresen ; Alexander Refsum Jensenius

    Musicologists, psychologists, and computer scientists study relationships between auditory and visual stimuli from very different perspectives and using various terminologies and methodologies. This article aims to bridge the gap between phenomenological sound theory, auditory–visual theory, and audio–video processing and machine learning. We introduce the SoundActions dataset, a collection of 365 audio–video recordings of (primarily) short sound actions. Each recording has been human‑labeled and annotated according to Pierre Schaeffer’s theory of reduced listening, which describes the property of the sound itself (e.g., ‘an impulsive sound’) instead of the source (e.g., ‘a bird sound’). With these reduced‑type labels in the audio–video dataset, we conducted two experiments: (1) fine‑tuning the latest audio–video transformer model on the reduced‑type labels in the SoundActions dataset, proving that the model can recognize reduced‑type labels, and observing that the modality‑imbalance phenomenon is similar to the added value theory by Michel Chion and (2) proposing the Ensemble of Perception Mode Adapters method inspired by Pierre Schaeffer’s three listening modes, improving the audio–video model also on reduced‑type tasks.

More results in NVA…