Robotic Blended Sonification: Consequential Robot Sound as Creative Material for Human-Robot Interaction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Johansen, Stine S., Browning, Yanto, Brumpton, Anthony, Donovan, Jared, Rittenbruch, Markus
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909177407864832
author Johansen, Stine S.
Browning, Yanto
Brumpton, Anthony
Donovan, Jared
Rittenbruch, Markus
author_facet Johansen, Stine S.
Browning, Yanto
Brumpton, Anthony
Donovan, Jared
Rittenbruch, Markus
contents Current research in robotic sounds generally focuses on either masking the consequential sound produced by the robot or on sonifying data about the robot to create a synthetic robot sound. We propose to capture, modify, and utilise rather than mask the sounds that robots are already producing. In short, this approach relies on capturing a robot's sounds, processing them according to contextual information (e.g., collaborators' proximity or particular work sequences), and playing back the modified sound. Previous research indicates the usefulness of non-semantic, and even mechanical, sounds as a communication tool for conveying robotic affect and function. Adding to this, this paper presents a novel approach which makes two key contributions: (1) a technique for real-time capture and processing of consequential robot sounds, and (2) an approach to explore these sounds through direct human-robot interaction. Drawing on methodologies from design, human-robot interaction, and creative practice, the resulting 'Robotic Blended Sonification' is a concept which transforms the consequential robot sounds into a creative material that can be explored artistically and within application-based studies.
format Preprint
id arxiv_https___arxiv_org_abs_2404_13821
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Robotic Blended Sonification: Consequential Robot Sound as Creative Material for Human-Robot Interaction
Johansen, Stine S.
Browning, Yanto
Brumpton, Anthony
Donovan, Jared
Rittenbruch, Markus
Human-Computer Interaction
Robotics
Sound
Audio and Speech Processing
Current research in robotic sounds generally focuses on either masking the consequential sound produced by the robot or on sonifying data about the robot to create a synthetic robot sound. We propose to capture, modify, and utilise rather than mask the sounds that robots are already producing. In short, this approach relies on capturing a robot's sounds, processing them according to contextual information (e.g., collaborators' proximity or particular work sequences), and playing back the modified sound. Previous research indicates the usefulness of non-semantic, and even mechanical, sounds as a communication tool for conveying robotic affect and function. Adding to this, this paper presents a novel approach which makes two key contributions: (1) a technique for real-time capture and processing of consequential robot sounds, and (2) an approach to explore these sounds through direct human-robot interaction. Drawing on methodologies from design, human-robot interaction, and creative practice, the resulting 'Robotic Blended Sonification' is a concept which transforms the consequential robot sounds into a creative material that can be explored artistically and within application-based studies.
title Robotic Blended Sonification: Consequential Robot Sound as Creative Material for Human-Robot Interaction
topic Human-Computer Interaction
Robotics
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2404.13821