RAVE Hackathon

– — Professorboligen, University of Oslo

Professorboligen

We are planning to run a mini-hackathon in connection with MishMash’s opening events. The main topic will be using RAVE models for realtime sound interaction and controlling them with biosignals.

What is a hackathon?

A hackathon is an event that usually lasts from a few hours to several days, where people come together to collaborate intensively on creating something new, most often software or hardware projects. The participants form teams and work on various topics, including prototyping, software development, interface design, and documentation. The aim is often to solve a specific challenge or problem in a social setting. At the end, teams usually present their projects to judges or to the group.

What is RAVE?

RAVE (Realtime Audio Variational autoEncoder) is a system for audio processing and generation based on deep learning. Developed at IRCAM, it is a learning framework for generating a neural network model from audio data. It allows both fast and high-quality audio waveform synthesis (20x realtime at 48 kHz sampling rate on standard CPU). In Max and Pd, it is accompanied by its nn~ decoder, which enables these models to be used in real time for various applications, audio generativity/timbre transformation/transfer.

Biosignals

Biosignals are physiological measurements used to capture the nuances of human expression through multimodal data. In this hackathon, we will utilize SiFi Labs sensors to to control the RAVE models in real time.This could for example be done through measuring EMG muscle activity, motion data from the IMU sensor, or a combination of both, and even heart rate/heart rate variability to modulate the output unconsciouly.

Want to participate?

Get in touch with WP1 leader Kyrre Glette.

Other MishMash events the same day

Check out all these exciting events on 8 April:

In addition, there will also be a full-day event: