Modular observers. OpenSoundLab and PatchWorld as case studies for emerging practices of modular synthesis in extended realities

Abstract

Our research set out to determine how the distinctive social ethos and tactile appeal of physical modular synthesisers could be transferred into extended reality contexts. Employing a ‘netnographic’ approach, the research examined content drawn from social media platforms including YouTube, Discord and Reddit. Particular attention was given to an analysis of ‘PatchWorld’ as the most prominent commercially available virtual modular synthesis tool. Additionally, ‘OpenSoundLab’, an open-source mixed-reality modular sound laboratory that was developed in earlier research, was adapted to allow multi-user sessions in mixed reality (MR), both locally co-located or remotely. Commercial standalone headsets were handed out to three artists in order to observe how they translate their patch and performance practices into extended realities. Distributing both the headsets and software functioned as a form of ‘cultural probe’, enabling the collection of detailed user experiences and acting as a prompt for informed conversations. Through this process, the evaluation yielded evidence that some of the most valued aspects of using physical modular systems can be translated to virtual modular systems, especially since these share a similar – if not greater – potential for creative and social immersion in a spatial instrument.