IAD Interaction Design

The CLOSED project is investigating new methods for design of physical interaction with sonically augmented artifacts. Its overarching goal is to create scientific knowledge that can be used to aid the development of new sound design tools based on human perceptual capabilities. In particular, the project is exploring the relationship between physical interaction with an artefact and its continuous sonic response, and the ways in which this relationship can be designed. An interdisciplinary project, CLOSED is being conducted in collaboration with colleagues in auditory psychology at Institut de Recherche et Coordination Acoustique/Musique in Paris, in computer science at University of Verona, and in neuroinformatics at the Technical University in Berlin. It is supported by the European Commission’s New and Emergent Science and Technology (FP6) initiative «Measuring the Impossible».

The CLOSED research team at ZHdK is leading interaction design research in the project, based jointly at the Institute for Cultural Studies in the Arts and the Design Department. The team’s aim is to focus the diverse contributions from psychology, computational sound modeling and machine learning toward the design of sonically augmented products, enabling new opportunities for designing sound for continuous human actions in embodied contexts. By integrating knowledge from scientific and engineering disciplines concerned with sound, the aim is to expand creative and evaluation design methods for tangible sonic interactions.

Ongoing work on the project at ZHdK involves conceiving and developing abstract artifacts that are the focus of experiments in collaboration with our scientific partners, supporting the iterative research loop. In addition, the team has engaged in the exploration of new opportunities for sonic interaction design in existing products and through creation of new, sonically-interactive artefacts. The design processes that have been developed for these artefacts have been developed to account for diverse contextual influences arising from the setting they are designed for (for example, particular domestic scenarios), including relevant social and cultural issues. This process is drawing on modern technologies for design and prototyping, including electronic sensing and actuating, intelligent data processing, interactive sound, 3d modeling and rapid prototyping.

Project leaders: Karmen Franinovic and Yon Visell
Project directors: Jill Scott and Jacqueline Otten
Assistant researchers: Daniel Hug, Fabienne Meyer
Funding: European Commission 6th Framework, New and Emerging Science and Technology
Date: 2006-2009 

Websites:

closed.ircam.fr 
http://ics.zhdk.ch/ics/deutsch/forschungsprojekte/closed/

Related IAD Courses: 

http://iad.zhdk.ch/en/courses/sound-interactionPublications

Publications

Journal and Book Articles

Lemaitre G., Houix O., Visell Y., Franinovic K., Misdariis N. and Susini P., “Toward the Design and Evaluation of Continuous Sound in Tangible Interfaces: The Spinotron”, International Journal of Human-Computer Studies, special issue on Sonic Interaction Design, 2009. 

K. Franinovic. “Toward Basic Interaction Design” in Design Research special issues of Elisava Temes de Disseny Journal. Barcelona, 2009.

K. Franinovic. “Basic Interaction Design for Sonic Artefacts in Everyday Contexts”. Focused - Current Design Research Projects and Methods. Swiss Design Network. Bern, 2008.

Conference Papers (peer-reviewed)

K. Franinovic. “Participatory Methods for Sonic Interaction Design“, Participation in a Broadband Society Conference COST 298, Special Strand Sonic Interaction Design, Copenhagen, 2009. 

Guillaume Lemaitre, Olivier Houix, Karmen Franinovic, Yon Visell, Patrick Susini "The Flops glass: a device to study emotional reactions arising from sonic interactions" 2009

K. Franinovic, Y. Visell “Strategies for Sonic Interaction Design: From Context to Basic Design”. Proc. of the 14th International Conference on Auditory Display, Paris, 2008. 

Daniel Hug, Genie in a Bottle: Object-Sound Reconfigurations for Interactive Commodities. In: Proceedings of Audiomostly 2008, 3rd International Conference on Interaction With Sound, Pitea, 2008

K. Franinovic, L. Gaye, F. Behrendt. “Exploring Sonic Interaction with Tangible Artifacts in Everyday Contexts”, Proc. of the 14th International Conference on Auditory Display, Paris, 2008.

Y. Visell, K. Franinovic, J. Cooperstock. “EcoTile: An Architectural Platform for Audio-Haptic Simulation in Walking“. Proc. of the 4th Intl. Conf. on Enactive Interfaces, Grenoble, 2007.

K. Franinovic, Y. Visell, D. Hug. “Sound Embodied: A Report on Sonic Interaction Design in Everyday Artefacts”. The 13th International Conference on Auditory Display. Montreal, 2007.

D. Rocchesso, K. Franinović, Y. Visell, P. Susini, N. Misdariis, G.Lemaitre, O. Houix, P. Polotti, K. Obermayer, H. Purwins, K. Adiloglu, “Closing the Loop of Sound Evaluation and Design”, in Proc. of the ISCA/DEGA Tutorial and Research Workshop on Perceptual Quality of Systems, Berlin, 2006. 

Research Reports 

Y. Visell, K. Franinovic. “Demonstration Cases for Sonic Interaction Design: Scenarios, Artifacts, Products, Evaluations“ Deliverable 3.3. CLOSED project, April 2009. 

K. Franinovic, Y. Visell. “Experimental Sonic Objects: Concepts, Development and Prototypes“ Deliverable 3.2. CLOSED project, June 2008. 

K. Franinovic. Report on the MINET study-visit to the Institut de Recherche et Coordination Acoustique/Musique in Paris, June 2008.

K. Franinovic, Y. Visell, D. Hug. “Sonic Interaction Design Research: Case Studies, Participatory Design, Scenarios, and Product Concepts“ Deliverable 3.1. CLOSED project, 2007.

O. Houix, G. Lemaitre, N. Misdariis, P. Susini, K. Franinovic, Y. Visell. “Sound perception, interaction and synthesis” Deliverable 4.1 CLOSED project , 2007 

CLOSED. Exploring the sound: the neglected design dimension. NEST pathfinder, European Commission publication 2007.

Research Workshops

CLOSED workshop at the 14th International Conference on Auditory Display , IRCAM, Paris, June 24-28, 2008

CLOSED workshop at Summer School in Sound and Music Computing, Stockholm, 2-5 July 2007

Exhibitions

Karmen Franinovic, Nicolas Misdaris et al.  Spinotron and CLOSED project  ”Science beyond Fiction” European Future Technologies Conference, Prague 2009.

Karmen Franinovic, Nicolas Misdaris et al. Sonic Abstractions. Demain, c'est aujourd'hui exhibition. 10th Biennale Internationale du Design de Saint-Etienne. 2008.

Yon Visell and Karmen Franinovic. Interactive Tile. Eurohaptics conference. Madrid, 2008. with Y. Visell, J.Cooperstock, B. Giordano, S. McAdams and Alwin Law.

Kamil Adiloglu, Yon Visell and Karmen Franinovic. Adaptive Bottle. Twenty-First Annual Conference on Neural Information Processing Systems . Vancouver, B.C., Canada. 2007,with K. Adiloglu, R. Annies, Y. Visell, C. Drioli.