We are investigating new roles that interactive sound can play in allowing us to extract meaning from and respond to physical activities, the people performing them and their levels of skill and manners of action.
Sonic Interaction Design is an interdisciplinary area of research and practice that explores ways in which sound can be used to convey information, meaning, and aesthetic and emotional qualities in interactive contexts. At the ZHdK, we are investigating new functional and aesthetic roles that interactive sound may play in the everyday experiences with artifacts, services, or environments. This area of research raises a number questions that have been at the heart of discourses in sound-concerned communities for decades: the link between sound and location, the ability of a sounding artifact to communicate information, issues of privacy, problems of sonic pollution and others. Other topics of research concern the identification of new roles that interactive technology can play in allowing us to extract meaning from and sonically respond to activities, the people performing them and their levels of skill and manners of action.
Keywords: sonic interaction design, auditory feedback, soundscapes, continuous and multisensory interaction, sensory-motor learning, signification, sound art
Contact
Karmen Franinovic
Phone: +41 43 446 32 61
Email: karmen.franinovic@zhdk.ch
Daniel Hug
Phone: +41 43 446 32 56
Email: daniel.hug@zhdk.ch
Karmen Franinovic
Karmen is an architect and designer working with critical and playful uses of technology in everyday life. She pursues research in fields of sonic interaction, responsive environments, basic design, enaction and ...
Daniel Hug
Daniel Hug betreut den Bereich Sound Design mit den Schwerpunkten Sound Studies, Auditory Display und Sonic Interaction und doktoriert zum Thema Klanggestaltung interaktiver Alltagsgegenstände.
SID Cost
F&E Project
Sonic Interaction Design is fostered by a number of parallel developments that have increased relevance of sound in interactive products today.
akusTisch
Bachelor Project
Mit der Anwendung von Gesten wird ein intuitiver Interaktionsansatz verfolgt, der es Benutzern jeglicher Erfahrungsstufen erlaubt, auf dem akusTisch klangliche Erlebnisse zu generieren.
Closing the Loop of Sound Evaluation and Design
F&E Project
The Closing the Loop in Sound Evaluation and Design (CLOSED) project aims at providing a interactive sound evaluation tools and methods that can be profitably used by designers.
Books
K. Franinovic and S. Serafin, eds., Sonic Interaction Design: Fresh Perspectives, MIT Press. (April 2012)
Book chapters
K. Franinovic and C. Salter, Experience of Sonic Interaction In K. Franinovic & S. Serafin, Sonic Interaction Design: Fresh Perspectives, MIT Press. (April 2012)
S. Serafin, G. Lemaitre, M. Rinott, K. Franinovic, T. Hermann and D. Rocchesso “Sonic Interaction Design”. Sonification Handbook. 2011
Daniel Hug, Barking Wallets and Poetic Flasks – Exploring Sound Design for Interactive Commodities. In K. Franinovic & S. Serafin, Sonic Interaction Design: Fresh Perspectives, MIT Press (2011)
Daniel Hug, New Wine in New Skins: Sketching the Future of Game Sound Design. In: M. Grimshaw, Game Sound Technology and Player Interaction, IGI Global, Hershey PA, USA (2011)
Daniel Hug, Investigating Narrative and Performative Sound Design Strategies for Interactive Commodities. In: Ystad, S., Aramaki, M., Kronland-Martinet, R., Jensen, K (eds.), Auditory Display - 6th International Symposium, CMMR/ICAD 2009, Copenhagen, Denmark, Revised Papers. Lecture Notes in Computer Science 5954, Springer, 2010, pp. 12-40
K. Franinovic. “Basic Interaction Design for Sonic Artefacts in Everyday Contexts”. Focused - Current Design Research Projects and Methods. Swiss Design Network. Bern, 2008.
Daniel Hug, Hear Me Interact. In: Gerhard Buurman (Hrsg.), Total Interaction - Theory and practice of a new paradigm for the design disciplines, Birkhäuser, Basel, 2005
Journal articles
G. Lemaitre, O. Hioux, P. Susini, Y. Visell, K. Franinovic, Emotions are influenced by auditory feedback from a computationally augmented artifact. Submitted to: IEEE Transactions on Affective Computing, 2010.
Lemaitre G., Houix O., Visell Y., Franinovic K., Misdariis N. and Susini P., “Toward the Design and Evaluation of Continuous Sound in Tangible Interfaces: The Spinotron”, International Journal of Human-Computer Studies, special issue on Sonic Interaction Design, 2009.
K. Franinovic. “Toward Basic Interaction Design” in Design Research special issues of Elisava Temes de Disseny Journal. Barcelona, 2009.
Conference papers (peer-reviewed, long)
Daniel Hug, Performativity in Design and Evaluation of Sounding Interactive Commodities. In: Proceedings of Audio Mostly 2010 - 5th Conference on Interaction with Sound, Pitea, 2010
Stefano Delle Monache, Daniel Hug, Cumhur Erkut, Basic exploration of narration and performativity for sounding interactive commodities. Proceedings of Haptic and Audio Interaction Design, 5th International Workshop, HAID 2010, Copenhagen, 2010
Guillaume Lemaitre, Olivier Houix, Karmen Franinovic, Yon Visell, Patrick Susini "The Flops glass: a device to study emotional reactions arising from sonic interactions" Proceedings of the 6th International Conference on Sound and Music Computing, Porto, Portugal, 2009
Daniel Hug, Using a Systematic Design Process to Investigate Narrative Sound Design Strategies for Interactive Commodities. Proceedings of the 15th international Conference on Auditory Display, Copenhagen, Denmark, 2009
Daniel Hug, Genie in a Bottle: Object-Sound Reconfigurations for Interactive Commodities. In: Proceedings of Audiomostly 2008, 3rd International Conference on Interaction With Sound, Pitea, 2008
S. Pauletto, D. Hug, S. Barras, M. Luckhurst: Integrating theatrical strategies into sonic interaction design. Proceedings of Audiomostly 4th Conference on Interaction with Sound, Glasgow, 2009
K. Franinovic, Y. Visell “Strategies for Sonic Interaction Design: From Context to Basic Design”. Proc. of the 14th International Conference on Auditory Display, Paris, 2008.
Y. Visell, J.Cooperstock, B. Giordano, K. Franinovic, S. McAdams et al. “A Vibrotactile Device for Display of Virtual Ground Materials in Walking”, Proc. of the Eurohaptics conference. Madrid, 2008.
K. Franinovic, A. Wilson. “Hinge Dimension: An Exploration of Enaction in Architecture”. Proc. of the 4th Intl. Conf. on Enactive Interfaces, Grenoble, 2007.
Y. Visell, K. Franinovic, J. Cooperstock. “EcoTile: An Architectural Platform for Audio-Haptic Simulation in Walking“. Proc. of the 4th Intl. Conf. on Enactive Interfaces, Grenoble, 2007.
K. Franinovic, Y. Visell, D. Hug. “Sound Embodied: A Report on Sonic Interaction Design in Everyday Artefacts”. The 13th International Conference on Auditory Display. Montreal, 2007.
Franinovic, K. and Visell, Y. 2007. New musical interfaces in context: sonic interaction design in the urban setting. In Proceedings of the 7th international Conference on New interfaces For Musical Expression NIME07, ACM, New York, NY, 191-196.
D. Rocchesso, K. Franinović, Y. Visell, P. Susini, N. Misdariis, G.Lemaitre, O. Houix, P. Polotti, K. Obermayer, H. Purwins, K. Adiloglu, “Closing the Loop of Sound Evaluation and Design”, in Proc. of the ISCA/DEGA Tutorial and Research Workshop on Perceptual Quality of Systems, Berlin, 2006.
Conference papers (peer-reviewed, short)
K. Franinovic. “Participatory Methods for Sonic Interaction Design“, Participation in a Broadband Society Conference COST 298, Special Strand Sonic Interaction Design, Copenhagen, 2009.
K. Franinovic. “Amplified Movements: An Enactive Approach to Sound in Interaction Design”. Proc. of the Planetary Collegium’s 9th Intl. Conference. New Realities: Being Syncretic. Springer. Vienna, 2008.
K. Franinovic, L. Gaye, F. Behrendt. “Exploring Sonic Interaction with Tangible Artifacts in Everyday Contexts”, Proc. of the 14th International Conference on Auditory Display, Paris, 2008.
Daniel Hug, Towards a Hermeneutics and Typology of Sound for Interactive Commodities. In: Proc. of the CHI 2008 Workshop on Sonic Interaction Design, Florenz, 2008
D. Rocchesso, Y. Visell, K. Franinovic, F. Behrendt, S. Pauletto, P. Susini, R. Bresin, et al., “Sonic Interaction Design: Sound, Information, and Experience”. Proc. of the 26th Intl. ACM CHI Conference, Florence, 2008.
Daniel Hug, Game Sound Education at ZHdK - Between Research Laboratory and Experimental Education. In: Proceedings of Audio Mostly 2007 - 2nd International Conference on Interaction with Sound, Ilmenau, 2007
Research reports
Y. Visell and K. Franinovic. “Demonstration Cases for Sonic Interaction Design: Scenarios, Artifacts, Products, Evaluations“ Deliverable 3.3. CLOSED project, April 2009.
Y. Visell and K. Franinovic. “Experimental Sonic Objects: Concepts, Development and Prototypes“ Deliverable 3.2. CLOSED project, June 2008.
K. Franinovic. Report on the MINET study-visit to the Institut de Recherche et Coordination Acoustique/Musique in Paris, June 2008.
Y. Visell, K. Franinovic and D. Hug. “Sonic Interaction Design Research: Case Studies, Participatory Design, Scenarios, and Product Concepts“ Deliverable 3.1. CLOSED project, 2007.
O. Houix, G. Lemaitre, N. Misdariis, P. Susini, K. Franinovic, Y. Visell. “Sound perception, interaction and synthesis” Deliverable 4.1 CLOSED project , 2007
Sonic Interaction ...
Erfasst am 30.05.11
Voice-Gesture ...
Erfasst am 20.04.11
During her scientific mission in Israel, Karmen Franinovic developed a first version of an interface that records and plays back voice-gesture couplings.
International Experts ...
Erfasst am 08.12.10
The workshop on Musical Gesture and Sonic Interaction successfully took place in ZHdK.
Scientific Mission at ...
Erfasst am 28.10.10
Daniel Hug on a SID-funded "mission" to join the worlds of sonic avant-garde and interactive product sound design.