Sunday, June 10th

Time Session Venue
9:00 - 6:00 Student ThinkTank Forestry 144

Monday, June 11th

Time Session Venue
9:00 - 9:30 Welcoming Remarks Forestry G002
9:30 - 10:30 Health Data Forestry G002
10:30 - 11:00 Break Forestry Atrium
11:00 - 12:00 Keynote - Dr. Stefania Serafin Forestry G002
12:00 - 1:30 Lunch Forestry Atrium
1:30 - 3:00 Designing Sonification Forestry G002
3:00 - 3:30 Break Forestry Atrium
3:30 - 5:00 Images, Graphs and Spaces Forestry G002
6:00 - 8:00 Welcome Reception Forestry Atrium

Tuesday, June 12th

Time Session Venue
9:00 - 10:30 Sonification and Ambient Displays Forestry G002
10:30 - 11:00 Break Forestry Atrium
11:00 - 12:00 Keynote - Dr. Carryl Baldwin Forestry G002
12:00 - 1:30 Lunch Forestry Atrium
1:30 - 3:00 Hyundai Motors Special Session Forestry G002
3:00 - 3:10 Group Photo Forestry Atrium
3:10 - 3:30 Break Forestry Atrium
3:30 - 5:00 Diversity and Inclusion Workshop Forestry 144
5:00 - 6:00 Board Meeting (Open to Audience) Forestry 144
6:00 - 7:00 Board Meeting (Closed to Audience) Forestry 144
7:00 - 9:00 Jam Session Franklin Square Inn

Wednesday, June 13th

Time Session Venue
9:00 - 10:30 Full Day Workshops and Morning Tutorial Various
10:30 - 11:00 Break Forestry Atrium
11:00 - 12:30 Full Day Workshops and Morning Tutorial (cont.) Various
12:30 - 1:30 Lunch Forestry Atrium
1:30 - 3:00 Full Day Workshops (cont.) and Afternoon Tutorial Various
3:00 - 3:30 Break Forestry Atrium
3:30 - 5:00 Full Day Workshops and Afternoon Tutorial (cont.) Various
6:00 - 7:00 Sonification Concert Rosza Center

Thusday, June 14th

Time Session Venue
9:00 - 10:30 Maps, Location and Navigation Forestry G002
10:30 - 11:00 Break Forestry Atrium
11:00 - 12:30 AD Theory Forestry G002
12:30 - 1:30 Lunch Forestry Atrium
1:30 - 3:00 Presidents' Panel Forestry G002
3:00 - 4:00 Break/Posters Forestry Atrium
4:00 - 5:00 Rehabilitation Forestry G002
6:00 - 9:00 Banquet Franklin Square Inn

Friday, June 15th

Time Session Venue
9:00 - 10:30 Sonifying Science and Technology Forestry G002
10:30 - 11:00 Break Forestry Atrium
11:00 - 11:30 Open Mic Forestry G002
11:30 - 12:00 Announcements Forestry G002

Sunday, June 10th

Time Venue Session
9:00 - 6:00 Forestry 144 Student ThinkTank

Monday, June 11th

Time Venue Session Chair
9:00 - 9:30 Forestry G002 Welcoming Remarks/Introduction
9:30 - 10:30 Forestry G002 Health Data Matti Gröhn
CardioSounds: A Portable System to Sonify ECG Rhythm Disturbances in Real-Time *Best Student Paper Nominated* (PDF)
Andrea Aldana, Steffen Grautoff and Thomas Hermann
Realtime EMG Sonification System for Gait (PDF)
Ryosuke Nakagawa, Hideki Kadone, Masaki Matsubara, Kenji Suzuki and Hiroko Terasawa
Data-Driven Sonification of CFD Aneurysm Models *Best Student Paper Nominated* (PDF)
Daniel MacDonald, Thangam Natarajan, Richard Windeyer, Peter Coppin and David Steinman
10:30 - 11:00 Forestry Atrium Break
11:00 - 12:00 Forestry G002 Keynote
20 Years of Sonic Interactions
Dr. Stefania Serafin
12:00 - 1:30 Forestry Atrium Lunch
1:30 - 3:00 Forestry G002 Designing Sonification Mark Ballora
Sonification with Musical Characteristics: A Path Guided by User-Engagement (PDF)
Jonathan Middleton, Jaakko Hakulinen, Katariina Tiitinen, Juho Hella, Tuuli Keskinen, Pertti Huuskonen, Juhani Linna, Markku Turunen, Roope Raisamo and Mounia Ziat
A Study of Exploratory Analysis in Melodic Sonification with Structural and Durational Time Scales (PDF)
Takahiko Tsuchiya and Jason Freeman
Wave Space Sonification *Best Paper Nominated* (PDF)
Thomas Hermann
Kepler Concordia: Designing an Immersive Modular Musical and Scientific Instrument Using Novel Blockchain and Sonification Technologies in XR (PDF)
Kelly Snook, Tarik Barri, Joachim Goßmann, Jason Potts, Margaret Schedel and Hartmut Warm
M.U.S.I.C. (Musical Utility Software for Interactive Creations): The Multipurpose Motion-Sound Mapping Platform (PDF)
Joseph Ryan, Steven Landry, Jaclyn Barnes, Myounghoon Jeon and Chung Hyuk Park
3:00 - 3:30 Forestry Atrium Break
3:30 - 5:00 Forestry G002 Images, Graphs and Spaces Derek Brock
Representing Twitter Users’ Engagement by Sonification (PDF)
Robert Wheeler and David Worrall
Soundbased Image and Position Recognition System SIPReS (PDF)
Shin'Ichiro Uno, Yasuo Suzuki, Takashi Watanabe, Miku Matsumoto and Yan Wang
Photone: Exploring Modal Synergy in Photographic Images and Music (PDF)
Niklas Rönnberg and Jonas Löwgren
Acoustics of Virtually Coupled Performance Spaces (PDF)
Braxton Boren and Andrea Genovese
Audiograph: Auditory Graphs for Google Sheets with Faust (PDF)
Andres Aparicio and Rodrigo Cadiz
6:00 - 8:00 Forestry Atrium Welcome Reception

Tuesday, June 12th

Time Venue Session Chair
9:00 - 10:30 Forestry G002 Sonification and Ambient Displays Tim Ziemer
Humanising Data through Sound: Res Extensae and a User-Centric Approach to Data Sonification (PDF)
Sara Lenzi and Francesca Gleria
Plausible Auditory Augmentation of Physical Interaction *Best Paper Nominated* (PDF)
Marian Weger, Thomas Hermann and Robert Hoeldrich
Augmentation of an Institute's Kitchen: An Ambient Auditory Display of Electric Power Consumption (PDF)
Katharina Groß-Vogt, Marian Weger, Robert Höldrich, Thomas Hermann, Till Bovermann and Stefan Reichmann
Auditory Displays of Electric Power Grids (PDF)
Patrick Cowden and Luke Dosiek
Fluor Sonescense: A Sonification of the Visualization of Brass Instrument Tones (PDF)
Christopher Jette and James Buchholz
10:30 - 11:00 Forestry Atrium Break
11:00 - 12:00 Forestry G002 Keynote
Auditory Displays to Facilitate Attention Management in Highly Autonomous Systems
Dr. Carryl Baldwin
12:00 - 1:30 Forestry Atrium Lunch
1:30 - 3:00 Forestry G002 Hyundai Motors Special Session Michael Winters
Recognizability and Perceived Urgency of Bicycle Bells *Best Paper Nominated* (PDF)
Lisa Frohmann, Marian Weger and Robert Höldrich
A Psychoacoustic Auditory Display for Navigation *Best Paper Nominated* (PDF)
Tim Ziemer and Holger Schultheis
Soundtrad, A Method and Tool for Prototyping Auditory Displays: Can We Apply It to an Autonomous Driving Scenario? (PDF)
Doon Macdonald and Tony Stockman
Sonification Research and Trends at Volvo Cars
Justyna Maculewicz and Fredrik Hagman
In-Vehicle Situation Awareness Using Sounds
Steven Landry and Myounghoon Jeon
3:00 - 3:10 Forestry Atrium Group Photo
3:10 - 3:30 Forestry Atrium Break
3:30 - 5:00 Forestry 144 Diversity and Inclusion Workshop
5:00 - 6:00 Forestry 144 Board Meeting (Open to Audience)
6:00 - 7:00 Forestry 144 Board Meeting (Closed to Audience)
7:00 - 9:00 Franklin Square Inn Jam Session

Wednesday, June 13th

Time Venue Session
9:00 - 10:30 Full Day Workshops
Forestry 108 Sonic Interaction in Intelligent Cars
Justyna Maculewicz, Fredrik Hagman and Myounghoon Jeon
Forestry 144 Collaborative Design and Evaluation in Auditory Displays for Interactive Physics Simulations
Mike Winters and Prakriti Kaini with Bruce Walker
Morning Tutorial
Forestry 146 Introduction to Pure Data: Beginner and Intermediate Techniques for Data Sonification
Steven Landry
10:30 - 11:00 Forestry Atrium Break
11:00 - 12:00 Full Day Workshops and Morning Tutorial (cont.)
12:00 - 1:30 Forestry Atrium Lunch
1:30 - 3:00 Full Day Workshops (cont.)
Afternoon Tutorial
Forestry 146 Introduction to Data Sonification with Python and Csound
David Worrall
3:00 - 3:30 Forestry Atrium Break
3:30 - 5:00 Full Day Workshops and Afternoon Tutorial (cont.)
6:00 - 7:00 Rosza Center Sonification Concert

Thursday, June 14th

Time Venue Session Chair
9:00 - 10:30 Forestry G002 Maps, Location and Navigation Thomas Hermann
Reimagining Human Capacity for Location-Aware Audio Pattern Recognition: A Case for Immersive Exocentric Sonification (PDF)
Ivica Bukvic and Gregory Earle
Seeking a Reference Frame for Cartographic Sonification (PDF)
Megen Brittell
Using a Multimodal Immersive Environment to Investigate Perceptions in Augmented Virtual Reality Systems (PDF)
Samuel Chabot, Wendy Lee, Rebecca Elder and Jonas Braasch
Sonification of 3D Point Clouds for Substitution of Vision by Audition for the Visually Impaired (PDF)
Louis Commère, Florian Grond, Jean Rouat and François Côté
The Audio Game Laboratory: Building Maps from Games (PDF)
Brandon Biggs, Lena Yusim and Peter Coppin
10:30 - 11:00 Forestry Atrium Break
11:00 - 12:30 Forestry G002 AD Theory Bruce Walker
Sonification: A Prehistory (PDF)
David Worrall
Investigating Effective Methods of Designing Sonifications (PDF)
Michael Quinton, Iain McGregor and David Benyon
Towards Ecological, Embodied and User-Centric Design in Auditory Display (PDF)
Stuart Duncan Haffenden Cornejo
Examining the Learnability of Auditory Displays: Music, Earcons, Spearcons, and Lyricons *Best Student Paper Nominated* (PDF)
Kay Tislar, Zackery Duford, Brittany Nelson, Madeline Peabody and Myounghoon Jeon
12:30 - 1:30 Forestry Atrium Lunch
1:30 - 3:30 Forestry G002 Presidents' Panel
3:00 - 3:30 Forestry Atrium Break/Posters
4:00 - 5:00 Forestry G002 Rehabilitation Hiroko Terasawa
Simpaty-Hand App, A Musical Instrument Designed for People with Limited Motor Skills (PDF)
Carolina Valli
A Preliminary Evaluation of a Smart Exercise Application with Wearable Sensors (PDF)
Eric Vasey, Xingliang Li, Tejin Yoon and Myounghoon Jeon
"Musical Exercise” for People with Visual Impairments: A Preliminary Study with the Blindfolded (PDF)
Ridwan Ahmed Khan, Myounghoon Jeon and Tejin Yoon
6:00 - 9:00 Franklin Square Inn Banquet

Friday, June 15th

Time Venue Session Chair
9:00 - 10:30 Forestry G002 Sonifying Science and Technology Katie Wolf
Sonification and Science Pedagogy: Preliminary Experiences and Assessments of Earth Science Data Presented in an Undergraduate General Education Course (PDF)
Mark Ballora, Christopher Roman, Robert Pockalny and Karen Wishner
Planethesizer: Approaching Exoplanet Sonification (PDF)
Adrián García Riber
ToxSampler: Locative Sound Art Exploration of the Toxic Release Inventory (PDF)
Michael Blandino
Sonifying Stochastic Walks on Biomolecular Energy Landscapes *Best Student Paper Nominated* (PDF)
Robert Arbon, Alex Jones, Lars Bratholm, Tom Mitchell and David Glowacki
Emotive Voice Acceptance in Human-Robot Interaction (PDF)
Jaclyn Barnes, Erin Richie, Qiyue Lin, Myounghoon Jeon and Chung Hyuk Park
10:30 - 11:00 Forestry Atrium Break
11:00 - 11:30 Forestry G002 Open Mic
11:30 - 12:00 Forestry G002 Announcements

Sonification Concert

Wednesday, June 13th 6pm
Rozsa Center for Performing Arts

Fluor Sonescence (PDF)

Christopher Jette and Mark Broschinsky
Fluor Sonescence is a work for trombone, electronics and video, where sounds are translated to video and the videos are translated to sounds. The video documentation includes the video and sound components of the work. Please see https://vimeo.com/255790972/ to hear and view Fluor Sonescence.

Temple of No Religion (PDF)

Alessio Rossato
Piece created with material recorded at Villa Smilea of Montale Pistoiese (Tuscany-Italy), where Andrea Dami's metal and sheet metal sculptures were sampled in various recording sessions including short improvisations. The sculptures were played in different ways, from the naked hands to wooden sticks, metal, rubber, with different thickness chains etc... and different types of microphones were used with "active" recording mode, searching different sound and position in the sculptures. The piece consists of five sections, the composition process is based on the concept of musical sculpture: from section I, four repetitions/variations have been made in which each one is based on precise focused music. The title is inspired by a building Iglesia sin Religion by Colombian architect Simón Vélez, a cathedral-temple built only with bamboo canes, simple material and with Attention to eco- sustainability and that contradicts, at least in this work, the monumentality and functionality of the building itself...

Planethesizer (PDF)

Adrián García Riber
The exponential increase in virtual instruments development and their popularity and establishment as part of the current workflow on audio productions, both in home studios and professional environments, creates a new opportunity in bringing science to the general public and designing audio tools based on physical or mathematical models of undoubted creative and artistic utility. In this context, the publication of the discovery of seven Earth-like planets orbiting around the Trappist-1 star on February 2017, inspired the creation of a model-based virtual instrument. As a result, the Virtual Interactive Synthesizer prototype Planethesizer is presented, whose default configurations display a multimodal Trappist-1, Kepler-444 and a K2-72 planetary systems simulation. With the development of this astronomical data interactive sonification VST plugin, this work also tries to suggest a possible line of interdisciplinary audio tools development.

Atlas Of Uncertainty (PDF)

Massimo Vito Avantaggiato
This paper regards the interaction of electroacoustic music with visual elements, outside real time hypotheses. In particular, this writing tries to suggest how analysis techniques for acousmatic music can help - without the presumption of being general or strictly objective – the creative process for achieving any audiovisual work. In the following article we face the following issues:

  • Audiovisual works, repetition and multilevel composition;
  • The metaphorical relationships between video and audio;
  • Semiotic Units, discretization and sense of form;
  • On time management/ temporality;
  • The spatial revaluation of sonic and graphic details;
  • The importance of coordination with analysis techniques for acousmatic music.
We identified some guidelines followed in the achievement of our recent work “Atlas of Uncertainty”, to exploit the potential of sound at different levels of structuration.

Flow

Christopher Plummer
This piece is part of a series based on the yearly flow of Michigan Rivers. This project started by the research scientist converting the flow data into a series of sine waves. This then left the artistic task of contextualizing and harmonizing this collection of beeps into something engaging, something that effected an audience. Three methods have been used to connect with an audience. The first was to smooth out the sine waves and increase the complexity of their timbre. Second was the creation of a background of harmonic support, for this water sounds were added and processed to hold the melody and create a full sound stage that added depth and richness to the composition. Finally, for ICAD a trombone part was added that maps the counters of the melody and helps highlight the flow trends.

Snowfall (PDF)

Daniel Grayvold
Snowfall is a meditative hybrid musical composition/audio installation that explores the interpretation of winter weather as a depressive event through the sonification of snowfall data recorded in the Keweenaw county of Michigan.

Installations

Photone (PDF)

Forestry near the Atrium
Niklas Rönnberg and Jonas Löwgren
We present Photone, an installation comprising an interactive combination of photographic images and music. An image is displayed and a dynamic musical score is generated based on the overall color properties of the image and the color value of the pixel under the cursor. Hence, the music changes as the user moves the cursor, creating a modal synergy where visual and auditory output combine holistically with the chosen interaction technique.

Ceratonova Shasta (PDF)

Forestry 100A
Jason Fick
Ceratonova Shasta is a two-channel fixed media composition featuring the sonification of microbiome data. All sound gestures made in the piece sonify measurements of a parasite spore sampled from 2008-2016. This parasite (ceratonova shasta) resulted in particularly high mortality rates at an index site located in the mainstem of Klamath River, where it intersects with Beaver Creek in Northern California. The sound content and formal procedures are influenced by this single data set on both a macro and micro level. Peaceful and distressed sound characters represent the life and death of the fish within this delicate microbiome. The composition can be found at: http://jasonfick.com/Jason_Fick/Ceratonova_Shasta.html.

Waveforms (PDF)

Forestry G004
Michele Zaccagnini
WAVEFORMS is the latest installment of my ongoing compositional research which aims at creating pieces that truly exist at the boundary of aural and visual senses. To achieve this perceptual blurring of senses I implement algorithmic compositions that can be rendered as sound and images synchronously. Generally speaking, when multi-media composers are faced with the issue of connecting aural and visual elements they can work on a continuum of a spectrum that spans between "high level" and a “low level" perceptual connection between aural and visual elements. The former is an abstract connection: a scene from a film is accompanied by a soundtrack that musically suggests what kind of emotion the viewer "should" feel. At this side of the spectrum, the multi-media creator can work in procedurally loose fashion as she is allowed to freely associate sounds and images based on a general aesthetic idea. On the other hand, when working at the "low level" end of the spectrum the multi-media creator aims at creating a tight knit perceptual relation between sounds and visuals so that virtually all data represented in the aural realm find a correspondent in the visual realm (and vice versa). This installation draws from a series of tools and practices I have developed and differers from other kinds of audio-visual works in fundamental ways. As I was zeroing in the issue of "low level" connection between music and image I realized how the common approach to audio-visualization, commonly defined as "audio-reactive," was proving excessively cumbersome and computationally expensive: the use of audio-reactive algorithms can majorly limit the possibilities of representing musical events in a discrete manner especially in the case of polyphonic music. Since my approach to composition is algorithmic at its core, I am able to bypass the audio-reactive step by feeding matrices of raw musical data that I gathered from my algorithms into rendering.

Offbeat News (PDF)

Forestry Atrium
Matteo Castiglioni
"Offbeat News" is a sound installation made of a radio that always sounds the same channel. This channel consists of a continuous rap flow made of news taken in real time from the network, these are analyzed and through some algorithms new ones are created, generating a situation in the balance between the real and the false.