Research

Here is the poster I presented at NIME 2006 in Paris based on the paper Towards a Gesture Description Interchange Format. The paper was written together with Tellef Kvifte, and the abstract reads: This paper presents our need for a Gesture Description Interchange Format (GDIF) for storing, retrieving and sharing information about music-related gestures. Ideally, it should be possible to store all sorts of data from various commercial and custom made controllers, motion capture and computer vision systems, as well as results from different types of gesture analysis, in a coherent and consistent way....

Peter Robinson (University of Cambridge) are working on emotionally intelligent interfaces, and have made a setup for a summer show at a science museum in London where they can track 20 different types of emotional responses using computer vision: Can you read minds? The answer is most likely ‘yes’. You may not consider it mind reading but our ability to understand what people are thinking and feeling from their facial expressions and gestures is just that....

My paper entitled “Using motiongrams in the study of musical gestures” was accepted to ICMC 06 in New Orleans. The abstract is: Navigating through hours of video material is often time-consuming, and it is similarly difficult to create good visualization of musical gestures in such a material. Traditional displays of time-sampled video frames are not particularly useful when studying single-shot studio recordings, since they present a series of still images and very little movement related information....

We have started a collaboration between between UiO and AHO, and some of the music technology students followed courses with the interaction designers at AHO this spring semester. This was a great success, and I was impressed with what came out of it. Henrik Marstrander has worked on a table interface where he can control various musical parameters, and Jon Olav Eikenes and Marie Wennesland has made a multi-touch multi-touch interface modelled after Jeff Han....

Apple and Nike has teamed up and released the Nike+iPod package, which allows for using an iPod Nano as a pedometer and share the training information online. It is based on a wireless accelerometer (1.37 x 0.95 x 0.30 inches, 0.23 ounce, using a proprietary protocol at 2.4GHz) and a receiver that connects to the iPod (Size: 1.03 x 0.62 x 0.22 inches, 0.12 ounce). Suggested price is US$29, which is very cheap thinking about the included accelerometer....

{.imagelink}Sonic Visualiser from Queen Mary’s is yet another software tool for visualizing audio content. However, there are some features that stand out: Cross-platform: available for OS X, Linux, Windows GPL’ed Native support for aiff, wav, mp3 and ogg (but what about AAC?) Annotations: Support for adding labelled time points and defining segments, point values and curves. The annotations can be overlayed on top of waveforms and spectrograms Time-stretch Vamp Plugins is at the core of the Sonic Visualiser, and it seems like they want this to become a standard for non-realtime audio plugins....

Katherine Wilson writes about how she underestimated blogging when she got started: At the start I underestimated what it could be used for. It’s a database, a diary, a place to jot down notes that don’t fit anywhere else, a place to stake out your research territory, a self-promotion tool, an information bank, an ideas exchange, a support community, a progress-log, a device for self-discipline, confidence-tracker, a complaints department, a file storage system....

Marc Hedlund at O’Reilly summarizes the good things about PDF books: - They are searchable. They are portable. They can often be bought and downloaded immediately. I am still trying to decide what I think about this. In general I prefer to have all articles and reference literature available as PDFs in my digital library, currently organizing them using DevonThink Pro. As computer screens are finally getting bigger, brighter and with higher resolution (even the new MacBook is sporting 1200x800 pixels on the 13 inch screen), it is becoming increasingly more pleasant reading on screen....

{.imagelink}The installation Spatial Sounds (100dB at 100km/h) by Marnix de Nijs and Edwin van der Heide. Spatial Sounds 100 dB at 100 km/h was set up at Usine-C during the Elektrafestival. A speaker is mounted on a metallic arm, rotating around at different speeds dependent on the people in the room. Ultrasonic sensors detect the distance to people in the space and changes the sound being played as well as speed of rotation (more technical info here)....

Found an interesting thread on the Max list entitled Working with Max is not easy. But what is easy. Before we learn something we find it difficult. When we know it we find it easy. I guess a problem with Max, if it can be called a problem, is that its low entry-level (at least compared to many other programming languages) is that the user might be misleaded into thinking that this is something that can be mastered in two weeks....