I have been doing video analysis on QuickTime (.mov) files for several years, but have never really had the need to use the time information of the movie files. For a project, I now had the need for getting the timecode in seconds out of the files, and this turned out to be a little more tricky than first expected. Hence this little summary for other people that may be in the same situation....
From 2007 to 2011 I had a part-time research position at the Norwegian Academy of Music in a project called New Instruments for Musical Exploration, and with the acronym NIME. This project was also the reason why I ended up organising the NIME conference in Oslo in 2011. The NIME project focused on creating an environment for musical innovation at the Norwegian Academy of Music, through exploring the design of new physical and electronic instruments....
My paper titled An action–sound approach to teaching interactive music has recently been published by Organised Sound. The paper is based on some of the theoretical ideas on action-sound couplings developed in my PhD, combined with how I designed the course Interactive Music based on such an approach to music technology. **Abstract **The conceptual starting point for an `action-sound approach’ to teaching music technology is the acknowledgment of the couplings that exist in acoustic instruments between sounding objects, sound-producing actions and the resultant sounds themselves....
I often export data from Matlab into TSV files for students and collaborators to use in other programs. It is not entirely straightforward to open these files in MS Excel, so here is a series of screenshots of how to do it. There are two tricks to make it work: [Remember to use “tab” as the delimiter between columns]{style=“line-height: 13px;”} On Norwegian and other systems that use “comma” as decimal separator, it is necessary to specify that the TSV file contains values with “dot” as the decimal separator....
Yesterday, I posted a blog entry on my TimeLapser application, and how it was used to document the working process of the making of the sculpture Hommage til kaffeselskapene by my mother. The final timelapse video looks like this: Now I have run this timelapse video through my VideoAnalysis application, to see what types of analysis material can come out of such a video. The average image displays a “summary” of the entire video recording, somehow similar to an “open shutter” in traditional photography....
I have recently started moving my development efforts over to GitHub, to keep everything in one place. Now I have also uploaded a small application I developed for a project by my mother, Norwegian sculptor Grete Refsum. She wanted to create a timelapse video of her making a new sculpture, “Hommage til kaffeselskapene”, for her installation piece Tante Vivi, fange nr. 24 127 Ravensbrück. There are lots of timelapse software available, but none of them that fitted my needs....
New publication: **Title ** Analyzing correspondence between sound objects and body motion Authors Kristian Nymoen, Rolf Inge Godøy, Alexander Refsum Jensenius and Jim Tørresen has now been published in ACM Transactions on Applied Perception. Abstract Links between music and body motion can be studied through experiments called sound-tracing. One of the main challenges in such research is to develop robust analysis techniques that are able to deal with the multidimensional data that musical sound and body motion present....
Back from a great NIME 2013 conference in Daejeon + Seoul! For Norwegian readers out there, I have written a blog post about the conference on my head of department blog. I would have loved to write some more about the conference in English, but I think these images from my Flickr account will have to do for now: {style=“padding: 0; overflow: hidden; margin: 0; width: 500px;”} At the last of the conference it was also announced that next year’s conference will be held in London and hosted by the Embodied AudioVisual Interaction Group at Goldsmiths....
Yesterday, Ståle presented a paper on mocap filtering at the NIME conference in Daejeon. Today I presented a demo on using Kinect images as input to my sonomotiongram technique. Title Kinectofon: Performing with shapes in planes Links Paper (PDF) Poster (PDF) Software Videos (coming soon) Abstract The paper presents the Kinectofon, an instrument for creating sounds through free-hand interaction in a 3D space. The instrument is based on the RGB and depth image streams retrieved from a Microsoft Kinect sensor device....
We have three papers from our fourMs group at this year’s NIME conference in Daejeon. The first one was presented today by Ståle Skogstad, and is based on his work on trying minimize the delay when filtering motion capture data. Title Filtering motion capture data for real-time applications Links: Paper (PDF) Project page Max/MSP implementation Abstract: In this paper we present some custom designed filters for real-time motion capture applications....