MPEG-A » History » Version 135

« Previous - Version 135/420 (diff) - Next » - Current version
Panos Kudumakis, 2015-07-15 01:20 PM


Invited talk on IM AF by Panos Kudumakis, Malaga, Spain 11 April 2013

MPEG-A: Interactive Music Application Format

Sonic Visualiser with IM AF support featuring automatic chords extraction aligned in time with lyrics:
Source code
Executable for windows & mac os/x
La fuga an IM AF (.ima) song

Spanish pop band 'Diɘcinueve', featured in TV and press, is the first band to use Sonic Visualiser with IM AF support that lets music fans remix and share the group's latest single 'La fuga' in endless new forms. Thanks to Emilio Molina Martínez.

HTML5 IM AF Player ver. 4 by Mariano Mora-Mcginity.
Featuring music remix
"HTML5 IM AF Player ver. 3" by Colin Gunder Dodds.
Featuring chords extraction
HTML5 IM AF Player ver. 2 by Luke Barlow.
Featuring robustness & zoom in/out.
HTML5 IM AF Player ver. 1 by Giacomo Herrero.
Featuring lyrics & album picture.

We would like to further enhance IM AF with new technologies. Topics for student projects available (at all levels UG/MSc/PhD) to be taken are given below. Programming languages background is a prerequisite as well as willingness to learn new ones, e.g., HTML5. Furthermore, students are expected to develop knowledge and skills on working with latest standards (MPEG, EBU, DMP) as well as acquire commercial and market perspective of music technologies for internet, broadcasting and mobile applications.
  • Lyrics extraction and/or highlighting for karaoke apps
  • Rights tracking for fair artists remuneration
  • Dynamic adaptive audio streaming
  • 3D audio mixing
  • Second screen music recommendation
  • Vocaloid animation

If you would like to involve in this project please contact p.kudumakis at qmul.ac.uk

Projects

  • Mariano Mora-Mcginity (C4DM PhD Candidate)
    Music remix: derivative works rights tracking
    HTML5 IM AF Player ver. 4
    Music remix & sharing using MVCO Ext
  • Thomas Wilmering (C4DM Post-doc)
    Music remix: derivative works rights tracking
    WD ISO/IEC 21000-19/AMD1 on time-segments & multi-track audio, Jun. 2015

Related publications

  • Jesús C. García, Panos Kudumakis, Isabel Barbancho, Lorenzo J. Tardón and Mark Sandler, 'Enabling interactive and interoperable semantic music applications', Springer Handbook for Systematic Musicology, Apr. 2014. In press.
  • Panos Kudumakis, Inseon Jang and Mark Sandler, 'A New Interactive MPEG Format for the Music Industry', 7th International Symposium on Computer Music Modeling and Retrieval (CMMR'10), Málaga, Spain, 21-24 June, 2010.

Inspirations