samer@0: \documentclass[a4paper]{article} samer@0: \usepackage{tools} samer@0: samer@0: \author{Samer Abdallah and Henrik Ekeus} samer@0: \title{Digital Shoreditch\\Information Dynamics Installation} samer@0: samer@0: samer@0: \begin{document} samer@0: \maketitle samer@0: samer@0: \section{How it went} samer@0: samer@0: \subsection{Reactions of visitors} samer@0: Initially some confusion, but after we learned to present it properly, samer@0: then generally positive reactions. We would ask everyone to step out samer@0: of active space before explaining the ideas behind it and how to use samer@0: the system. samer@0: samer@0: Default unguided response - walking about, waving samer@0: arms, dancing---\emph{fast} movements, \emph{rhythmic} samer@0: movements. We had to explain that interaction occurs samer@0: not on the time scale of the sounds, but on a slower time samer@0: scale. samer@0: samer@0: Types of behaviour - solo, collaborative. samer@0: samer@0: Timing controls a bit complex and also too easy to mess up timing. samer@0: Gesture framework is ok though. samer@0: samer@0: samer@0: \subsection{Performance and reliability of technology} samer@0: samer@0: Need to walk out and in to `rebirth' voices after restart is annoying samer@0: Need a way to limit the number of voices and valid ids effectively samer@0: Prolog part is getting flooded with tracking messages samer@0: Matlab part is performing ok when limited to only a few samer@0: transmats per second, but: samer@0: - no time for scatter plot update! samer@0: - timeing out problem is bad samer@0: Loudness-height link needs calibrating to height of person samer@0: Proper 3D calibration needed to allow for tilt. samer@0: Use height of bounding box more effectively? samer@0: samer@0: \section{Future directions} samer@0: samer@0: \subsection{Writing up} samer@0: Submit a paper to, \eg, NIME. samer@0: Emphasise high level of control---we excercise control over samer@0: \emph{statistical structure}. samer@0: samer@0: \subsection{Improving the user interface} samer@0: Make it easier for users to recognise which voice they are generating. samer@0: Remove height bias (detect ground plane). samer@0: Occlusions are a problem: mount the kinect higher? samer@0: samer@0: \subsection{As a compositional tool} samer@0: A more `task oriented' approach? Eg, creation of a texture, samer@0: creation of a melodic line, \etc. samer@0: 3D body gestural control not really needed. Could make samer@0: controller with two manual controls, hand trackers. samer@0: samer@0: \subsection{Other parameters to control} samer@0: Short-term variables like note duration, IOI etc. samer@0: Longer-term dynamics, like a chord progressions. samer@0: Variables which \emph{modulate} the output of other voices, samer@0: eg tonality/harmony processes. Requires better pitch representation samer@0: for voices so that harmonic changes can be effected without samer@0: modifying the outputs of the voice processes. samer@0: samer@0: \eg voices produce scale degrees. samer@0: synth units share a global scale. samer@0: tonality process modifies global scale. samer@0: Should we implement modulation via wholesale transposition samer@0: or via minimal modification of pitches? samer@0: samer@0: samer@0: \subsection{Studying the behaviour of users} samer@0: Experiment to observe how people move in the information space samer@0: under various conditions: (a) as a solo voice; (b) collaboration samer@0: with fixed virtual voice; (c) collaboration with another human. samer@0: samer@0: \subsection{Performances} samer@0: Ask John Eacott about possible venues and state of live score code. samer@0: Performance with dancer? Ask Tim or Di. samer@0: Performance with live scores and musicians, \eg string quartet. samer@0: samer@0: \subsection{Sequencer plug-in} samer@0: Ask Chris Cannam about this. samer@0: samer@0: samer@0: Core algorithms as engine, service or component samer@0: Send Marcus's thesis and stuff about experimental aesthetics to Henrik. samer@0: \end{document}