|
samer@0
|
1 \documentclass[a4paper]{article}
|
|
samer@0
|
2 \usepackage{tools}
|
|
samer@0
|
3
|
|
samer@0
|
4 \author{Samer Abdallah and Henrik Ekeus}
|
|
samer@0
|
5 \title{Digital Shoreditch\\Information Dynamics Installation}
|
|
samer@0
|
6
|
|
samer@0
|
7
|
|
samer@0
|
8 \begin{document}
|
|
samer@0
|
9 \maketitle
|
|
samer@0
|
10
|
|
samer@0
|
11 \section{How it went}
|
|
samer@0
|
12
|
|
samer@0
|
13 \subsection{Reactions of visitors}
|
|
samer@0
|
14 Initially some confusion, but after we learned to present it properly,
|
|
samer@0
|
15 then generally positive reactions. We would ask everyone to step out
|
|
samer@0
|
16 of active space before explaining the ideas behind it and how to use
|
|
samer@0
|
17 the system.
|
|
samer@0
|
18
|
|
samer@0
|
19 Default unguided response - walking about, waving
|
|
samer@0
|
20 arms, dancing---\emph{fast} movements, \emph{rhythmic}
|
|
samer@0
|
21 movements. We had to explain that interaction occurs
|
|
samer@0
|
22 not on the time scale of the sounds, but on a slower time
|
|
samer@0
|
23 scale.
|
|
samer@0
|
24
|
|
samer@0
|
25 Types of behaviour - solo, collaborative.
|
|
samer@0
|
26
|
|
samer@0
|
27 Timing controls a bit complex and also too easy to mess up timing.
|
|
samer@0
|
28 Gesture framework is ok though.
|
|
samer@0
|
29
|
|
samer@0
|
30
|
|
samer@0
|
31 \subsection{Performance and reliability of technology}
|
|
samer@0
|
32
|
|
samer@0
|
33 Need to walk out and in to `rebirth' voices after restart is annoying
|
|
samer@0
|
34 Need a way to limit the number of voices and valid ids effectively
|
|
samer@0
|
35 Prolog part is getting flooded with tracking messages
|
|
samer@0
|
36 Matlab part is performing ok when limited to only a few
|
|
samer@0
|
37 transmats per second, but:
|
|
samer@0
|
38 - no time for scatter plot update!
|
|
samer@0
|
39 - timeing out problem is bad
|
|
samer@0
|
40 Loudness-height link needs calibrating to height of person
|
|
samer@0
|
41 Proper 3D calibration needed to allow for tilt.
|
|
samer@0
|
42 Use height of bounding box more effectively?
|
|
samer@0
|
43
|
|
samer@0
|
44 \section{Future directions}
|
|
samer@0
|
45
|
|
samer@0
|
46 \subsection{Writing up}
|
|
samer@0
|
47 Submit a paper to, \eg, NIME.
|
|
samer@0
|
48 Emphasise high level of control---we excercise control over
|
|
samer@0
|
49 \emph{statistical structure}.
|
|
samer@0
|
50
|
|
samer@0
|
51 \subsection{Improving the user interface}
|
|
samer@0
|
52 Make it easier for users to recognise which voice they are generating.
|
|
samer@0
|
53 Remove height bias (detect ground plane).
|
|
samer@0
|
54 Occlusions are a problem: mount the kinect higher?
|
|
samer@0
|
55
|
|
samer@0
|
56 \subsection{As a compositional tool}
|
|
samer@0
|
57 A more `task oriented' approach? Eg, creation of a texture,
|
|
samer@0
|
58 creation of a melodic line, \etc.
|
|
samer@0
|
59 3D body gestural control not really needed. Could make
|
|
samer@0
|
60 controller with two manual controls, hand trackers.
|
|
samer@0
|
61
|
|
samer@0
|
62 \subsection{Other parameters to control}
|
|
samer@0
|
63 Short-term variables like note duration, IOI etc.
|
|
samer@0
|
64 Longer-term dynamics, like a chord progressions.
|
|
samer@0
|
65 Variables which \emph{modulate} the output of other voices,
|
|
samer@0
|
66 eg tonality/harmony processes. Requires better pitch representation
|
|
samer@0
|
67 for voices so that harmonic changes can be effected without
|
|
samer@0
|
68 modifying the outputs of the voice processes.
|
|
samer@0
|
69
|
|
samer@0
|
70 \eg voices produce scale degrees.
|
|
samer@0
|
71 synth units share a global scale.
|
|
samer@0
|
72 tonality process modifies global scale.
|
|
samer@0
|
73 Should we implement modulation via wholesale transposition
|
|
samer@0
|
74 or via minimal modification of pitches?
|
|
samer@0
|
75
|
|
samer@0
|
76
|
|
samer@0
|
77 \subsection{Studying the behaviour of users}
|
|
samer@0
|
78 Experiment to observe how people move in the information space
|
|
samer@0
|
79 under various conditions: (a) as a solo voice; (b) collaboration
|
|
samer@0
|
80 with fixed virtual voice; (c) collaboration with another human.
|
|
samer@0
|
81
|
|
samer@0
|
82 \subsection{Performances}
|
|
samer@0
|
83 Ask John Eacott about possible venues and state of live score code.
|
|
samer@0
|
84 Performance with dancer? Ask Tim or Di.
|
|
samer@0
|
85 Performance with live scores and musicians, \eg string quartet.
|
|
samer@0
|
86
|
|
samer@0
|
87 \subsection{Sequencer plug-in}
|
|
samer@0
|
88 Ask Chris Cannam about this.
|
|
samer@0
|
89
|
|
samer@0
|
90
|
|
samer@0
|
91 Core algorithms as engine, service or component
|
|
samer@0
|
92 Send Marcus's thesis and stuff about experimental aesthetics to Henrik.
|
|
samer@0
|
93 \end{document}
|
