Mercurial > hg > cip2012
comparison draft.tex @ 13:317db6d6f433
copied H text into draft.tex
author | Henrik Ekeus <hekeus@eecs.qmul.ac.uk> |
---|---|
date | Tue, 06 Mar 2012 12:22:55 +0000 |
parents | a76c1edacdde |
children | d5f63ea0f266 |
comparison
equal
deleted
inserted
replaced
12:543966ed6c21 | 13:317db6d6f433 |
---|---|
230 \subsection{Beat Tracking} | 230 \subsection{Beat Tracking} |
231 Bayesian belief can be used to predict when things happen (as oppose to just what happens). Information Dynamics of? | 231 Bayesian belief can be used to predict when things happen (as oppose to just what happens). Information Dynamics of? |
232 | 232 |
233 | 233 |
234 | 234 |
235 \subsection{Information Dynamics as Design Tool } | 235 \section{Information Dynamics as Design Tool} |
236 \subsubsection{The Melody Triangle} | 236 |
237 \emph{What the Melody Triangle is\dots} | 237 In addition to applying Information Dynamics to analysis, it is also possible use this approach in design, such as the composition of musical materials. |
238 | 238 By providing a framework for linking information theoretic measures to the control of generative processes, it becomes possible to steer the output of these processes to match a criteria defined by these measures. |
239 | 239 For instance outputs of a stochastic musical process could be filtered to match constraints defined by a set of information theoretic measures. |
240 \emph{The Melody Triangle as Composition Assistant\dots} | 240 |
241 | 241 The use of stochastic processes for the generation of musical material has been widespread for decades -- Iannis Xenakis applied probabilistic mathematical models to the creation of musical materials, including to the formulation of a theory of Markovian Stochastic Music. |
242 \emph{comparable tools} The use of stochastic processes for the generation of musical material has been widespread for decades. Just as Information Theory was coming of age Iannis Xenakis applied probabilistic mathematical models to the creation of musical materials. This included the formulation of a theory of Markovian Stochastic Music. With the Melody Triangle similar processes generate the content, however we are able to explore and interface with these processes at the high and abstract level of expectation, randomness and predictability. | 242 However we can use information dynamics measures to explore and interface with such processes at the high and abstract level of expectation, randomness and predictability. |
243 | 243 The Melody Triangle is such a system. |
244 \emph{Using the Melody Triangle for the generation of non-sonic content (maybe)} | 244 |
245 | 245 \subsection{The Melody Triangle} The Melody Triangle is an exploratory interface for the discovery of melodic content, where the input -- positions within a triangle -- directly map to information theoretic measures associated with the output. |
246 \subsection{Information Dynamics as Evaluative Feedback Mechanism} | 246 The measures are the entropy rate, redundancy and predictive information rate of the random process used to generate the sequence of notes. |
247 | 247 These are all related to the predictability of the the sequence and as such address the notions of expectation and surprise in the perception of music.\emph{self-plagiarised} |
248 | 248 |
249 \emph{comparable system} Gordon Pask's Musicolor (1953) applied a similar notion of boredom in its design. | 249 Before the Melody Triangle can used, it has to be ÔpopulatedÕ with possible parameter values for the melody generators. |
250 The Musicolour would react to audio input through a microphone by flashing coloured lights. Rather than a direct mapping of sound to light, Pask designed the device to be a partner to a performing musician. It would adapt its lighting pattern based on the rhythms and frequencies it would hear, quickly `learning' to flash in time with the music. However Pask endowed the device with the ability to `be bored'; if the rhythmic and frequency content of the input remained the same for too long it would listen for other rhythms and frequencies, only lighting when it heard these. As the Musicolour would `get bored', the musician would have to change and vary their playing, eliciting new and unexpected outputs in trying to keep the Musicolour interested. | 250 These are then plotted in a 3d statistical space of redundancy, entropy rate and predictive information rate. |
251 | 251 In our case we generated thousands of transition matrixes, representing first-order Markov chains, by a random sampling method. In figure x we see a representation of how these matrixes are distributed in the 3d statistical space; each one of these points corresponds to a transition matrix.\emph{self-plagiarised} |
252 In a similar vain, our \emph{Information Dynamics Critic}(name?) allows for an evaluative measure of an input stream, however containing a more sophisticated notion of boredom that \dots | 252 |
253 | 253 When we look at the distribution of transition matrixes plotted in this space, we see that it forms an arch shape that is fairly thin. |
254 \subsection{Musical Preference and Information Dynamics} | 254 It thus becomes a reasonable approximation to pretend that it is just a sheet in two dimensions; and so we stretch out this curved arc into a flat triangle. |
255 Any results from this study | 255 It is this triangular sheet that is our ÔMelody TriangleÕ and forms the interface by which the system is controlled. \emph{self-plagiarised} |
256 | |
257 When the Melody Triangle is used, regardless of whether it is as a screen based system, or as an interactive installation, it involves a mapping to this statistical space. | |
258 When the user, through the interface, selects a position within the triangle, the corresponding transition matrix is returned. | |
259 Figure x shows how the triangle maps to different measures of redundancy, entropy rate and predictive information rate.\emph{self-plagiarised} | |
260 | |
261 Each corner corresponds to three different extremes of predictability and unpredictability, which could be loosely characterised as ÔperiodicityÕ, ÔnoiseÕ and ÔrepetitionÕ. | |
262 Melodies from the ÔnoiseÕ corner have no discernible pattern; they have high entropy rate, low predictive information rate and low redundancy. | |
263 These melodies are essentially totally random. | |
264 A melody along the ÔperiodicityÕ to ÔrepetitionÕ edge are all deterministic loops that get shorter as we approach the ÔrepetitionÕ corner, until it becomes just one repeating note. | |
265 It is the areas in between the extremes that provide the more ÔinterestingÕ melodies. | |
266 That is, those that have some level of unpredictability, but are not completely ran- dom. Or, conversely, that are predictable, but not entirely so. | |
267 This triangular space allows for an intuitive explorationof expectation and surprise in temporal sequences based on a simple model of how one might guess the next event given the previous one.\emph{self-plagiarised} | |
268 | |
269 | |
270 | |
271 Any number of interfaces could be developed for the Melody Triangle. | |
272 We have developed two; a standard screen based interface where a user moves tokens with a mouse in and around a triangle on screen, and a multi-user interactive installation where a Kinect camera tracks individuals in a space and maps their positions in the space to the triangle. | |
273 Each visitor would generate a melody, and could collaborate with their co-visitors to generate musical textures -- a playful yet informative way to explore expectation and surprise in music. | |
274 | |
275 As a screen based interface the Melody Triangle can serve as composition tool. | |
276 A triangle is drawn on the screen, screen space thus mapped to the statistical space of the Melody Triangle. | |
277 A number of round tokens, each representing a melody can be dragged in and around the triangle. | |
278 When a token is dragged into the triangle, the system will start generating the sequence of notes with statistical properties that correspond to its position in the triangle.\emph{self-plagiarised} | |
279 | |
280 In this mode, the Melody Triangle can be used as a kind of composition assistant for the generation of interesting musical textures and melodies. | |
281 However unlike other computer aided composition tools or programming environments, here the composer engages with music on the high and abstract level of expectation, randomness and predictability.\emph{self-plagiarised} | |
282 | |
283 | |
284 Additionally the Melody Triangle serves as an effective tool for experimental investigations into musical preference and their relationship to the information dynamics models. | |
285 | |
286 %As the Melody Triangle essentially operates on a stream of symbols, it it is possible to apply the melody triangle to the design of non-sonic content. | |
287 | |
288 \section{Musical Preference and Information Dynamics} | |
289 We carried out a preliminary study that sought to identify any correlation between aesthetic preference and the information theoretical measures of the Melody Triangle. | |
290 In this study participants were asked to use the screen based interface but it was simplified so that all they could do was move tokens around. | |
291 To help discount visual biases, the axes of the triangle would be randomly rearranged for each participant.\emph{self-plagiarised} | |
292 | |
293 The study was divided in to two parts, the first investigated musical preference with respect to single melodies at different tempos. | |
294 In the second part of the study, a back- ground melody is playing and the participants are asked to find a second melody that Õworks wellÕ with the background melody. | |
295 For each participant this was done four times, each with a different background melody from four different areas of the Melody Triangle. | |
296 For all parts of the study the participants were asked to ÔmarkÕ, by pressing the space bar, whenever they liked what they were hearing.\emph{self-plagiarised} | |
297 | |
298 \emph{todo - results} | |
299 | |
300 \section{Information Dynamics as Evaluative Feedback Mechanism} | |
301 | |
302 \emph{todo - code the info dyn evaluator :) } | |
303 | |
304 It is possible to use information dynamics measures to develop a kind of `critic' that would evaluate a stream of symbols. | |
305 For instance we could develop a system to notify us if a stream of symbols is too boring, either because they are too repetitive or too chaotic. | |
306 This could be used to evaluate both pre-composed streams of symbols, or could even be used to provide real-time feedback in an improvisatory setup. | |
307 | |
308 \emph{comparable system} Gordon Pask's Musicolor (1953) applied a similar notion of boredom in its design. | |
309 The Musicolour would react to audio input through a microphone by flashing coloured lights. | |
310 Rather than a direct mapping of sound to light, Pask designed the device to be a partner to a performing musician. | |
311 It would adapt its lighting pattern based on the rhythms and frequencies it would hear, quickly `learning' to flash in time with the music. | |
312 However Pask endowed the device with the ability to `be bored'; if the rhythmic and frequency content of the input remained the same for too long it would listen for other rhythms and frequencies, only lighting when it heard these. | |
313 As the Musicolour would `get bored', the musician would have to change and vary their playing, eliciting new and unexpected outputs in trying to keep the Musicolour interested. | |
314 | |
315 In a similar vain, our \emph{Information Dynamics Critic}(name?) allows for an evaluative measure of an input stream, however containing a more sophisticated notion of boredom that \dots | |
316 | |
317 | |
318 | |
319 | |
256 \section{Conclusion} | 320 \section{Conclusion} |
257 | 321 |
258 \bibliographystyle{unsrt} | 322 \bibliographystyle{unsrt} |
259 {\bibliography{all,c4dm}} | 323 {\bibliography{all,c4dm}} |
260 \end{document} | 324 \end{document} |