comparison draft.tex @ 35:194c7ec7e35d

Re-wrote section IV
author Henrik Ekeus <hekeus@eecs.qmul.ac.uk>
date Wed, 14 Mar 2012 18:21:16 +0000
parents 25846c37a08a
children ec7d64c0ae44
comparison
equal deleted inserted replaced
34:25846c37a08a 35:194c7ec7e35d
619 \emph{Andrew} 619 \emph{Andrew}
620 620
621 621
622 \section{Information dynamics as compositional aid} 622 \section{Information dynamics as compositional aid}
623 623
624 In addition to applying information dynamics to analysis, it is also possible 624 In addition to applying information dynamics to analysis, it is also possible to apply it to the generation of content, such as to the composition of musical materials.
625 use this approach in design, such as the composition of musical materials. By 625 The outputs of algorithmic or stochastic processes can be filtered to match a set of criteria defined in terms of the information dynamics model, this criteria thus becoming a means of interfacing with the generative process.
626 providing a framework for linking information theoretic measures to the control 626 For instance a stochastic music generating process could be controlled by modifying constraints on its output in terms of predictive information rate or entropy rate.
627 of generative processes, it becomes possible to steer the output of these processes 627
628 to match a criteria defined by these measures. For instance outputs of a 628 The use of stochastic processes for the composition of musical material has been widespread for decades -- for instance Iannis Xenakis applied probabilistic mathematical models to the creation of musical materials\cite{Xenakis:1992ul}.
629 stochastic musical process could be filtered to match constraints defined by a 629 Information dynamics can serve as a novel framework for the exploration of the possibilities of such processes at the high and abstract level of expectation, randomness and predictability.
630 set of information theoretic measures.
631
632 The use of stochastic processes for the generation of musical material has been
633 widespread for decades -- Iannis Xenakis applied probabilistic mathematical
634 models to the creation of musical materials, including to the formulation of a
635 theory of Markovian Stochastic Music. However we can use information dynamics
636 measures to explore and interface with such processes at the high and abstract
637 level of expectation, randomness and predictability. The Melody Triangle is
638 such a system.
639 630
640 \subsection{The Melody Triangle} 631 \subsection{The Melody Triangle}
641 The Melody Triangle is an exploratory interface for the discovery of melodic 632 The Melody Triangle is an exploratory interface for the discovery of melodic content, where the input -- positions within a triangle -- directly map to information theoretic measures of the output.
642 content, where the input -- positions within a triangle -- directly map to 633 The measures -- entropy rate, redundancy and predictive information rate -- form a criteria with which to filter the output of the stochastic processes used to generate sequences of notes.
643 information theoretic measures associated with the output. 634 These measures address notions of expectation and surprise in music, and as such the Melody Triangle is a means of interfacing with a generative process in terms of the predictability of its output.
644 The measures are the entropy rate, redundancy and predictive information rate
645 of the random process used to generate the sequence of notes.
646 These are all related to the predictability of the the sequence and as such
647 address the notions of expectation and surprise in the perception of
648 music.\emph{self-plagiarised}
649 635
650 Before the Melody Triangle can used, it has to be `populated' with possible 636 The triangle is `populated' with possible parameter values for melody generators.
651 parameter values for the melody generators. These are then plotted in a 3d 637 These are plotted in a 3d statistical space of redundancy, entropy rate and predictive information rate.
652 statistical space of redundancy, entropy rate and predictive information rate. 638 In our case we generated thousands of transition matrixes, representing first-order Markov chains, by a random sampling method.
653 In our case we generated thousands of transition matrixes, representing first-order 639 In figure \ref{InfoDynEngine} we see a representation of how these matrixes are distributed in the 3d statistical space; each one of these points corresponds to a transition matrix.
654 Markov chains, by a random sampling method. In figure \ref{InfoDynEngine} we see 640
655 a representation of how these matrixes are distributed in the 3d statistical 641
656 space; each one of these points corresponds to a transition 642
657 matrix.\emph{self-plagiarised}
658
659 643
660 When we look at the distribution of transition matrixes plotted in this space, 644 The distribution of transition matrixes plotted in this space forms an arch shape that is fairly thin.
661 we see that it forms an arch shape that is fairly thin. It thus becomes a 645 It thus becomes a reasonable approximation to pretend that it is just a sheet in two dimensions; and so we stretch out this curved arc into a flat triangle.
662 reasonable approximation to pretend that it is just a sheet in two dimensions; 646 It is this triangular sheet that is our `Melody Triangle' and forms the interface by which the system is controlled.
663 and so we stretch out this curved arc into a flat triangle. It is this triangular 647 Using this interface thus involves a mapping to statistical space; a user selects a position within the triangle, and a corresponding transition matrix is returned.
664 sheet that is our `Melody Triangle' and forms the interface by which the system 648 Figure \ref{TheTriangle} shows how the triangle maps to different measures of redundancy, entropy rate and predictive information rate.
665 is controlled. \emph{self-plagiarised} 649
666 650
667 When the Melody Triangle is used, regardless of whether it is as a screen based 651
668 system, or as an interactive installation, it involves a mapping to this statistical 652
669 space. When the user, through the interface, selects a position within the 653 Each corner corresponds to three different extremes of predictability and unpredictability, which could be loosely characterised as `periodicity', `noise' and `repetition'.
670 triangle, the corresponding transition matrix is returned. Figure \ref{TheTriangle} 654 Melodies from the `noise' corner have no discernible pattern; they have high entropy rate, low predictive information rate and low redundancy.
671 shows how the triangle maps to different measures of redundancy, entropy rate 655 These melodies are essentially totally random.
672 and predictive information rate.\emph{self-plagiarised} 656 A melody along the `periodicity' to `repetition' edge are all deterministic loops that get shorter as we approach the `repetition' corner, until it becomes just one repeating note.
673 657 It is the areas in between the extremes that provide the more `interesting' melodies.
674 Each corner corresponds to three different extremes of predictability and 658 These melodies have some level of unpredictability, but are not completely random.
675 unpredictability, which could be loosely characterised as `periodicity', `noise' 659 Or, conversely, are predictable, but not entirely so.
676 and `repetition'. Melodies from the `noise' corner have no discernible pattern; 660
677 they have high entropy rate, low predictive information rate and low redundancy. 661 The Melody Triangle exists in two incarnations; a standard screen based interface where a user moves tokens in and around a triangle on screen, and a multi-user interactive installation where a Kinect camera tracks individuals in a space and maps their positions in physical space to the triangle.
678 These melodies are essentially totally random. A melody along the `periodicity' 662 In the latter visitors entering the installation generates a melody, and could collaborate with their co-visitors to generate musical textures -- a playful yet informative way to explore expectation and surprise in music.
679 to `repetition' edge are all deterministic loops that get shorter as we approach 663 Additionally different gestures could be detected to change the tempo, register, instrumentation and periodicity of the output melody.
680 the `repetition' corner, until it becomes just one repeating note. It is the
681 areas in between the extremes that provide the more `interesting' melodies. That
682 is, those that have some level of unpredictability, but are not completely ran-
683 dom. Or, conversely, that are predictable, but not entirely so. This triangular
684 space allows for an intuitive explorationof expectation and surprise in temporal
685 sequences based on a simple model of how one might guess the next event given
686 the previous one.\emph{self-plagiarised}
687 664
688 \begin{figure} 665 \begin{figure}
689 \centering 666 \centering
690 \includegraphics[width=\linewidth]{figs/mtriscat} 667 \includegraphics[width=\linewidth]{figs/mtriscat}
691 \caption{The population of transition matrices distributed along three axes of 668 \caption{The population of transition matrices distributed along three axes of
696 represents its PIR---note that the highest values are found at intermediate entropy 673 represents its PIR---note that the highest values are found at intermediate entropy
697 and redundancy, and that the distribution as a whole makes a curved triangle. Although 674 and redundancy, and that the distribution as a whole makes a curved triangle. Although
698 not visible in this plot, it is largely hollow in the middle. 675 not visible in this plot, it is largely hollow in the middle.
699 \label{InfoDynEngine}} 676 \label{InfoDynEngine}}
700 \end{figure} 677 \end{figure}
701
702
703
704 Any number of interfaces could be developed for the Melody Triangle. We have
705 developed two; a standard screen based interface where a user moves tokens with
706 a mouse in and around a triangle on screen, and a multi-user interactive
707 installation where a Kinect camera tracks individuals in a space and maps their
708 positions in the space to the triangle.
709 Each visitor would generate a melody, and could collaborate with their co-visitors
710 to generate musical textures -- a playful yet informative way to explore
711 expectation and surprise in music.
712 678
713 As a screen based interface the Melody Triangle can serve as composition tool. 679 As a screen based interface the Melody Triangle can serve as composition tool.
714 A triangle is drawn on the screen, screen space thus mapped to the statistical 680 A triangle is drawn on the screen, screen space thus mapped to the statistical space of the Melody Triangle.
715 space of the Melody Triangle. 681 A number of round tokens, each representing a melody can be dragged in and around the triangle.
716 A number of round tokens, each representing a melody can be dragged in and 682 When a token is dragged into the triangle, the system will start generating the sequence of symbols with statistical properties that correspond to the position of the token.
717 around the triangle. When a token is dragged into the triangle, the system 683 These symbols are then mapped to notes of a scale.
718 will start generating the sequence of notes with statistical properties that 684 Keyboard input allow for control over additionally parameters.
719 correspond to its position in the triangle.\emph{self-plagiarised} 685
720
721 In this mode, the Melody Triangle can be used as a kind of composition assistant
722 for the generation of interesting musical textures and melodies. However unlike
723 other computer aided composition tools or programming environments, here the
724 composer engages with music on the high and abstract level of expectation,
725 randomness and predictability.\emph{self-plagiarised}
726
727
728 Additionally the Melody Triangle serves as an effective tool for experimental investigations into musical preference and their relationship to the information dynamics models.
729
730 %As the Melody Triangle essentially operates on a stream of symbols, it it is possible to apply the melody triangle to the design of non-sonic content.
731
732 \begin{figure} 686 \begin{figure}
733 \centering 687 \centering
734 \includegraphics[width=0.9\linewidth]{figs/TheTriangle.pdf} 688 \includegraphics[width=0.9\linewidth]{figs/TheTriangle.pdf}
735 \caption{The Melody Triangle\label{TheTriangle}} 689 \caption{The Melody Triangle\label{TheTriangle}}
736 \end{figure} 690 \end{figure}
691
692 In this mode, the Melody Triangle is a compositional tool.
693 It can assist a composer in the creation not only of melodies, but by placing multiple tokens in the triangle, the generation of intricate musical textures.
694 Unlike other computer aided composition tools or programming environments, here the composer engages with music on the high and abstract level of expectation, randomness and predictability.
695
737 696
738 \section{Musical Preference and Information Dynamics} 697 \section{Musical Preference and Information Dynamics}
739 We carried out a preliminary study that sought to identify any correlation between 698 We carried out a preliminary study that sought to identify any correlation between
740 aesthetic preference and the information theoretical measures of the Melody 699 aesthetic preference and the information theoretical measures of the Melody
741 Triangle. In this study participants were asked to use the screen based interface 700 Triangle. In this study participants were asked to use the screen based interface