Mercurial > hg > cip2012
comparison draft.tex @ 35:194c7ec7e35d
Re-wrote section IV
author | Henrik Ekeus <hekeus@eecs.qmul.ac.uk> |
---|---|
date | Wed, 14 Mar 2012 18:21:16 +0000 |
parents | 25846c37a08a |
children | ec7d64c0ae44 |
comparison
equal
deleted
inserted
replaced
34:25846c37a08a | 35:194c7ec7e35d |
---|---|
619 \emph{Andrew} | 619 \emph{Andrew} |
620 | 620 |
621 | 621 |
622 \section{Information dynamics as compositional aid} | 622 \section{Information dynamics as compositional aid} |
623 | 623 |
624 In addition to applying information dynamics to analysis, it is also possible | 624 In addition to applying information dynamics to analysis, it is also possible to apply it to the generation of content, such as to the composition of musical materials. |
625 use this approach in design, such as the composition of musical materials. By | 625 The outputs of algorithmic or stochastic processes can be filtered to match a set of criteria defined in terms of the information dynamics model, this criteria thus becoming a means of interfacing with the generative process. |
626 providing a framework for linking information theoretic measures to the control | 626 For instance a stochastic music generating process could be controlled by modifying constraints on its output in terms of predictive information rate or entropy rate. |
627 of generative processes, it becomes possible to steer the output of these processes | 627 |
628 to match a criteria defined by these measures. For instance outputs of a | 628 The use of stochastic processes for the composition of musical material has been widespread for decades -- for instance Iannis Xenakis applied probabilistic mathematical models to the creation of musical materials\cite{Xenakis:1992ul}. |
629 stochastic musical process could be filtered to match constraints defined by a | 629 Information dynamics can serve as a novel framework for the exploration of the possibilities of such processes at the high and abstract level of expectation, randomness and predictability. |
630 set of information theoretic measures. | |
631 | |
632 The use of stochastic processes for the generation of musical material has been | |
633 widespread for decades -- Iannis Xenakis applied probabilistic mathematical | |
634 models to the creation of musical materials, including to the formulation of a | |
635 theory of Markovian Stochastic Music. However we can use information dynamics | |
636 measures to explore and interface with such processes at the high and abstract | |
637 level of expectation, randomness and predictability. The Melody Triangle is | |
638 such a system. | |
639 | 630 |
640 \subsection{The Melody Triangle} | 631 \subsection{The Melody Triangle} |
641 The Melody Triangle is an exploratory interface for the discovery of melodic | 632 The Melody Triangle is an exploratory interface for the discovery of melodic content, where the input -- positions within a triangle -- directly map to information theoretic measures of the output. |
642 content, where the input -- positions within a triangle -- directly map to | 633 The measures -- entropy rate, redundancy and predictive information rate -- form a criteria with which to filter the output of the stochastic processes used to generate sequences of notes. |
643 information theoretic measures associated with the output. | 634 These measures address notions of expectation and surprise in music, and as such the Melody Triangle is a means of interfacing with a generative process in terms of the predictability of its output. |
644 The measures are the entropy rate, redundancy and predictive information rate | |
645 of the random process used to generate the sequence of notes. | |
646 These are all related to the predictability of the the sequence and as such | |
647 address the notions of expectation and surprise in the perception of | |
648 music.\emph{self-plagiarised} | |
649 | 635 |
650 Before the Melody Triangle can used, it has to be `populated' with possible | 636 The triangle is `populated' with possible parameter values for melody generators. |
651 parameter values for the melody generators. These are then plotted in a 3d | 637 These are plotted in a 3d statistical space of redundancy, entropy rate and predictive information rate. |
652 statistical space of redundancy, entropy rate and predictive information rate. | 638 In our case we generated thousands of transition matrixes, representing first-order Markov chains, by a random sampling method. |
653 In our case we generated thousands of transition matrixes, representing first-order | 639 In figure \ref{InfoDynEngine} we see a representation of how these matrixes are distributed in the 3d statistical space; each one of these points corresponds to a transition matrix. |
654 Markov chains, by a random sampling method. In figure \ref{InfoDynEngine} we see | 640 |
655 a representation of how these matrixes are distributed in the 3d statistical | 641 |
656 space; each one of these points corresponds to a transition | 642 |
657 matrix.\emph{self-plagiarised} | |
658 | |
659 | 643 |
660 When we look at the distribution of transition matrixes plotted in this space, | 644 The distribution of transition matrixes plotted in this space forms an arch shape that is fairly thin. |
661 we see that it forms an arch shape that is fairly thin. It thus becomes a | 645 It thus becomes a reasonable approximation to pretend that it is just a sheet in two dimensions; and so we stretch out this curved arc into a flat triangle. |
662 reasonable approximation to pretend that it is just a sheet in two dimensions; | 646 It is this triangular sheet that is our `Melody Triangle' and forms the interface by which the system is controlled. |
663 and so we stretch out this curved arc into a flat triangle. It is this triangular | 647 Using this interface thus involves a mapping to statistical space; a user selects a position within the triangle, and a corresponding transition matrix is returned. |
664 sheet that is our `Melody Triangle' and forms the interface by which the system | 648 Figure \ref{TheTriangle} shows how the triangle maps to different measures of redundancy, entropy rate and predictive information rate. |
665 is controlled. \emph{self-plagiarised} | 649 |
666 | 650 |
667 When the Melody Triangle is used, regardless of whether it is as a screen based | 651 |
668 system, or as an interactive installation, it involves a mapping to this statistical | 652 |
669 space. When the user, through the interface, selects a position within the | 653 Each corner corresponds to three different extremes of predictability and unpredictability, which could be loosely characterised as `periodicity', `noise' and `repetition'. |
670 triangle, the corresponding transition matrix is returned. Figure \ref{TheTriangle} | 654 Melodies from the `noise' corner have no discernible pattern; they have high entropy rate, low predictive information rate and low redundancy. |
671 shows how the triangle maps to different measures of redundancy, entropy rate | 655 These melodies are essentially totally random. |
672 and predictive information rate.\emph{self-plagiarised} | 656 A melody along the `periodicity' to `repetition' edge are all deterministic loops that get shorter as we approach the `repetition' corner, until it becomes just one repeating note. |
673 | 657 It is the areas in between the extremes that provide the more `interesting' melodies. |
674 Each corner corresponds to three different extremes of predictability and | 658 These melodies have some level of unpredictability, but are not completely random. |
675 unpredictability, which could be loosely characterised as `periodicity', `noise' | 659 Or, conversely, are predictable, but not entirely so. |
676 and `repetition'. Melodies from the `noise' corner have no discernible pattern; | 660 |
677 they have high entropy rate, low predictive information rate and low redundancy. | 661 The Melody Triangle exists in two incarnations; a standard screen based interface where a user moves tokens in and around a triangle on screen, and a multi-user interactive installation where a Kinect camera tracks individuals in a space and maps their positions in physical space to the triangle. |
678 These melodies are essentially totally random. A melody along the `periodicity' | 662 In the latter visitors entering the installation generates a melody, and could collaborate with their co-visitors to generate musical textures -- a playful yet informative way to explore expectation and surprise in music. |
679 to `repetition' edge are all deterministic loops that get shorter as we approach | 663 Additionally different gestures could be detected to change the tempo, register, instrumentation and periodicity of the output melody. |
680 the `repetition' corner, until it becomes just one repeating note. It is the | |
681 areas in between the extremes that provide the more `interesting' melodies. That | |
682 is, those that have some level of unpredictability, but are not completely ran- | |
683 dom. Or, conversely, that are predictable, but not entirely so. This triangular | |
684 space allows for an intuitive explorationof expectation and surprise in temporal | |
685 sequences based on a simple model of how one might guess the next event given | |
686 the previous one.\emph{self-plagiarised} | |
687 | 664 |
688 \begin{figure} | 665 \begin{figure} |
689 \centering | 666 \centering |
690 \includegraphics[width=\linewidth]{figs/mtriscat} | 667 \includegraphics[width=\linewidth]{figs/mtriscat} |
691 \caption{The population of transition matrices distributed along three axes of | 668 \caption{The population of transition matrices distributed along three axes of |
696 represents its PIR---note that the highest values are found at intermediate entropy | 673 represents its PIR---note that the highest values are found at intermediate entropy |
697 and redundancy, and that the distribution as a whole makes a curved triangle. Although | 674 and redundancy, and that the distribution as a whole makes a curved triangle. Although |
698 not visible in this plot, it is largely hollow in the middle. | 675 not visible in this plot, it is largely hollow in the middle. |
699 \label{InfoDynEngine}} | 676 \label{InfoDynEngine}} |
700 \end{figure} | 677 \end{figure} |
701 | |
702 | |
703 | |
704 Any number of interfaces could be developed for the Melody Triangle. We have | |
705 developed two; a standard screen based interface where a user moves tokens with | |
706 a mouse in and around a triangle on screen, and a multi-user interactive | |
707 installation where a Kinect camera tracks individuals in a space and maps their | |
708 positions in the space to the triangle. | |
709 Each visitor would generate a melody, and could collaborate with their co-visitors | |
710 to generate musical textures -- a playful yet informative way to explore | |
711 expectation and surprise in music. | |
712 | 678 |
713 As a screen based interface the Melody Triangle can serve as composition tool. | 679 As a screen based interface the Melody Triangle can serve as composition tool. |
714 A triangle is drawn on the screen, screen space thus mapped to the statistical | 680 A triangle is drawn on the screen, screen space thus mapped to the statistical space of the Melody Triangle. |
715 space of the Melody Triangle. | 681 A number of round tokens, each representing a melody can be dragged in and around the triangle. |
716 A number of round tokens, each representing a melody can be dragged in and | 682 When a token is dragged into the triangle, the system will start generating the sequence of symbols with statistical properties that correspond to the position of the token. |
717 around the triangle. When a token is dragged into the triangle, the system | 683 These symbols are then mapped to notes of a scale. |
718 will start generating the sequence of notes with statistical properties that | 684 Keyboard input allow for control over additionally parameters. |
719 correspond to its position in the triangle.\emph{self-plagiarised} | 685 |
720 | |
721 In this mode, the Melody Triangle can be used as a kind of composition assistant | |
722 for the generation of interesting musical textures and melodies. However unlike | |
723 other computer aided composition tools or programming environments, here the | |
724 composer engages with music on the high and abstract level of expectation, | |
725 randomness and predictability.\emph{self-plagiarised} | |
726 | |
727 | |
728 Additionally the Melody Triangle serves as an effective tool for experimental investigations into musical preference and their relationship to the information dynamics models. | |
729 | |
730 %As the Melody Triangle essentially operates on a stream of symbols, it it is possible to apply the melody triangle to the design of non-sonic content. | |
731 | |
732 \begin{figure} | 686 \begin{figure} |
733 \centering | 687 \centering |
734 \includegraphics[width=0.9\linewidth]{figs/TheTriangle.pdf} | 688 \includegraphics[width=0.9\linewidth]{figs/TheTriangle.pdf} |
735 \caption{The Melody Triangle\label{TheTriangle}} | 689 \caption{The Melody Triangle\label{TheTriangle}} |
736 \end{figure} | 690 \end{figure} |
691 | |
692 In this mode, the Melody Triangle is a compositional tool. | |
693 It can assist a composer in the creation not only of melodies, but by placing multiple tokens in the triangle, the generation of intricate musical textures. | |
694 Unlike other computer aided composition tools or programming environments, here the composer engages with music on the high and abstract level of expectation, randomness and predictability. | |
695 | |
737 | 696 |
738 \section{Musical Preference and Information Dynamics} | 697 \section{Musical Preference and Information Dynamics} |
739 We carried out a preliminary study that sought to identify any correlation between | 698 We carried out a preliminary study that sought to identify any correlation between |
740 aesthetic preference and the information theoretical measures of the Melody | 699 aesthetic preference and the information theoretical measures of the Melody |
741 Triangle. In this study participants were asked to use the screen based interface | 700 Triangle. In this study participants were asked to use the screen based interface |