comparison docs/SMC15/smc2015template.tex @ 973:07bde6fea7b1

Paper: added interface image, minor updates
author Brecht De Man <BrechtDeMan@users.noreply.github.com>
date Thu, 23 Apr 2015 12:02:34 +0100
parents d5a88548df71
children 23db21f24198
comparison
equal deleted inserted replaced
972:565ffb272d82 973:07bde6fea7b1
151 151
152 %NICK: examples of what kind of audio applications HTML5 has made possible, with references to publications (or website)\\ 152 %NICK: examples of what kind of audio applications HTML5 has made possible, with references to publications (or website)\\
153 153
154 The Web Audio API is a high-level JavaScript API designed for real-time processing audio inside the browser through various processing nodes \cite{webaudioapi}. Various web sites have used the Web Audio API for either creative purposes, such as drum machines and score creation tools \cite{webaudiodemo}, %http://webaudio.github.io/demo-list/ 154 The Web Audio API is a high-level JavaScript API designed for real-time processing audio inside the browser through various processing nodes \cite{webaudioapi}. Various web sites have used the Web Audio API for either creative purposes, such as drum machines and score creation tools \cite{webaudiodemo}, %http://webaudio.github.io/demo-list/
155 others from the list show real-time captured audio processing such as room reverberation tools and a phase vocoder from the system microphone. The BBC Radiophonic Workshop shows effects used on famous TV shows such as Doctor Who, being simulated inside the browser \cite{bbcradiophonics}. %http://webaudio.prototyping.bbc.co.uk/ 155 others from the list show real-time captured audio processing such as room reverberation tools and a phase vocoder from the system microphone. The BBC Radiophonic Workshop shows effects used on famous TV shows such as Doctor Who, being simulated inside the browser \cite{bbcradiophonics}. %http://webaudio.prototyping.bbc.co.uk/
156 Another example is the BBC R\&D automatic compressor which applies a dynamic range compressor on a radio station which dynamically adjusts the compressor settings to match the listener's envrionment.\\ % The paper for this has not been released yet by AES... 156 Another example is the BBC R\&D automatic compressor which applies a dynamic range compressor on a radio station which dynamically adjusts the compressor settings to match the listener's environment.\\ % The paper for this has not been released yet by AES...
157 157
158 This work is based on the APE audio perceptual evaluation interface for MATLAB \cite{deman2014b}. Because of the 158 This work is based on the APE audio perceptual evaluation interface for MATLAB \cite{deman2014b}. An important drawback of this toolbox is the need to have MATLAB to create a test and even to run (barring the use of an executable generated by MATLAB), and limited compatibility with both earlier and newer versions of MATLAB, which makes it hard to maintain. On the other hand, a web application generally has the advantage of running in most browsers on most applications, and we present a tool that requires no specialised software or even programming knowledge to set up.
159 %prior work: \cite{deman2014b} in MATLAB, much less easy to deploy, and often stops working due to version updates \\
160
161
159 162
160 background (types of research where this type of perceptual evaluation of audio is relevant)\\ 163 background (types of research where this type of perceptual evaluation of audio is relevant)\\
161 164
162 multiple stimulus perceptual evaluation \cite{bech}\\ 165 multiple stimulus perceptual evaluation \cite{bech}\\
163 166
164 prior work: \cite{deman2014b} in MATLAB, much less easy to deploy, and often stops working due to version updates \\
165
166 goal, what are we trying to do? \\ 167 goal, what are we trying to do? \\
167 168
168 other background papers (some SMC?)\\ 169 other background papers (some SMC?)\\
169
170 [Previously, due to limited functionality of HTML, ..., it was not possible to design this type of interfaces with such high quality audio... ]
171
172 170
173 %\section{Design considerations}\label{sec:designconsiderations} % not necessary? with next (/previous) section? 171 %\section{Design considerations}\label{sec:designconsiderations} % not necessary? with next (/previous) section?
174 172
175 We present a browser-based perceptual evaluation tool for audio that ... \\ 173 We present a browser-based perceptual evaluation tool for audio that ... \\
176 174
188 186
189 \subsection{Interface}\label{sec:interface} %elsewhere? 187 \subsection{Interface}\label{sec:interface} %elsewhere?
190 188
191 At this point, we have implemented the interface of the MATLAB-based APE Perceptual Evaluation for Audio toolbox \cite{deman2014b}, which shows one marker for each simultaneously evaluated audio fragment on one or more horizontal axes (to rate/rank the respective fragments), as well as a comment box for every marker, and any extra text boxes for extra comments. See \ref{fig:interface} for an example of the interface, with 10 fragments and one axis. However, the back end of this test environment allows for many more established and novel interfaces for listening tests, particularly ones where the subject only assesses audio without manipulating it (i.e. method of adjustment, which would require additional features to be implemented). 189 At this point, we have implemented the interface of the MATLAB-based APE Perceptual Evaluation for Audio toolbox \cite{deman2014b}, which shows one marker for each simultaneously evaluated audio fragment on one or more horizontal axes (to rate/rank the respective fragments), as well as a comment box for every marker, and any extra text boxes for extra comments. See \ref{fig:interface} for an example of the interface, with 10 fragments and one axis. However, the back end of this test environment allows for many more established and novel interfaces for listening tests, particularly ones where the subject only assesses audio without manipulating it (i.e. method of adjustment, which would require additional features to be implemented).
192 190
193 %\begin{figure*}[htbp] 191 \begin{figure*}[htbp]
194 %\begin{center} 192 \begin{center}
195 %\includegraphics[width=0.9\textwidth]{interface.png} 193 \includegraphics[width=0.9\textwidth]{interface.png}
196 %\caption{Example of interface, with 1 axis and 10 fragments} 194 \caption{Example of interface, with 1 axis and 10 fragments}
197 %\label{fig:interface} 195 \label{fig:interface}
198 %\end{center} 196 \end{center}
199 %\end{figure*} 197 \end{figure*}
200 198
201 199
202 200
203 \subsection{Architecture}\label{sec:architecture} 201 \subsection{Architecture}\label{sec:architecture}
204 202