# HG changeset patch # User Nicholas Jillings # Date 1428657652 -3600 # Node ID 438468ff317e6b66d95bc989850cf7a726cd6332 # Parent 3653190a0926594bacd86d6c0f0bf8fe02b10255# Parent edfad2f071dca1060b550c1aafc571fbbd95f9f0 Merge and rebuild pdf. diff -r 3653190a0926 -r 438468ff317e .hgignore --- a/.hgignore Fri Apr 10 10:16:52 2015 +0100 +++ b/.hgignore Fri Apr 10 10:20:52 2015 +0100 @@ -7,4 +7,7 @@ docs/SMC15/smc2015template.log docs/SMC15/smc2015template.out docs/SMC15/smc2015template.pdf -docs/SMC15/smc2015template.synctex.gz \ No newline at end of file +docs/SMC15/smc2015template.synctex.gz +re:^docs/ExperimentVariableControl\.aux$ +re:^docs/ExperimentVariableControl\.log$ +re:^docs/ExperimentVariableControl\.synctex\.gz$ diff -r 3653190a0926 -r 438468ff317e docs/ProjectSpecificationDocument.pdf Binary file docs/ProjectSpecificationDocument.pdf has changed diff -r 3653190a0926 -r 438468ff317e docs/ProjectSpecificationDocument.tex --- a/docs/ProjectSpecificationDocument.tex Fri Apr 10 10:16:52 2015 +0100 +++ b/docs/ProjectSpecificationDocument.tex Fri Apr 10 10:20:52 2015 +0100 @@ -117,6 +117,43 @@ \item elementFlagComments - Return a boolean per element to see if the element has comments. \end{itemize} +\section{Feature List} +\begin{itemize} +\item Paging listening tests - eg. Ask multiple questions in each experiment +\item Labels on X axis - scale +\item Input questions/comment at top to guide towards the question being asked. +\item Randomise track numbers -(inc. comment boxes and relate back to correct reference track) +\item Randomise order of individual tests +\item Save output XML file to remote server +\item Tests Metrics +\begin{itemize} +\item Duration of listening to each track +\item Time spent on each individual test +\item Start and end position of every track +\item Flags on each track, to ensure each track (but may not restrict users from submitting) +\begin{itemize} +\item Has been listened to +\item Has been moved +\item Has comments about it +\end{itemize} +\end{itemize} +\end{itemize} + +\subsection{Advanced feature list} +\begin{itemize} +\item Repeat each tests number of times (2 or 3?) to remove learning / experience bias and ensure that the order is consistent +\item Perform Loudness equalisation on all tracks +\item Selection of test type +\item Pre-test of some basic hearing test +\begin{itemize} +\item MUSHRA (with vertical slider per track) +\item APE (Single horizontal slider) +\item AB Test +\end{itemize} +\end{itemize} + + + \section{Example} Here is an example XML structure diff -r 3653190a0926 -r 438468ff317e docs/ResultsSpecificationDocument.pdf Binary file docs/ResultsSpecificationDocument.pdf has changed diff -r 3653190a0926 -r 438468ff317e docs/SMC15/smc2015template.tex --- a/docs/SMC15/smc2015template.tex Fri Apr 10 10:16:52 2015 +0100 +++ b/docs/SMC15/smc2015template.tex Fri Apr 10 10:20:52 2015 +0100 @@ -202,8 +202,38 @@ % Should we include an Example of the input and output XML structure?? \section{Applications}\label{sec:applications} %? +discussion of use of this toolbox (possibly based on a quick mock test using my research data, to be repeated with a large number of participants and more data later)\\ -discussion of use of this toolbox (possibly based on a quick mock test using my research data, to be repeated with a large number of participants and more data later)\\ +\subsection{Listening Environment Standardisation} + +In order to reduce the impact of having a non-standardised listening environment and unobservable participants, a series of pre-test standard questions have been put together to ask every participant. The first part of this is that every participant is asked to carry out the test, wherever possible, with a pair of quality headphones. + +\begin{itemize} +\item Name (text box) +\item I am happy for name to be used in an academic publication (check box) +\item First Language (text box) +\item Location eg. country, city (text box) +\item Playback System (ratio box (Headphones or Speaker)) +\item Make and Model of Playback System (text box) +\item Please assess how good you believe your hearing to be, where 1 is deaf, 10 is professional critical listener (Dropdown box 1-10) +\end{itemize} + + +There are also a series of considerations that have been made towards ensuring there is a standardised listening environment, so it is possible to +\begin{itemize} +\item Begin with standardised listening test - to confirm listening experience +\item Perform loudness equalisation on all tracks +\\** OR THIS SHOULD BE DONE BEFORE THE EXPERIMENT +\item Randomise order of tests +\item Randomise order of tracks in each test +\item Repeat each experiment a number of times +\\** TO REMOVE THE FAMILIARISATION WITH EXPERIMENT VARIABLE +\\** TO ENSURE CONSISTENCY OF USER +\item Track all user interactions with system +\end{itemize} + + + \section{Conclusions and future work}\label{sec:conclusions} @@ -215,6 +245,11 @@ % future work Further work may include the development of other common test designs, such as [...], and [...]. In addition, [...]. +\begin{itemize} +\item Options for MUSHRA style experiment with vertical slide per track, APE style experiment where all tracks are on a single horizontal axis, or AB test +\end{itemize} + + ... The source code of this tool can be found on \url{code.soundsoftware.ac.uk/projects/browserevaluationtool}.