Mercurial > hg > webaudioevaluationtool
changeset 31:438468ff317e
Merge and rebuild pdf.
author | Nicholas Jillings <n.g.r.jillings@se14.qmul.ac.uk> |
---|---|
date | Fri, 10 Apr 2015 10:20:52 +0100 |
parents | 3653190a0926 (current diff) edfad2f071dc (diff) |
children | 2b9bcac771a8 4924b57165c2 |
files | docs/ProjectSpecificationDocument.pdf docs/ProjectSpecificationDocument.tex docs/ResultsSpecificationDocument.pdf |
diffstat | 5 files changed, 77 insertions(+), 2 deletions(-) [+] |
line wrap: on
line diff
--- a/.hgignore Fri Apr 10 10:16:52 2015 +0100 +++ b/.hgignore Fri Apr 10 10:20:52 2015 +0100 @@ -7,4 +7,7 @@ docs/SMC15/smc2015template.log docs/SMC15/smc2015template.out docs/SMC15/smc2015template.pdf -docs/SMC15/smc2015template.synctex.gz \ No newline at end of file +docs/SMC15/smc2015template.synctex.gz +re:^docs/ExperimentVariableControl\.aux$ +re:^docs/ExperimentVariableControl\.log$ +re:^docs/ExperimentVariableControl\.synctex\.gz$
--- a/docs/ProjectSpecificationDocument.tex Fri Apr 10 10:16:52 2015 +0100 +++ b/docs/ProjectSpecificationDocument.tex Fri Apr 10 10:20:52 2015 +0100 @@ -117,6 +117,43 @@ \item elementFlagComments - Return a boolean per element to see if the element has comments. \end{itemize} +\section{Feature List} +\begin{itemize} +\item Paging listening tests - eg. Ask multiple questions in each experiment +\item Labels on X axis - scale +\item Input questions/comment at top to guide towards the question being asked. +\item Randomise track numbers -(inc. comment boxes and relate back to correct reference track) +\item Randomise order of individual tests +\item Save output XML file to remote server +\item Tests Metrics +\begin{itemize} +\item Duration of listening to each track +\item Time spent on each individual test +\item Start and end position of every track +\item Flags on each track, to ensure each track (but may not restrict users from submitting) +\begin{itemize} +\item Has been listened to +\item Has been moved +\item Has comments about it +\end{itemize} +\end{itemize} +\end{itemize} + +\subsection{Advanced feature list} +\begin{itemize} +\item Repeat each tests number of times (2 or 3?) to remove learning / experience bias and ensure that the order is consistent +\item Perform Loudness equalisation on all tracks +\item Selection of test type +\item Pre-test of some basic hearing test +\begin{itemize} +\item MUSHRA (with vertical slider per track) +\item APE (Single horizontal slider) +\item AB Test +\end{itemize} +\end{itemize} + + + \section{Example} Here is an example XML structure
--- a/docs/SMC15/smc2015template.tex Fri Apr 10 10:16:52 2015 +0100 +++ b/docs/SMC15/smc2015template.tex Fri Apr 10 10:20:52 2015 +0100 @@ -202,8 +202,38 @@ % Should we include an Example of the input and output XML structure?? \section{Applications}\label{sec:applications} %? +discussion of use of this toolbox (possibly based on a quick mock test using my research data, to be repeated with a large number of participants and more data later)\\ -discussion of use of this toolbox (possibly based on a quick mock test using my research data, to be repeated with a large number of participants and more data later)\\ +\subsection{Listening Environment Standardisation} + +In order to reduce the impact of having a non-standardised listening environment and unobservable participants, a series of pre-test standard questions have been put together to ask every participant. The first part of this is that every participant is asked to carry out the test, wherever possible, with a pair of quality headphones. + +\begin{itemize} +\item Name (text box) +\item I am happy for name to be used in an academic publication (check box) +\item First Language (text box) +\item Location eg. country, city (text box) +\item Playback System (ratio box (Headphones or Speaker)) +\item Make and Model of Playback System (text box) +\item Please assess how good you believe your hearing to be, where 1 is deaf, 10 is professional critical listener (Dropdown box 1-10) +\end{itemize} + + +There are also a series of considerations that have been made towards ensuring there is a standardised listening environment, so it is possible to +\begin{itemize} +\item Begin with standardised listening test - to confirm listening experience +\item Perform loudness equalisation on all tracks +\\** OR THIS SHOULD BE DONE BEFORE THE EXPERIMENT +\item Randomise order of tests +\item Randomise order of tracks in each test +\item Repeat each experiment a number of times +\\** TO REMOVE THE FAMILIARISATION WITH EXPERIMENT VARIABLE +\\** TO ENSURE CONSISTENCY OF USER +\item Track all user interactions with system +\end{itemize} + + + \section{Conclusions and future work}\label{sec:conclusions} @@ -215,6 +245,11 @@ % future work Further work may include the development of other common test designs, such as [...], and [...]. In addition, [...]. +\begin{itemize} +\item Options for MUSHRA style experiment with vertical slide per track, APE style experiment where all tracks are on a single horizontal axis, or AB test +\end{itemize} + + ... The source code of this tool can be found on \url{code.soundsoftware.ac.uk/projects/browserevaluationtool}.