Mercurial > hg > webaudioevaluationtool
comparison docs/Instructions/Instructions.tex @ 494:95b6a39160fa Dev_main
More instructions. Added comment box sections. Still wip.
author | Nicholas Jillings <n.g.r.jillings@se14.qmul.ac.uk> |
---|---|
date | Wed, 27 Jan 2016 09:49:42 +0000 |
parents | 92df95a6e95d |
children | 91b3c9b2e847 |
comparison
equal
deleted
inserted
replaced
493:1fc9f982b778 | 494:95b6a39160fa |
---|---|
291 \item \texttt{<metric>}: Must appear only once. | 291 \item \texttt{<metric>}: Must appear only once. |
292 \item \texttt{<interface>}: Must appear only once. | 292 \item \texttt{<interface>}: Must appear only once. |
293 \end{itemize} | 293 \end{itemize} |
294 | 294 |
295 \subsection{Page} | 295 \subsection{Page} |
296 \label{sec:page} | |
296 The only other first level child nodes, these specify the test pages. It takes the following attributes: | 297 The only other first level child nodes, these specify the test pages. It takes the following attributes: |
297 \begin{itemize} | 298 \begin{itemize} |
298 \item \texttt{id}: ID, mandatory. A string which must be unique across the entire XML. It is used to identify the page on test completion as pages are returned in the results in the order they appeared, not specified. | 299 \item \texttt{id}: ID, mandatory. A string which must be unique across the entire XML. It is used to identify the page on test completion as pages are returned in the results in the order they appeared, not specified. |
299 \item \texttt{hostURL}: URL, mandatory. Used in conjuction with the \texttt{<audioelement>} url to specify where the audio files are located. For instance if all your files are in the directory \texttt{./test/} you can set this attribute to "/test/" and the \texttt{<audioelement>} url attribute only needs to file name. Set to "" if no hostURL prefix desired. | 300 \item \texttt{hostURL}: URL, mandatory. Used in conjuction with the \texttt{<audioelement>} url to specify where the audio files are located. For instance if all your files are in the directory \texttt{./test/} you can set this attribute to "/test/" and the \texttt{<audioelement>} url attribute only needs to file name. Set to "" if no hostURL prefix desired. |
300 \item \texttt{randomiseOrder}: Boolean, optional. If true the audio fragments are presented randomly rather than the order specified. See \ref{sec:randomisation}. Default is false. | 301 \item \texttt{randomiseOrder}: Boolean, optional. If true the audio fragments are presented randomly rather than the order specified. See \ref{sec:randomisation}. Default is false. |
308 \begin{itemize} | 309 \begin{itemize} |
309 \item \texttt{<title>}: Appear once or not at all. The text content of this node specifies the title of the test page, for instance \texttt{<title>John Doe's Test</title>} | 310 \item \texttt{<title>}: Appear once or not at all. The text content of this node specifies the title of the test page, for instance \texttt{<title>John Doe's Test</title>} |
310 \item \texttt{<commentboxprefix}: Appear once or not at all. The text content specifies the prefix of the comment boxes, see \ref{sec:commentboxes}. | 311 \item \texttt{<commentboxprefix}: Appear once or not at all. The text content specifies the prefix of the comment boxes, see \ref{sec:commentboxes}. |
311 \item \texttt{<interface>}: Must appear only once. | 312 \item \texttt{<interface>}: Must appear only once. |
312 \item \texttt{<audioelement>}: Minimum of one. Specifies an audio element, see \ref{sec:audioelement}. | 313 \item \texttt{<audioelement>}: Minimum of one. Specifies an audio element, see \ref{sec:audioelement}. |
313 \item \texttt{<commentquestion}: Min of 0, max unlimited occurences. See \ref{sec:commentboxes}. | 314 \item \texttt{<commentquestion>}: Min of 0, max unlimited occurences. See \ref{sec:commentboxes}. |
314 \item \texttt{<survey>}: Min of 0, max of 2 occurences. See \ref{sec:survey} | 315 \item \texttt{<survey>}: Min of 0, max of 2 occurences. See \ref{sec:survey} |
315 \end{itemize} | 316 \end{itemize} |
316 | 317 |
317 \subsection{Survey} | 318 \subsection{Survey} |
318 \label{sec:survey} | 319 \label{sec:survey} |
429 \subsection{Sample rate} | 430 \subsection{Sample rate} |
430 \label{sec:samplerate} | 431 \label{sec:samplerate} |
431 If you require the test to be conducted at a certain sample rate (i.e. you do not tolerate resampling of the elements to correspond with the system's sample rate), add \texttt{sampleRate="96000"} - where ``96000'' can be any support sample rate (in Hz) - so that a warning message is shown alerting the subject that their system's sample rate is different from this enforced sample rate. This is checked immediately after parsing and stops the page loading any other elements if this check has failed. | 432 If you require the test to be conducted at a certain sample rate (i.e. you do not tolerate resampling of the elements to correspond with the system's sample rate), add \texttt{sampleRate="96000"} - where ``96000'' can be any support sample rate (in Hz) - so that a warning message is shown alerting the subject that their system's sample rate is different from this enforced sample rate. This is checked immediately after parsing and stops the page loading any other elements if this check has failed. |
432 | 433 |
433 \subsection{Metrics} | 434 \subsection{Metrics} |
434 Enable the collection of metrics by adding \texttt{collectMetrics=`true'} in the \texttt{setup} node. % Should this always be on?? | |
435 | |
436 The \texttt{Metric} node, which contains the metrics to be tracked during the complete test, is a child of the \texttt{setup} node, and it could look as follows. | 435 The \texttt{Metric} node, which contains the metrics to be tracked during the complete test, is a child of the \texttt{setup} node, and it could look as follows. |
437 | 436 |
438 \begin{lstlisting} | 437 \begin{lstlisting} |
439 <Metric> | 438 <Metric> |
440 <metricEnable>testTimer</metricEnable> | 439 <metricEnable>testTimer</metricEnable> |
445 <metricEnable>elementFlagMoved</metricEnable> | 444 <metricEnable>elementFlagMoved</metricEnable> |
446 <metricEnable>elementListenTracker</metricEnable> | 445 <metricEnable>elementListenTracker</metricEnable> |
447 </Metric> | 446 </Metric> |
448 \end{lstlisting} | 447 \end{lstlisting} |
449 | 448 |
450 When in doubt, err on the inclusive side, as one never knows which information is needed in the future. Most of these metrics are necessary for post-processing scripts such as timeline\_view\_movement.py. | 449 When in doubt, err on the inclusive side, as one never knows which information is needed in the future. Most of these metrics are necessary for post-processing scripts such as timeline\_view\_movement.py. % Brecht: should perhaps list somewhere what metrics are required for which analysis scripts. |
451 | 450 |
452 \subsubsection{Time test duration} | 451 \subsubsection{Time test duration} |
453 \texttt{testTimer}\\ | 452 \texttt{testTimer}\\ |
454 One per test page. Presents the total test time from the first playback on the test page to the submission of the test page (exculding test time of the pre-/post- test surveys). This is presented in the results as \texttt{<metricresult id="testTime"> 8.60299319727892 </metricresult>}. The time is in seconds. | 453 One per test page. Presents the total test time from the first playback on the test page to the submission of the test page (exculding test time of the pre-/post- test surveys). This is presented in the results as \texttt{<metricresult id="testTime"> 8.60299319727892 </metricresult>}. The time is in seconds. |
455 | 454 |
535 \begin{lstlisting} | 534 \begin{lstlisting} |
536 <navigator> | 535 <navigator> |
537 <platform>MacIntel</platform> | 536 <platform>MacIntel</platform> |
538 <vendor>Google Inc.</vendor> | 537 <vendor>Google Inc.</vendor> |
539 <uagent>Mozilla/5.0 ... </uagent> | 538 <uagent>Mozilla/5.0 ... </uagent> |
539 <screen innerHeight="1900px" innerWidth="1920px"/> | |
540 </navigator> | 540 </navigator> |
541 \end{lstlisting} | 541 \end{lstlisting} |
542 | 542 |
543 \subsection{Gain} | 543 \subsection{Gain} |
544 It is possible to set the gain (in decibel) applied to the different audioelements, as an attribute of the \texttt{audioelement} nodes in the configuration XML file: | 544 It is possible to set the gain (in decibel) applied to the different audioelements, as an attribute of the \texttt{audioelement} nodes in the configuration XML file: |
545 | 545 |
546 \texttt{<audioElements url="sample-01.wav" gain="-6" id="sample01quieter" />}\\ | 546 \texttt{<audioElements url="sample-01.wav" gain="-6" id="sample01quieter" />}\\ |
547 Please note, there are no checks on this to detect if accidentaly typed in linear. | 547 Please note, there are no checks on this to detect if accidentaly typed in linear. This gain is applied \emph{after} any loudness normalisation. |
548 | 548 |
549 \subsection{Loudness} | 549 \subsection{Loudness} |
550 \label{sec:loudness} | 550 \label{sec:loudness} |
551 % automatic loudness equalisation | 551 % automatic loudness equalisation |
552 % guide to loudness.js | 552 % guide to loudness.js |
553 Each audio fragment on loading has its loudness calculated. The tool uses the EBU R 128 recommendation following the ITU-R BS.1770-4 loduness calculations to return the integreated LUFS loudness. The attribute \texttt{loudness} will set the loudness from the scope it is applied in. Applying it in the \texttt{<setup>} node will set the loudness for all test pages. Applying it in the \texttt{<page>} node will set the loudness for that page. Applying it in the \texttt{<audioelement>} node will set the loudness for that fragment. The scope is set locally, so if there is a loudness on both the \texttt{<page>} and \texttt{<setup>} nodes, that test page will take the value associated with the \texttt{<page>}. The loudness attribute is set in LUFS | 553 Each audio fragment on loading has its loudness calculated. The tool uses the EBU R 128 recommendation following the ITU-R BS.1770-4 loduness calculations to return the integreated LUFS loudness. The attribute \texttt{loudness} will set the loudness from the scope it is applied in. Applying it in the \texttt{<setup>} node will set the loudness for all test pages. Applying it in the \texttt{<page>} node will set the loudness for that page. Applying it in the \texttt{<audioelement>} node will set the loudness for that fragment. The scope is set locally, so if there is a loudness on both the \texttt{<page>} and \texttt{<setup>} nodes, that test page will take the value associated with the \texttt{<page>}. The loudness attribute is set in LUFS |
554 | |
555 \subsection{Comment Boxes} | |
556 \label{sec:commentboxes} | |
557 There are two types of comment boxes which can be presented, those linked to the audio fragments on the page and those which pose a general question. The audio fragment boxes are shown by setting the attribute \texttt{showElementComments} to true of the page in question. This will then show a comment box below the main interface for every fragment on the page. There is some customisation around the text that accompanies the box, by default the text will read "Comment on fragment " followed by the fragment identifier (the number / letter shown by the interface). This 'prefix' can be modified using the page node \texttt{<commentboxprefix>}, see \ref{sec:page} for where to place this node in the document. The comment box prefix node takes no attribute and the text contained by the node represents to the prefix. For instance if we have a node \texttt{<commentboxprefix> Describe fragment </commentboxprefix>}, then the interface will show "Describe fragment " followed by the identifier. | |
558 | |
559 The second type of comment box is slightly more complex because it can handle different types of response data. These are called comment questions because they are located in the comment section of the test but pose a specific question. | |
554 | 560 |
555 \clearpage | 561 \clearpage |
556 | 562 |
557 | 563 |
558 \section{Using the test create tool} | 564 \section{Using the test create tool} |