comparison docs/Instructions/Instructions.tex @ 494:95b6a39160fa Dev_main

More instructions. Added comment box sections. Still wip.
author Nicholas Jillings <n.g.r.jillings@se14.qmul.ac.uk>
date Wed, 27 Jan 2016 09:49:42 +0000
parents 92df95a6e95d
children 91b3c9b2e847
comparison
equal deleted inserted replaced
493:1fc9f982b778 494:95b6a39160fa
291 \item \texttt{<metric>}: Must appear only once. 291 \item \texttt{<metric>}: Must appear only once.
292 \item \texttt{<interface>}: Must appear only once. 292 \item \texttt{<interface>}: Must appear only once.
293 \end{itemize} 293 \end{itemize}
294 294
295 \subsection{Page} 295 \subsection{Page}
296 \label{sec:page}
296 The only other first level child nodes, these specify the test pages. It takes the following attributes: 297 The only other first level child nodes, these specify the test pages. It takes the following attributes:
297 \begin{itemize} 298 \begin{itemize}
298 \item \texttt{id}: ID, mandatory. A string which must be unique across the entire XML. It is used to identify the page on test completion as pages are returned in the results in the order they appeared, not specified. 299 \item \texttt{id}: ID, mandatory. A string which must be unique across the entire XML. It is used to identify the page on test completion as pages are returned in the results in the order they appeared, not specified.
299 \item \texttt{hostURL}: URL, mandatory. Used in conjuction with the \texttt{<audioelement>} url to specify where the audio files are located. For instance if all your files are in the directory \texttt{./test/} you can set this attribute to "/test/" and the \texttt{<audioelement>} url attribute only needs to file name. Set to "" if no hostURL prefix desired. 300 \item \texttt{hostURL}: URL, mandatory. Used in conjuction with the \texttt{<audioelement>} url to specify where the audio files are located. For instance if all your files are in the directory \texttt{./test/} you can set this attribute to "/test/" and the \texttt{<audioelement>} url attribute only needs to file name. Set to "" if no hostURL prefix desired.
300 \item \texttt{randomiseOrder}: Boolean, optional. If true the audio fragments are presented randomly rather than the order specified. See \ref{sec:randomisation}. Default is false. 301 \item \texttt{randomiseOrder}: Boolean, optional. If true the audio fragments are presented randomly rather than the order specified. See \ref{sec:randomisation}. Default is false.
308 \begin{itemize} 309 \begin{itemize}
309 \item \texttt{<title>}: Appear once or not at all. The text content of this node specifies the title of the test page, for instance \texttt{<title>John Doe's Test</title>} 310 \item \texttt{<title>}: Appear once or not at all. The text content of this node specifies the title of the test page, for instance \texttt{<title>John Doe's Test</title>}
310 \item \texttt{<commentboxprefix}: Appear once or not at all. The text content specifies the prefix of the comment boxes, see \ref{sec:commentboxes}. 311 \item \texttt{<commentboxprefix}: Appear once or not at all. The text content specifies the prefix of the comment boxes, see \ref{sec:commentboxes}.
311 \item \texttt{<interface>}: Must appear only once. 312 \item \texttt{<interface>}: Must appear only once.
312 \item \texttt{<audioelement>}: Minimum of one. Specifies an audio element, see \ref{sec:audioelement}. 313 \item \texttt{<audioelement>}: Minimum of one. Specifies an audio element, see \ref{sec:audioelement}.
313 \item \texttt{<commentquestion}: Min of 0, max unlimited occurences. See \ref{sec:commentboxes}. 314 \item \texttt{<commentquestion>}: Min of 0, max unlimited occurences. See \ref{sec:commentboxes}.
314 \item \texttt{<survey>}: Min of 0, max of 2 occurences. See \ref{sec:survey} 315 \item \texttt{<survey>}: Min of 0, max of 2 occurences. See \ref{sec:survey}
315 \end{itemize} 316 \end{itemize}
316 317
317 \subsection{Survey} 318 \subsection{Survey}
318 \label{sec:survey} 319 \label{sec:survey}
429 \subsection{Sample rate} 430 \subsection{Sample rate}
430 \label{sec:samplerate} 431 \label{sec:samplerate}
431 If you require the test to be conducted at a certain sample rate (i.e. you do not tolerate resampling of the elements to correspond with the system's sample rate), add \texttt{sampleRate="96000"} - where ``96000'' can be any support sample rate (in Hz) - so that a warning message is shown alerting the subject that their system's sample rate is different from this enforced sample rate. This is checked immediately after parsing and stops the page loading any other elements if this check has failed. 432 If you require the test to be conducted at a certain sample rate (i.e. you do not tolerate resampling of the elements to correspond with the system's sample rate), add \texttt{sampleRate="96000"} - where ``96000'' can be any support sample rate (in Hz) - so that a warning message is shown alerting the subject that their system's sample rate is different from this enforced sample rate. This is checked immediately after parsing and stops the page loading any other elements if this check has failed.
432 433
433 \subsection{Metrics} 434 \subsection{Metrics}
434 Enable the collection of metrics by adding \texttt{collectMetrics=`true'} in the \texttt{setup} node. % Should this always be on??
435
436 The \texttt{Metric} node, which contains the metrics to be tracked during the complete test, is a child of the \texttt{setup} node, and it could look as follows. 435 The \texttt{Metric} node, which contains the metrics to be tracked during the complete test, is a child of the \texttt{setup} node, and it could look as follows.
437 436
438 \begin{lstlisting} 437 \begin{lstlisting}
439 <Metric> 438 <Metric>
440 <metricEnable>testTimer</metricEnable> 439 <metricEnable>testTimer</metricEnable>
445 <metricEnable>elementFlagMoved</metricEnable> 444 <metricEnable>elementFlagMoved</metricEnable>
446 <metricEnable>elementListenTracker</metricEnable> 445 <metricEnable>elementListenTracker</metricEnable>
447 </Metric> 446 </Metric>
448 \end{lstlisting} 447 \end{lstlisting}
449 448
450 When in doubt, err on the inclusive side, as one never knows which information is needed in the future. Most of these metrics are necessary for post-processing scripts such as timeline\_view\_movement.py. 449 When in doubt, err on the inclusive side, as one never knows which information is needed in the future. Most of these metrics are necessary for post-processing scripts such as timeline\_view\_movement.py. % Brecht: should perhaps list somewhere what metrics are required for which analysis scripts.
451 450
452 \subsubsection{Time test duration} 451 \subsubsection{Time test duration}
453 \texttt{testTimer}\\ 452 \texttt{testTimer}\\
454 One per test page. Presents the total test time from the first playback on the test page to the submission of the test page (exculding test time of the pre-/post- test surveys). This is presented in the results as \texttt{<metricresult id="testTime"> 8.60299319727892 </metricresult>}. The time is in seconds. 453 One per test page. Presents the total test time from the first playback on the test page to the submission of the test page (exculding test time of the pre-/post- test surveys). This is presented in the results as \texttt{<metricresult id="testTime"> 8.60299319727892 </metricresult>}. The time is in seconds.
455 454
535 \begin{lstlisting} 534 \begin{lstlisting}
536 <navigator> 535 <navigator>
537 <platform>MacIntel</platform> 536 <platform>MacIntel</platform>
538 <vendor>Google Inc.</vendor> 537 <vendor>Google Inc.</vendor>
539 <uagent>Mozilla/5.0 ... </uagent> 538 <uagent>Mozilla/5.0 ... </uagent>
539 <screen innerHeight="1900px" innerWidth="1920px"/>
540 </navigator> 540 </navigator>
541 \end{lstlisting} 541 \end{lstlisting}
542 542
543 \subsection{Gain} 543 \subsection{Gain}
544 It is possible to set the gain (in decibel) applied to the different audioelements, as an attribute of the \texttt{audioelement} nodes in the configuration XML file: 544 It is possible to set the gain (in decibel) applied to the different audioelements, as an attribute of the \texttt{audioelement} nodes in the configuration XML file:
545 545
546 \texttt{<audioElements url="sample-01.wav" gain="-6" id="sample01quieter" />}\\ 546 \texttt{<audioElements url="sample-01.wav" gain="-6" id="sample01quieter" />}\\
547 Please note, there are no checks on this to detect if accidentaly typed in linear. 547 Please note, there are no checks on this to detect if accidentaly typed in linear. This gain is applied \emph{after} any loudness normalisation.
548 548
549 \subsection{Loudness} 549 \subsection{Loudness}
550 \label{sec:loudness} 550 \label{sec:loudness}
551 % automatic loudness equalisation 551 % automatic loudness equalisation
552 % guide to loudness.js 552 % guide to loudness.js
553 Each audio fragment on loading has its loudness calculated. The tool uses the EBU R 128 recommendation following the ITU-R BS.1770-4 loduness calculations to return the integreated LUFS loudness. The attribute \texttt{loudness} will set the loudness from the scope it is applied in. Applying it in the \texttt{<setup>} node will set the loudness for all test pages. Applying it in the \texttt{<page>} node will set the loudness for that page. Applying it in the \texttt{<audioelement>} node will set the loudness for that fragment. The scope is set locally, so if there is a loudness on both the \texttt{<page>} and \texttt{<setup>} nodes, that test page will take the value associated with the \texttt{<page>}. The loudness attribute is set in LUFS 553 Each audio fragment on loading has its loudness calculated. The tool uses the EBU R 128 recommendation following the ITU-R BS.1770-4 loduness calculations to return the integreated LUFS loudness. The attribute \texttt{loudness} will set the loudness from the scope it is applied in. Applying it in the \texttt{<setup>} node will set the loudness for all test pages. Applying it in the \texttt{<page>} node will set the loudness for that page. Applying it in the \texttt{<audioelement>} node will set the loudness for that fragment. The scope is set locally, so if there is a loudness on both the \texttt{<page>} and \texttt{<setup>} nodes, that test page will take the value associated with the \texttt{<page>}. The loudness attribute is set in LUFS
554
555 \subsection{Comment Boxes}
556 \label{sec:commentboxes}
557 There are two types of comment boxes which can be presented, those linked to the audio fragments on the page and those which pose a general question. The audio fragment boxes are shown by setting the attribute \texttt{showElementComments} to true of the page in question. This will then show a comment box below the main interface for every fragment on the page. There is some customisation around the text that accompanies the box, by default the text will read "Comment on fragment " followed by the fragment identifier (the number / letter shown by the interface). This 'prefix' can be modified using the page node \texttt{<commentboxprefix>}, see \ref{sec:page} for where to place this node in the document. The comment box prefix node takes no attribute and the text contained by the node represents to the prefix. For instance if we have a node \texttt{<commentboxprefix> Describe fragment </commentboxprefix>}, then the interface will show "Describe fragment " followed by the identifier.
558
559 The second type of comment box is slightly more complex because it can handle different types of response data. These are called comment questions because they are located in the comment section of the test but pose a specific question.
554 560
555 \clearpage 561 \clearpage
556 562
557 563
558 \section{Using the test create tool} 564 \section{Using the test create tool}