comparison docs/SMC15/smc2015template.tex @ 228:ec0eb2da8dc0

SMC Paper: increased XML size, condensed XML content and rest of paper.
author Brecht De Man <b.deman@qmul.ac.uk>
date Fri, 19 Jun 2015 12:21:05 +0100
parents 927f53b0eda8
children b04f0c228093
comparison
equal deleted inserted replaced
227:927f53b0eda8 228:ec0eb2da8dc0
14 \setitemize{noitemsep,topsep=0pt,parsep=0pt,partopsep=0pt} 14 \setitemize{noitemsep,topsep=0pt,parsep=0pt,partopsep=0pt}
15 15
16 16
17 17
18 \usepackage{color} 18 \usepackage{color}
19 \definecolor{gray}{rgb}{0.4,0.4,0.4} 19 \definecolor{grey}{rgb}{0.1,0.1,0.1}
20 \definecolor{darkblue}{rgb}{0.0,0.0,0.6} 20 \definecolor{darkblue}{rgb}{0.0,0.0,0.6}
21 \definecolor{cyan}{rgb}{0.0,0.6,0.6} 21 \definecolor{cyan}{rgb}{0.0,0.6,0.6}
22 22
23 23
24 \hyphenation{Java-script} 24 \hyphenation{Java-script}
296 296
297 \lstset{ 297 \lstset{
298 basicstyle=\ttfamily, 298 basicstyle=\ttfamily,
299 columns=fullflexible, 299 columns=fullflexible,
300 showstringspaces=false, 300 showstringspaces=false,
301 commentstyle=\color{gray}\upshape 301 commentstyle=\color{grey}\upshape
302 } 302 }
303 303
304 \lstdefinelanguage{XML} 304 \lstdefinelanguage{XML}
305 { 305 {
306 morestring=[b]", 306 morestring=[b]",
310 identifierstyle=\color{darkblue} \bfseries, 310 identifierstyle=\color{darkblue} \bfseries,
311 keywordstyle=\color{cyan} \bfseries, 311 keywordstyle=\color{cyan} \bfseries,
312 morekeywords={xmlns,version,type}, 312 morekeywords={xmlns,version,type},
313 breaklines=true% list your attributes here 313 breaklines=true% list your attributes here
314 } 314 }
315 \tiny 315 \scriptsize
316 \lstset{language=XML} 316 \lstset{language=XML}
317 317
318 \begin{lstlisting} 318 \begin{lstlisting}
319 <?xml version="1.0" encoding="utf-8"?> 319 <?xml version="1.0" encoding="utf-8"?>
320 <BrowserEvalProjectDocument> 320 <BrowserEvalProjectDocument>
344 <title>Example Test Question</title> 344 <title>Example Test Question</title>
345 <scale position="0">Min</scale> 345 <scale position="0">Min</scale>
346 <scale position="100">Max</scale> 346 <scale position="100">Max</scale>
347 <commentBoxPrefix>Comment on fragment</commentBoxPrefix> 347 <commentBoxPrefix>Comment on fragment</commentBoxPrefix>
348 </interface> 348 </interface>
349 <audioElements url="0.wav" id="elem0"/>
350 <audioElements url="1.wav" id="elem1"/> 349 <audioElements url="1.wav" id="elem1"/>
351 <audioElements url="2.wav" id="elem2"/> 350 <audioElements url="2.wav" id="elem2"/>
352 <audioElements url="3.wav" id="elem3"/> 351 <audioElements url="3.wav" id="elem3"/>
353 <CommentQuestion id="generalExperience" type="text">General Comments</CommentQuestion> 352 <CommentQuestion id="generalExperience" type="text">General Comments</CommentQuestion>
354 <PreTest/> 353 <PreTest/>
359 </BrowserEvalProjectDocument> 358 </BrowserEvalProjectDocument>
360 359
361 \end{lstlisting} 360 \end{lstlisting}
362 361
363 \normalsize 362 \normalsize
363 \vspace{-1em}
364 364
365 \subsection{Setup and configurability} 365 \subsection{Setup and configurability}
366 366
367 The setup document has several defined nodes and structure which are documented with the source code. For example, there is a section for general setup options where any pre-test and post-test questions and statements can be defined. Pre- and post-test dialogue boxes allow for comments or questions to be presented before or after the test, to convey listening test instructions, and gather information about the subject, listening environment, and overall experience of the test. In the example set up document above, a question box with the id `location' is added, which is set to be mandatory to answer. The question is in the PreTest node meaning it will appear before any testing will begin. When the result for the entire test is shown, the response will appear in the PreTest node with the id `location' allowing it to be found easily, provided the id values are meaningful. 367 The setup document has several defined nodes and structure which are documented with the source code. For example, there is a section for general setup options where any pre-test and post-test questions and statements can be defined. Pre- and post-test dialogue boxes allow for comments or questions to be presented before or after the test, to convey listening test instructions, and gather information about the subject, listening environment, and overall experience of the test. In the example set up document above, a question box with the id `location' is added, which is set to be mandatory to answer. The question is in the PreTest node meaning it will appear before any testing will begin. When the result for the entire test is shown, the response will appear in the PreTest node with the id `location' allowing it to be found easily, provided the id values are meaningful.
368 368
396 396
397 \subsection{Results} 397 \subsection{Results}
398 398
399 The results file is dynamically generated by the interface upon clicking the `Submit' button. This also executes checks, depending on the setup file, to ensure that all tracks have been played back, rated and commented on. The XML output returned contains a node per fragment and contains both the corresponding marker's position and any comments written in the associated comment box. The rating returned is normalised to be a value between 0 and 1, normalising the pixel representation of different browser windows. The results also contain information collected by any defined pre/post questions. An excerpt of an output file is presented below detailing the data collected for a single audioElement. 399 The results file is dynamically generated by the interface upon clicking the `Submit' button. This also executes checks, depending on the setup file, to ensure that all tracks have been played back, rated and commented on. The XML output returned contains a node per fragment and contains both the corresponding marker's position and any comments written in the associated comment box. The rating returned is normalised to be a value between 0 and 1, normalising the pixel representation of different browser windows. The results also contain information collected by any defined pre/post questions. An excerpt of an output file is presented below detailing the data collected for a single audioElement.
400 400
401 \tiny 401 \scriptsize
402 \lstset{language=XML} 402 \lstset{language=XML}
403 403
404 \begin{lstlisting} 404 \begin{lstlisting}
405 <browserevaluationresult> 405 <browserevaluationresult>
406 <datetime> 406 <datetime>
411 <comment id="location">Control Room</comment> 411 <comment id="location">Control Room</comment>
412 </pretest> 412 </pretest>
413 <audioholder> 413 <audioholder>
414 <pretest></pretest> 414 <pretest></pretest>
415 <posttest> 415 <posttest>
416 <comment id="songGenre">Alternative-Rock</comment> 416 <comment id="songGenre">Pop</comment>
417 </posttest> 417 </posttest>
418 <metric> 418 <metric>
419 <metricresult id="testTime">813.328</metricresult> 419 <metricresult id="testTime">813.32</metricresult>
420 </metric> 420 </metric>
421 <audioelement id="elem0"> 421 <audioelement id="elem1">
422 <comment> 422 <comment>
423 <question>Comment on track 0</question> 423 <question>Comment on track 1</question>
424 <response>Like the reverb length and style, however Vocals get lost in the mix.</response> 424 <response>Good, but vocals too quiet.</response>
425 </comment> 425 </comment>
426 <value>0.639010989010989</value> 426 <value>0.639010989010989</value>
427 <metric> 427 <metric>
428 <metricresult id="elementTimer">111.05066666666663</metricresult> 428 <metricresult id="elementTimer">111.05</metricresult>
429 <metricresult id="elementTrackerFull"> 429 <metricresult id="elementTrackerFull">
430 <timepos id="0"> 430 <timepos id="0">
431 <time>61.602666666666664</time> 431 <time>61.60</time>
432 <position>0.639010989010989</position> 432 <position>0.6390</position>
433 </timepos> 433 </timepos>
434 </metricresult> 434 </metricresult>
435 <metricresult id="elementInitialPosition">0.6571428571428571</metricresult> 435 <metricresult id="elementInitialPosition">0.6571</metricresult>
436 <metricresult id="elementFlagListenedTo">true</metricresult> 436 <metricresult id="elementFlagListenedTo">true</metricresult>
437 <metricresult id="elementFlagMoved">true</metricresult>
438 </metric> 437 </metric>
439 </audioelement> 438 </audioelement>
440 </audioHolder> 439 </audioHolder>
441 </browserevaluationresult> 440 </browserevaluationresult>
442 441
443 \end{lstlisting} 442 \end{lstlisting}
444 443
445 \normalsize 444 \normalsize
446 445 \vspace{-.5em}
447 Each page of testing is returned with the results of the entire page included in the structure. One \texttt{audioelement} node is created per audio fragment per page, along with its ID. This includes several child nodes including the rating between 0 and 1, the comment, and any other collected metrics including how long the element was listened for, the initial position, boolean flags if the element was listened to, if the element was moved and if the element comment box had any comment. Furthermore, each user action (manipulation of any interface element, such as playback or moving a marker) can be logged along with a the corresponding time code. 446 Each page of testing is returned with the results of the entire page included in the structure. One \texttt{audioelement} node is created per audio fragment per page, along with its ID. This includes several child nodes including the rating between 0 and 1, the comment, and any other collected metrics including how long the element was listened for, the initial position, and boolean flags showing if the element was listened to, moved and commented on. Furthermore, each user action (manipulation of any interface element, such as playback or moving a marker) can be logged along with a the corresponding time code.
448 We also store session data such as the time the test took place and the duration of the test. 447 We also store session data such as the time the test took place and the duration of the test.
449 We provide the option to store the results locally, and/or to have them sent to a server. 448 We provide the option to store the results locally, and/or to have them sent to a server.
450 449
451 %Here is an example of the set up XML and the results XML: % perhaps best to refer to each XML after each section (set up <> results) 450 %Here is an example of the set up XML and the results XML: % perhaps best to refer to each XML after each section (set up <> results)
452 % Should we include an Example of the input and output XML structure?? --> Sure. 451 % Should we include an Example of the input and output XML structure?? --> Sure.