Mercurial > hg > soundsoftware-icassp-2012

--- a/Makefile	Wed Sep 21 11:23:07 2011 +0100
+++ b/Makefile	Wed Sep 21 13:27:27 2011 +0100
@@ -1,5 +1,4 @@
 all: cannam.pdf

-cannam.pdf: cannam.tex
-	echo | pdflatex $<
-
+cannam.pdf: cannam.tex refs.bib
+	pdflatex cannam && bibtex cannam && pdflatex cannam && pdflatex cannam
--- a/cannam.tex	Wed Sep 21 11:23:07 2011 +0100
+++ b/cannam.tex	Wed Sep 21 13:27:27 2011 +0100
@@ -55,31 +55,107 @@
 \subsection{Reproducible Research}
 \label{subsec:rr}

-\section{Philosophy}
+Some researchers have come to realize that the traditional methods of
+disseminating research outputs are no longer sufficient for
+computational science research. Algorithms are often so complex and
+the number of parameters so varied that the description in the paper
+is in many cases no longer sufficient for other scientists to
+reproduce the published results.  Dohono and colleagues at Stanford
+have, since the mid 1990’s, aimed to carry out ``Reproducible
+Research'' by providing the paper, source code and data, sufficient
+for other researchers to reproduce the same results
+\cite{buckheit1995}.  The last few years have seen some moves to
+promote this philosophy across the signal processing research
+community. A special session was organised at the ICASSP 2007
+international signal processing conference, and special issues of IEEE
+Signal Processing Magazine and Computing in Science and Engineering
+concerning this subject both appeared in 2009
+\cite{vandewalle2009}. The IEEE Signal Processing society now
+encourages Reproducible Research, allowing links from the online
+journal repository IEEEXplore to the code and data so that other
+researchers can reproduce the results. Actions such as these promote
+the idea that research results in signal processing should be
+presented not simply as a printed paper, but as a compendium including
+the paper, research data, and code.  Vandewalle et al have also
+created a Reproducible Research Repository (http://rr.epfl.ch/),
+designed to promote reproducible research by requiring the authors of
+a paper to upload the code and data used in the experiments. Readers
+can also give comments about a publication and evaluate the
+reproducibility of the work.
+
+\subsection{Current practice in UK audio and music research}
+\label{subsec:current}
+
+Although the Reproducible Research principle suggests a comprehensive
+solution to the reproducibility problem, in practice take-up in this
+field is limited.  Undertaking reproducible research needs additional
+effort to adopt the philosophy at an early stage and can be perceived
+as delaying the production of ``real'' research. Once research results
+have been produced and a paper written, there is little apparent
+incentive to make the research reproducible. In practice, it appears
+that most researchers in the audio and music area do not carry out
+reproducible research and many are unfamiliar with the concept.  In
+our survey of UK audio and music researchers \cite{ssamrsurvey}, the
+majority of respondents said either that they took no steps to ensure
+reproducible research, or that they only made code or data available
+on request.  Obstacles cited included ``lack of time'', ``copyright
+restrictions'', and ``potential commercial use'' of the code.  In
+addition to these, a broader case study by the UK Research Information
+Network into science research across several subject areas also
+identified ``lack of evidence of benefits'', ``cultures of
+independence and competition'' and ``concerns about quality'' as
+typical inhibiting factors \cite{rin2010}.
+
+\section{Our approach}
 \label{sec:philosophy}

-\subsection{Sustainable software from the ground up}
+\subsection{Sustainable software: a bottom-up approach}
 \label{subsec:groundup}

-\section{Our approach}
-\label{sec:approach}
+\section{Our work so far}
+\label{sec:sofar}

-\subsection{SoundSoftware and Software Carpentry Autumn School 2010}
+\subsection{SoundSoftware/Software Carpentry Autumn School}
 \label{subsec:autumnschool}

 \subsection{SoundSoftware Code Site}
 \label{subsec:codesite}

+\subsubsection{Public and private projects}
+\subsubsection{Linking publications with code}
+\subsubsection{Tracking external projects}
+
 \subsection{Version control and EasyMercurial}
 \label{subsec:easyhg}

 \subsection{Software developer engagement: case studies}
 \label{subsec:engagement}

-\subsubsection{Sonic Visualiser}
+\subsubsection{Sonic Visualiser and Vamp Plugins}
 \label{subsubsec:sv}
+
+Sonic Visualiser was developed at the Centre for Digital Music from
+2005 onwards as a visualisation and analysis tool for audio
+recordings, particularly of music \cite{cannam2006}.  Noting the lack
+of a modular way to release audio analysis methods for use by the
+general public, in 2006 we developed the Vamp plugin system
+\cite{vamp} and implemented it in Sonic Visualiser and the subsequent
+Sonic Annotator \cite{cannam2010}.  The Vamp system has since been
+used by the Centre and others with some success for publishing working
+methods.
+
+%%% (The above gives context for the following, but is perhaps not ideally placed)
+
+\subsubsection{Chordino and NNLS Chroma}
+\label{subsubsec:chordino}
+
+\cite{mauch2010}
+
+% Note that in this case the author did _not_ follow a RR methodology, and the code is not referred to in the paper.  The link between code and publication must be made after the fact.
+
 \subsubsection{AIM}
 \label{subsubsec:aim}
+
 \subsubsection{AudioDB}
 \label{subsubsec:audiodb}

@@ -132,6 +208,6 @@
 % style file from IEEE produces unsorted bibliography list.
 % -------------------------------------------------------------------------
 \bibliographystyle{IEEEbib}
-\bibliography{strings,refs}
+\bibliography{refs}

 \end{document}
--- /dev/null	Thu Jan 01 00:00:00 1970 +0000
+++ b/refs.bib	Wed Sep 21 13:27:27 2011 +0100
@@ -0,0 +1,92 @@
+@InProceedings{dixon2005,
+  author = {S. Dixon and G. Widmer},
+  title = "{MATCH: A Music Alignment Tool Chest}",
+  booktitle = {6th International Conference on Music Information
+                  Retrieval},
+  pages = {492--497},
+  year = {2005},
+  OPTeditor = {},
+  address = {London, England},
+  month = {September},
+  OPTnote = {},
+  OPTannote = {}
+}
+
+@inproceedings{cannam2006,
+  author = {C. Cannam and
+               C. Landone and
+               M. B. Sandler and
+               J. P. Bello},
+  title = {The Sonic Visualiser: A Visualisation Platform for Semantic
+               Descriptors from Musical Signals},
+  booktitle = {Proc. International Symposium on Music Information
+                  Retrieval},
+  year = {2006},
+  pages = {324--327},
+}
+
+@misc{vamp,
+  author = {C. Cannam},
+  title = {The Vamp Audio Analysis Plugin API: A Programmer's Guide},
+year = {2007},
+howpublished = {http://vamp-plugins.org/guide.pdf}
+}
+
+@InProceedings{tidhar2009,
+  author = {D. Tidhar and G. Fazekas and S. Kolozali and M. Sandler},
+  title = "{Publishing Music Similarity Features on the Semantic
+                  Web}",
+  booktitle = {Proc. ISMIR},
+  pages = {447--452},
+  year = 2009,
+  address = {Kobe, Japan},
+  month = {October}}
+
+@InProceedings{mauch2010,
+  author = {M. Mauch and S. Dixon},
+  title = {Approximate Note Transcription for the Improved Identification of Difficult Chords},
+  booktitle = {Proceedings of the 11th International Society for Music Information Retrieval Conference (ISMIR 2010)},
+  year = 2010}
+
+@techreport{buckheit1995,
+  author = {J. B. Buckheit and D. L. Donoho},
+year = 1995,
+title = {WaveLab and reproducible research},
+institution = {Stanford University}
+}
+
+@article{vandewalle2009,
+author = {P. Vandewalle and J. Kovacevic and M. Vetterli},
+year = 2009,
+title = {Reproducible Research in Signal Processing - What, why, and how},
+journal = {IEEE Signal Processing Magazine},
+volume = 26,
+number = 3,
+pages = {37-47},
+}
+
+@misc{rin2010,
+author = {Research Information Network and NESTA},
+title = {Open to All? Case studies of openness in research},
+year = 2010,
+howpublished = {http://www.rin.ac.uk/our-work/data-management-and-curation/open-science-case-studies},
+}
+
+@misc{ssamrsurvey,
+author = {I. Damnjanovic and L. Figueira and C. Cannam and M. Plumbley},
+title = {SoundSoftware.ac.uk Survey Report},
+year = 2011,
+howpublished = {http://code.soundsoftware.ac.uk/documents/17},
+}
+
+@article{cannam2010,
+author = {C. Cannam and M. O. Jewell and C. Rhodes and M. Sandler and M. d'Inverno},
+title = {Linked Data And You: Bringing music research software into the Semantic Web},
+journal = {Journal of New Music Research},
+number = 4,
+volume = 39,
+pages = {313-325},
+year = 2010,
+}
+
+