Mercurial > hg > soundsoftware-icassp-2012
changeset 11:84ad0fe93204
survey results (work in progress)
author | luisf <luis.figueira@eecs.qmul.ac.uk> |
---|---|
date | Thu, 22 Sep 2011 14:35:17 +0100 |
parents | 307c07c337ce |
children | 56a6379e7718 |
files | survey_appendix.tex |
diffstat | 1 files changed, 67 insertions(+), 2 deletions(-) [+] |
line wrap: on
line diff
--- a/survey_appendix.tex Thu Sep 22 12:33:50 2011 +0100 +++ b/survey_appendix.tex Thu Sep 22 14:35:17 2011 +0100 @@ -1,7 +1,72 @@ +In October 2010 we opened an online survey, advertised to a +number of senior researchers in other groups around the UK. This +survey asked for detailed information about the software usage and authorship practices of +researchers, with the aim of obtaining a number of individual case +points for further examination as well as some broad numerical +results. The survey, started in November 2010, closed in April 2011, +with 54 complete and 23 partially complete responses. There were +responses from at least 16 different institutions. + + +\subsection{Software Development} + +Our survey shows that 66,6\% of researchers use more than one OS. Linux isn’t +used as a single operating system by anybody, which seems to indicate +that most Linux users use it for multi-platform developing or for +specific software needs. SuperCollider, Android SDK/NDK, NET, PRAAT (Speech Researcher), CUDA-C +(GPU Programming), Clojure, Presentation, R. + +Most researchers (56\%) use version control. This kind of system is +more widely used by PHD students and Postdocs/Research +Assistants. When asked for what kind of technologies were used, SVN +(14) and GIT (7) were the most popular systems. CVS (5) and Mercurial +(4) were the other available options. Many users use more than one of +these systems simultaneously. + +When asked for the usage of code hosting services, 52\% of the researchers +said their code stayed in their computers. The most used third-party +source code hosting services is SourceForge (6 users). 10 users are +using university source code version control tools. \textit{remove + numbers, only leave percentages} + +27 users do not produce or maintain software. 16 do, while 11 did not +answer. \textit{percentages\ldots} + +Most users (57\%) do not plan to make any software available. + +When asked “Do you develop any software that you do not intend to +publish?”, 52\% of the users answered no. Possible commercial use is +the main justification given for not publishing the software at this +point. + +\subsection{Reproducible Research} + +Most researchers (56\%) acknowledge they don't take the necessary +steps to ensure sustainable and reproducible research. Many do not +understand the concept of reproducible research. By analyzing this +accordingly to the current position, we can see that PhD students are +the ones that are less aware of the importance of reproducible +research (even the ones that are almost finishing their PhD). + +Many of the researchers that ensure they do the steps necessary to +reproducibility say they only give the code and/or data to interested +researchers. Some researchers also say that they publish their code in +their own pages. At the same time, there are indications that this +procedure can lead to unsustainability itself. Many researchers +complain about the amount of time and/or complexity of making research +reproducible. Also many of them make only parts of their work +available. Some researchers also complain about copyright issues in +releasing data. + +Many researchers do not understand the full concept of +reproducibility. Some assume that explaining the algorithm and the +tools used is enough for other researchers to be able to reproduce +their results. Finally, some typical (but not widely admitted) answers +justify the decision not to embrace reproducibility due to messy code +or code/data protection: + %%% Local Variables: %%% mode: latex %%% TeX-master: "cannam" %%% End: - -This is the appendix. \ No newline at end of file