Wiki » History » Version 3

Steve Welburn, 2012-10-26 06:52 PM

1 1 Steve Welburn
h1. Wiki
2 1 Steve Welburn
3 1 Steve Welburn
NB: All this may be superceded by more recent versions of DataStage, DSpace and the SWORDv2 server!
4 1 Steve Welburn
5 3 Steve Welburn
According to Marco's "blog post":http://rdm.c4dm.eecs.qmul.ac.uk/datastage-and-dspace it looks as though a specific ingester isn't necessary, but could be used to process the manifest.rdf to add metadata.
6 1 Steve Welburn
7 2 Steve Welburn
h2. DataStage under Virtualbox
8 2 Steve Welburn
9 1 Steve Welburn
The DataStage server doesn't start properly in VirtualBox. In order to submit files, it is necessary to:
10 1 Steve Welburn
<pre>
11 1 Steve Welburn
sudo datastage-server stop
12 1 Steve Welburn
sudo datastage-server start
13 1 Steve Welburn
</pre>
14 1 Steve Welburn
15 1 Steve Welburn
h2. SWORDv2 Server
16 1 Steve Welburn
17 1 Steve Welburn
If using DSpace 1.8.2, the java swordv2 server library (/system/webapps/swordv2/WEB-INF/server-2.0-classes.jar) MUST be removed and substituted with the latest version from https://github.com/swordapp/JavaServer2.0 .
18 1 Steve Welburn
19 1 Steve Welburn
h2. Tomcat configuration
20 2 Steve Welburn
21 1 Steve Welburn
Tomcat ran out of "permanent generation":http://blogs.oracle.com/jonthecollector/entry/presenting_the_permanent_generation memory when using SWORD interface - this was then updated in tomcat6.comf by adding:
22 1 Steve Welburn
23 1 Steve Welburn
<pre>
24 1 Steve Welburn
JAVA_OPTS = "-XX:MaxPermSize=256m"
25 1 Steve Welburn
</pre>
26 1 Steve Welburn
27 1 Steve Welburn
h2. "DataStage":http://rdm.c4dm.eecs.qmul.ac.uk/datastage-and-dspace
28 1 Steve Welburn
29 1 Steve Welburn
To work with C4DM's DSpace the way SWORDUPLOADER works, changes are required to the file (Datastage version 0.3rc2): /usr/lib/python2.6/dist-packages/datastage/dataset/sword2depositor.py .
30 1 Steve Welburn
31 1 Steve Welburn
At line 66, it should read:
32 1 Steve Welburn
<pre>
33 1 Steve Welburn
receipt = conn.create(col_iri=col.href, metadata_entry=e, suggested_identifier=dataset.identifier,in_progress=True)
34 1 Steve Welburn
</pre>
35 1 Steve Welburn
36 1 Steve Welburn
Around line 133, should read:
37 1 Steve Welburn
<pre>
38 1 Steve Welburn
new_receipt = comm.update(dr = receipt,
39 1 Steve Welburn
                         payload=data,
40 1 Steve Welburn
                         mimetype="application/zip",
41 1 Steve Welburn
                         filename=dataset.identifier + "zip",
42 1 Steve Welburn
                         in_progress=True,
43 1 Steve Welburn
                         packaging='http://dataflow.ox.ac.uk/package/DataBankBagIt')
44 1 Steve Welburn
</pre>
45 1 Steve Welburn
46 1 Steve Welburn
With these changes, it should be possible to upload files to DSpace AS CONFIGURED AT C4DM! The modified file can be downloaded from "here":https://code.soundsoftware.ac.uk/attachments/446/sword2depositor.py