[Rdap] Very large files in DataVerse

[Jonathan Petters]

Eugene:


I can suggest one workaround approach to ingesting >2GB size files into Dataverse that may work for you (and others using DVN).



Our system administrator found that you can upload a dummy file to Dataverse (e.g. near zero bytes), turn off Dataverse, and then move the large file (e.g. >2GB) into the same location and name as the dummy file within the database at the back-end of Dataverse.  After modifying the checksum for the file in the database (back-end again) and turning Dataverse back on, Dataverse will then recognize the larger file and make it available for download.

It requires a little comfortability with the inner workings of databases, but I hope that helps you and others looking for ways to make large files accessible through DVN!

Jon

Jonathan Petters, Ph.D.
Data Management Consultant
JHU Data Management Services
The Sheridan Libraries
http://dmp.data.jhu.edu/
(410) 516-5957

********************************

From: Eugene Barsky <eugene.barsky at ubc.ca<mailto:eugene.barsky at ubc.ca>>
Date: Fri, Sep 19, 2014 at 4:29 PM
Subject: [Rdap] Very large files in DataVerse
To: rdap at mail.asis.org<mailto:rdap at mail.asis.org>
Greetings from rainy Vancouver:

Not sure whether this is the right place to ask this question, but I will try:
We are working with our campus colleagues to open UBC MOOC data via our DataVerse instance - http://dvn.library.ubc.ca. The problem is that these files are really big, more than 10GB each.
We could split these with a zip software of even with Linux commands, however, we are wondering whether anyone has experience working with really big files in DataVerse.
If yes, we would love to chat!
Thank you!
Eugene
---
Eugene Barsky <http://directory.library.ubc.ca/people/view/622>
Research Data Management Librarian
University of British Columbia
http://researchdata.library.ubc.ca/  <http://researchdata.library.ubc.ca/>
---
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.kunverj.com/pipermail/rdap/attachments/20140923/977a14e9/attachment.html>