[Rdap] I give up

Mark Conrad mark.conrad at nara.gov
Thu Jun 2 09:09:32 EDT 2016


You mentioned that this is an NSF project. Where did the project tell the
NSF they would store the data in the Data Management Plan they submitted
with their proposal?

Mark Conrad
NARA Information Services
IAS
The National Archives and Records Administration
Erma Ora Byrd Conference and Learning Center
Building 494, Room 225
610 State Route 956
Rocket Center, WV  26726

Phone: 304-726-7820
Fax: 304-726-7802
Email: mark.conrad at nara.gov


On Thu, Jun 2, 2016 at 8:23 AM, Jonathan Petters <jpetter1 at jhu.edu> wrote:

> Daureen et al.,
>
>
>
> Another option in making such a large amount of data (100s of GB)
> accessible is for the research group to create a directory or partition
> locally from which they can grant access to the data sets.  This way
> interested parties (presuming there are not a LOT of them) can access the
> data close to the systems on which they were created.  This would sidestep
> the issue of serving up a large amount of data and the potential transfer
> issues that can go with it.
>
>
>
> Going this route might require the assistance of an IT rep to make sure
> permissions and security are handled appropriately.  Just another option to
> consider!
>
>
>
> Jon
>
>
>
> Jonathan Petters, Ph.D.
>
> Data Management Consultant
>
> JHU Data Management Services
>
> http://dmp.data.jhu.edu/
>
> (410) 516-5957
>
>
>
>
>
>
>
> *From:* Rdap [mailto:rdap-bounces at asis.org] *On Behalf Of *Imker, Heidi J
> *Sent:* Thursday, June 02, 2016 7:58 AM
> *To:* Research Data, Access and Preservation
> *Subject:* Re: [Rdap] I give up
>
>
>
> Hi Daureen and all,
>
>
>
> There is academic torrents for sharing large data files:
> http://academictorrents.com/
>
>
>
> We don't have any experience using it here so sorry to say we can't vouch
> for it but worth looking into.  It's not a repo in the preservation sense
> but at least can get the data shared ...
>
>
>
> Good luck!
>
>
>
> Heidi
>
> Sent from my iPhone
>
>
> On Jun 1, 2016, at 11:04 PM, Mike Smit <Mike.Smit at dal.ca> wrote:
>
> GitHub was my first thought as well, but GitHub caps regular files to
> <100MB, and files uploaded using its Large Files protocol to 2GB. I believe
> this is due to the challenge of versioning large files, as opposed to
> storage limits, so one could try uploading 1000 1GB files.  I suspect this
> would attract GitHub's attention in a not-very-positive way.  (git as a
> tool requires free storage space equal to used storage space, so 2TB of
> disk would be required: $60/month at market cloud rates).
>
>
>
> I would suggest that for data generated by software, that the "right"
> approach is to release the software, ideally open-source, with appropriate
> documentation for re-generating that data.  Unless the data generation time
> period is measured in weeks, months, or years, that would require less
> resources over time than storing and serving large data files. CPU time is
> cheap compared to data transfer prices.
>
>
>
> Computer science is a pretty broad area - there are repositories, but they
> are more focused than the discipline (e.g. machine learning repositories).
>
>
>
> Has anyone built a data repository that distributes files using
> BitTorrent? That's the kind of thing a computer scientist would get excited
> about.
>
>
>
> Cheers,
>
>
>
> Mike
>
>
>
>
>
> ----------------------------------------------------
> Dr. Mike Smit
> Assistant Professor
> School of Information Management
> Faculty of Management
> Dalhousie University, Halifax, NS
>
> Mike.Smit at dal.ca  //  902-494-1901
> ----------------------------------------------------
>
>
>
>
>
> On Wednesday, 1 June 2016, Daureen Nesdill <daureen.nesdill at utah.edu>
> wrote:
>
> Hmmm. The student said he had checked Github and the 1 TB is an issue.
>
>
>
> I finally went to IEEE looking for information and learned about Tera
> Promise http://openscience.us/repo/
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__openscience.us_repo_&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=nmZ6V9zMf1c3Gsq1YITSw8koQFE7vmr1nSO44muZZYQ&e=>
>
> and other open science possibilities.
> http://openscience.us/other/index.html
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__openscience.us_other_index.html&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=L6dhsT2jvIQaiY8nHLILUhWyFD3S6gPa52oeg10tZlY&e=>
>
>
>
> Thanks for the reminder about export control restrictions
>
>
>
> Daureen
>
>
>
> *From:* Rdap [rdap-bounces at asis.org] on behalf of Pouchard, Line C [
> pouchard at purdue.edu]
>
> *Sent:* Wednesday, June 01, 2016 5:31 PM
> *To:* Research Data, Access and Preservation
> *Subject:* Re: [Rdap] I give up
>
> Daureen:
>
>
>
> Has the student tried Github?  It has a publication workflow where the
> data is uploaded to zenodo and acquires a DOI.
>
>
>
> It's not exactly a computer science repository but it might work for his
> purposes.
>
>
>
> As zenodo is in the EU, there might be export control restrictions on
> cyber security data.
>
>
>
> Line
>
>
> Sent from my iPhone
>
> Line Pouchard, PhD
>
> Purdue University Libraries
>
>
> On Jun 1, 2016, at 7:14 PM, Daureen Nesdill <daureen.nesdill at utah.edu
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__redir.aspx-3FREF-3De0aoAaOHirdbAJ3jnKKeZZPhhCtqzR8AC1nyRg4ctQzYmGOYl4rTCAFtYWlsdG86ZGF1cmVlbi5uZXNkaWxsQHV0YWguZWR1&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=mOgN3yuxtHUSOTysCR4FqST6kmKc9tlGkCXMva97yqw&e=>>
> wrote:
>
> Hi,
>
> I have a graduate student in computer science requesting me to find him a
> data repository for his research data. The article has already been
> published and folks are asking to see the data. The data is in a text
> format and 1 terabyte uncompressed; compressed it is 100-200 GB. He
> developed software that used other software to generate the data. It is a
> test of security issues with androids. He tells me his colleagues are
> waiting to see where he put his data because no one knows what to do. This
> project is NSF supported.
>
>
>
> I’ve looked through re3data and conducted a few google searches with no
> luck. Does anyone have any information about data repositories for computer
> science?
>
>
>
> Thanks for any assistance,
>
> Daureen
>
>
>
>
>
>
>
> Daureen Nesdill, MS, MLIS
>
> Research Data Management Librarian
>
> The Faculty Center @ the J. W. Marriott Library
>
> University of Utah
>
> 801-585-5975
>
> daureen.nesdill at utah.edu
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__redir.aspx-3FREF-3De0aoAaOHirdbAJ3jnKKeZZPhhCtqzR8AC1nyRg4ctQzYmGOYl4rTCAFtYWlsdG86ZGF1cmVlbi5uZXNkaWxsQHV0YWguZWR1&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=mOgN3yuxtHUSOTysCR4FqST6kmKc9tlGkCXMva97yqw&e=>
>
> ORCID http://orcid.org/0000-0003-0126-5038
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__redir.aspx-3FREF-3D5Ga5KW1Xbm1OQSDP41wirJ1rMsXLgks26dDYa5-5FCLKTYmGOYl4rTCAFodHRwOi8vb3JjaWQub3JnLzAwMDAtMDAwMy0wMTI2LTUwMzg.&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=O7-KkE9iGozv0o70HSV8oL8tDs921OK7NXKGL4AXrlk&e=>
>
> <image001.jpg>
>
>
>
>
>
> _______________________________________________
> Rdap mailing list
> Rdap at mail.asis.org
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__redir.aspx-3FREF-3DG83i-5FfKLifWY3SLLuTZogC4rvmqYRfRM3JNIfd5Nq1HYmGOYl4rTCAFtYWlsdG86UmRhcEBtYWlsLmFzaXMub3Jn&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=hrfReg51MCu4OKqBp8isMOX-l4vzRxycAtcyyqediDE&e=>
> http://mail.asis.org/mailman/listinfo/rdap
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__redir.aspx-3FREF-3DNgcPYnmQKHpmUWClB5qhiNsgWC-5FwVQchLngJRhDbmL7YmGOYl4rTCAFodHRwOi8vbWFpbC5hc2lzLm9yZy9tYWlsbWFuL2xpc3RpbmZvL3JkYXA.&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=rWiDMAQcwQGJZqEEdGbD0XYoLalRxdCZmQi2qEXjQ1s&e=>
>
> _______________________________________________
> Rdap mailing list
> Rdap at mail.asis.org
> http://mail.asis.org/mailman/listinfo/rdap
>
>
> _______________________________________________
> Rdap mailing list
> Rdap at mail.asis.org
> http://mail.asis.org/mailman/listinfo/rdap
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.kunverj.com/pipermail/rdap/attachments/20160602/bc3484d5/attachment.html>


More information about the RDAP mailing list