[Rdap] I give up

Imker, Heidi J imker at illinois.edu
Thu Jun 2 07:58:27 EDT 2016


Hi Daureen and all,

There is academic torrents for sharing large data files:  http://academictorrents.com/

We don't have any experience using it here so sorry to say we can't vouch for it but worth looking into.  It's not a repo in the preservation sense but at least can get the data shared ...

Good luck!

Heidi

Sent from my iPhone

On Jun 1, 2016, at 11:04 PM, Mike Smit <Mike.Smit at dal.ca<mailto:Mike.Smit at dal.ca>> wrote:

GitHub was my first thought as well, but GitHub caps regular files to <100MB, and files uploaded using its Large Files protocol to 2GB. I believe this is due to the challenge of versioning large files, as opposed to storage limits, so one could try uploading 1000 1GB files.  I suspect this would attract GitHub's attention in a not-very-positive way.  (git as a tool requires free storage space equal to used storage space, so 2TB of disk would be required: $60/month at market cloud rates).

I would suggest that for data generated by software, that the "right" approach is to release the software, ideally open-source, with appropriate documentation for re-generating that data.  Unless the data generation time period is measured in weeks, months, or years, that would require less resources over time than storing and serving large data files. CPU time is cheap compared to data transfer prices.

Computer science is a pretty broad area - there are repositories, but they are more focused than the discipline (e.g. machine learning repositories).

Has anyone built a data repository that distributes files using BitTorrent? That's the kind of thing a computer scientist would get excited about.

Cheers,

Mike


----------------------------------------------------
Dr. Mike Smit
Assistant Professor
School of Information Management
Faculty of Management
Dalhousie University, Halifax, NS
Mike.Smit at dal.ca  //  902-494-1901<tel:902-494-1901>
----------------------------------------------------




On Wednesday, 1 June 2016, Daureen Nesdill <daureen.nesdill at utah.edu<mailto:daureen.nesdill at utah.edu>> wrote:
Hmmm. The student said he had checked Github and the 1 TB is an issue.

I finally went to IEEE looking for information and learned about Tera Promise http://openscience.us/repo/<https://urldefense.proofpoint.com/v2/url?u=http-3A__openscience.us_repo_&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=nmZ6V9zMf1c3Gsq1YITSw8koQFE7vmr1nSO44muZZYQ&e=>
and other open science possibilities. http://openscience.us/other/index.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__openscience.us_other_index.html&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=L6dhsT2jvIQaiY8nHLILUhWyFD3S6gPa52oeg10tZlY&e=>

Thanks for the reminder about export control restrictions

Daureen

From: Rdap [rdap-bounces at asis.org] on behalf of Pouchard, Line C [pouchard at purdue.edu]
Sent: Wednesday, June 01, 2016 5:31 PM
To: Research Data, Access and Preservation
Subject: Re: [Rdap] I give up

Daureen:

Has the student tried Github?  It has a publication workflow where the data is uploaded to zenodo and acquires a DOI.

It's not exactly a computer science repository but it might work for his purposes.

As zenodo is in the EU, there might be export control restrictions on cyber security data.

Line

Sent from my iPhone
Line Pouchard, PhD
Purdue University Libraries

On Jun 1, 2016, at 7:14 PM, Daureen Nesdill <daureen.nesdill at utah.edu<https://urldefense.proofpoint.com/v2/url?u=http-3A__redir.aspx-3FREF-3De0aoAaOHirdbAJ3jnKKeZZPhhCtqzR8AC1nyRg4ctQzYmGOYl4rTCAFtYWlsdG86ZGF1cmVlbi5uZXNkaWxsQHV0YWguZWR1&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=mOgN3yuxtHUSOTysCR4FqST6kmKc9tlGkCXMva97yqw&e=>> wrote:

Hi,
I have a graduate student in computer science requesting me to find him a data repository for his research data. The article has already been published and folks are asking to see the data. The data is in a text format and 1 terabyte uncompressed; compressed it is 100-200 GB. He developed software that used other software to generate the data. It is a test of security issues with androids. He tells me his colleagues are waiting to see where he put his data because no one knows what to do. This project is NSF supported.

I’ve looked through re3data and conducted a few google searches with no luck. Does anyone have any information about data repositories for computer science?

Thanks for any assistance,
Daureen





Daureen Nesdill, MS, MLIS
Research Data Management Librarian
The Faculty Center @ the J. W. Marriott Library
University of Utah
801-585-5975<tel:801-585-5975>
daureen.nesdill at utah.edu<https://urldefense.proofpoint.com/v2/url?u=http-3A__redir.aspx-3FREF-3De0aoAaOHirdbAJ3jnKKeZZPhhCtqzR8AC1nyRg4ctQzYmGOYl4rTCAFtYWlsdG86ZGF1cmVlbi5uZXNkaWxsQHV0YWguZWR1&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=mOgN3yuxtHUSOTysCR4FqST6kmKc9tlGkCXMva97yqw&e=>
ORCID http://orcid.org/0000-0003-0126-5038<https://urldefense.proofpoint.com/v2/url?u=http-3A__redir.aspx-3FREF-3D5Ga5KW1Xbm1OQSDP41wirJ1rMsXLgks26dDYa5-5FCLKTYmGOYl4rTCAFodHRwOi8vb3JjaWQub3JnLzAwMDAtMDAwMy0wMTI2LTUwMzg.&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=O7-KkE9iGozv0o70HSV8oL8tDs921OK7NXKGL4AXrlk&e=>

<image001.jpg>



_______________________________________________
Rdap mailing list
Rdap at mail.asis.org<https://urldefense.proofpoint.com/v2/url?u=http-3A__redir.aspx-3FREF-3DG83i-5FfKLifWY3SLLuTZogC4rvmqYRfRM3JNIfd5Nq1HYmGOYl4rTCAFtYWlsdG86UmRhcEBtYWlsLmFzaXMub3Jn&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=hrfReg51MCu4OKqBp8isMOX-l4vzRxycAtcyyqediDE&e=>
http://mail.asis.org/mailman/listinfo/rdap<https://urldefense.proofpoint.com/v2/url?u=http-3A__redir.aspx-3FREF-3DNgcPYnmQKHpmUWClB5qhiNsgWC-5FwVQchLngJRhDbmL7YmGOYl4rTCAFodHRwOi8vbWFpbC5hc2lzLm9yZy9tYWlsbWFuL2xpc3RpbmZvL3JkYXA.&d=CwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=NoAn-vdhDckgnJ2YOtD8d9ZgCptSJ0E1_1GhK5-XcNk&m=esNgPgl5eicw6cNRY3E8mkPoc8EcT1WMLEgaixBWK2g&s=rWiDMAQcwQGJZqEEdGbD0XYoLalRxdCZmQi2qEXjQ1s&e=>
_______________________________________________
Rdap mailing list
Rdap at mail.asis.org<mailto:Rdap at mail.asis.org>
http://mail.asis.org/mailman/listinfo/rdap
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.kunverj.com/pipermail/rdap/attachments/20160602/6c5b7f83/attachment.html>


More information about the RDAP mailing list