[Rdap] compressing files

[Joe Hourcle]

On Jul 3, 2014, at 10:16 AM, Robert R. Downs wrote:

> The BagIt File Packaging Format might be of interest. It was developed by the California Digital Library and the US Library of Congress. Others also have been developing tools to meet the specification. More information can be found at the links, below.
> 
> https://confluence.ucop.edu/display/Curation/BagIt
> http://tools.ietf.org/html/draft-kunze-bagit-10
> http://sourceforge.net/projects/loc-xferutils/
> https://github.com/LibraryOfCongress/bagit-java/


BagIt came to mind for me, too ... but I'd specifically compress the files individually before placing into the bag, rather than creating a bag and compressing the whole thing.

This allows you to more easily extract a single file from the package, and limits the corruption from a flipped bit.

-Joe




> On 7/2/2014 5:56 PM, Daureen Nesdill wrote:
>> 
>> Hi,
>> 
>> I've been asked to gather information about compressing data files before submitting them to our IR. Are there any standards? Is this what people are usually doing. I'm assuming lossless rather than lossy compression. What our IR folks are proposing is zipping all files (datasets and files about the dataset) together.
>> 
>> Thanks,
>> 
>> Daureen
>> 
>> Daureen Nesdill MS, MLIS -Data Curation Librarian
>> 
>> The Faculty Center @ J. Willard Marriott Library
>> 
>> University of Utah
>> 
>> 295 South 1500 East, Salt Lake City UT 84112-0860
>> 
>> 801-585-5975
>> 
>> daureen.nesdill at utah.edu <mailto:daureen.nesdill at utah.edu>
>> 
>> Subject areas Data Management, the Sciences and Engineering
>> 
>> 
>> 
>> _______________________________________________
>> Rdap mailing list
>> Rdap at mail.asis.org
>> http://mail.asis.org/mailman/listinfo/rdap
> 
> _______________________________________________
> Rdap mailing list
> Rdap at mail.asis.org
> http://mail.asis.org/mailman/listinfo/rdap