A blocking, shuffling and lossless compression library

Edit Package blosc

Blosc is a high performance compressor optimized for binary data. It has been designed to transmit data to the processor cache faster than the traditional, non-compressed, direct memory fetch approach via a memcpy() OS call. Blosc is the first compressor (that I'm aware of) that is meant not only to reduce the size of large datasets on-disk or in-memory, but also to accelerate memory-bound computations.

It uses the blocking technique to reduce activity on the memory bus as much as possible. In short, this technique works by dividing datasets in blocks that are small enough to fit in caches of modern processors and perform compression / decompression there. It also leverages, if available, SIMD instructions (SSE2) and multi-threading capabilities of CPUs, in order to accelerate the compression / decompression process to a maximum.

Blosc is actually a metacompressor, that meaning that it can use a range of compression libraries for performing the actual compression/decompression. Right now, it comes with integrated support for BloscLZ (the original one), LZ4, LZ4HC, Snappy and Zlib. Blosc comes with full sources for all compressors, so in case it does not find the libraries installed in your system, it will compile from the included sources and they will be integrated into the Blosc library anyway. That means that you can trust in having all supported compressors integrated in Blosc in all supported platforms.

Refresh
Refresh
Source Files
Filename Size Changed
blosc-1.13.5.tar.gz 0000709050 692 KB
blosc.changes 0000016624 16.2 KB
blosc.spec 0000003678 3.59 KB
Revision 10 (latest revision is 25)
Dominique Leuenberger's avatar Dominique Leuenberger (dimstar_suse) accepted request 573293 from Martin Pluskal's avatar Martin Pluskal (pluskalm) (revision 10)
- Update to version 1.13.5:
  * Fixed a buffer overrun that happens when compressing small
    buffers and len(destination_buffer) < (len(source_buffer) +
    BLOSC_MAX_OVERHEAD). Reported by Ivan Smirnov.
  * Tests work now when external compressors are located in
    non-system locations. Fixes #210. Thanks to Leif Walsh.
  * Fixed a bug uncovered by the python-blosc test suite: when a
    buffer is to be copied, then we should reserve space for the
    header, not block pointers.
  * Serious optimization of memory copy functions (see new
    blosc/fastcopy.c). This benefits the speed of all the codecs,
    but specially the BloscLZ one. As a result of the above, the
    BloscLZ codec received a new adjustment of knobs so that you
    should expect better compression ratios with it too.
Comments 0
openSUSE Build Service is sponsored by