mirrors/lz4
0
0
Fork 0
mirror of https://github.com/lz4/lz4.git synced 2024-11-23 18:04:05 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,011 Commits 7 Branches 33 Tags 11 MiB
C 85.5%
Makefile 4.4%
Python 3.5%
Shell 1.7%
Meson 1.7%
Other 3.1%
1abecbc33c
Go to file
Yann Collet 1abecbc33c fix 32-bits mode. 
Large File support for Mac OS-X in 32-bits mode
Fixed potential undefined behavior
Changed makefile for 32-bits mode
2016-11-17 13:02:06 -08:00
contrib cmake: add public domain dedication, and a note about the maintainer 2016-11-12 15:53:52 -08:00
doc Expose internal types to remove strict aliasing 2016-11-11 13:00:02 -08:00
examples Add frame decompression example 2016-11-11 11:37:12 -08:00
lib fix 32-bits mode. 2016-11-17 13:02:06 -08:00
programs fix 32-bits mode. 2016-11-17 13:02:06 -08:00
tests fix 32-bits mode. 2016-11-17 13:02:06 -08:00
visual MinGW doesn't require the import library at all 2016-11-16 08:59:18 +01:00
.gitattributes added lz4-dll project 2016-11-08 16:31:09 +01:00
.gitignore added fullbench-dll.sln that works with gcc/MinGW 2016-11-15 12:57:03 +01:00
.travis.yml fix 32-bits mode. 2016-11-17 13:02:06 -08:00
appveyor.yml include NEWS in lz4_x64.zip and lz4_x86.zip 2016-11-16 11:06:28 +01:00
LICENSE Clarified license (#115, #244) 2016-11-01 19:14:04 -07:00
Makefile fix 32-bits mode. 2016-11-17 13:02:06 -08:00
NEWS fix 32-bits mode. 2016-11-17 13:02:06 -08:00
README.md updated README for v1.7.3 2016-11-16 11:36:45 -08:00

README.md

LZ4 - Extremely fast compression

LZ4 is lossless compression algorithm, providing compression speed at 400 MB/s per core, scalable with multi-cores CPU. It features an extremely fast decoder, with speed in multiple GB/s per core, typically reaching RAM speed limits on multi-core systems.

Speed can be tuned dynamically, selecting an "acceleration" factor which trades compression ratio for more speed up. On the other end, a high compression derivative, LZ4_HC, is also provided, trading CPU time for improved compression ratio. All versions feature the same decompression speed.

LZ4 library is provided as open-source software using BSD 2-Clause license.

Branch Status
master Build Status Build status coverity
dev Build Status Build status

Branch Policy:

  • The "master" branch is considered stable, at all times.
  • The "dev" branch is the one where all contributions must be merged before being promoted to master.
    • If you plan to propose a patch, please commit into the "dev" branch, or its own feature branch. Direct commit to "master" are not permitted.

Benchmarks

The benchmark uses lzbench, from @inikep compiled with GCC v6.2.0 on Linux 64-bits. The reference system uses a Core i7-3930K CPU @ 4.5GHz. Benchmark evaluates the compression of reference Silesia Corpus in single-thread mode.

Compressor Ratio Compression Decompression
memcpy 1.000 7300 MB/s 7300 MB/s
LZ4 fast 8 (v1.7.3) 1.799 911 MB/s 3360 MB/s
LZ4 default (v1.7.3) 2.101 625 MB/s 3220 MB/s
LZO 2.09 2.108 620 MB/s 845 MB/s
QuickLZ 1.5.0 2.238 510 MB/s 600 MB/s
Snappy 1.1.3 2.091 450 MB/s 1550 MB/s
LZF v3.6 2.073 365 MB/s 820 MB/s
Zstandard 1.1.1 -1 2.876 330 MB/s 930 MB/s
Zstandard 1.1.1 -3 3.164 200 MB/s 810 MB/s
zlib deflate 1.2.8 -1 2.730 100 MB/s 370 MB/s
LZ4 HC -9 (v1.7.3) 2.720 34 MB/s 3240 MB/s
zlib deflate 1.2.8 -6 3.099 33 MB/s 390 MB/s

Documentation

The raw LZ4 block compression format is detailed within lz4_Block_format.

To compress an arbitrarily long file or data stream, multiple blocks are required. Organizing these blocks and providing a common header format to handle their content is the purpose of the Frame format, defined into lz4_Frame_format. Interoperable versions of LZ4 must respect this frame format.

Other source versions

Beyond the C reference source, many contributors have created versions of lz4 in multiple languages (Java, C#, Python, Perl, Ruby, etc.). A list of known source ports is maintained on the LZ4 Homepage.