shcodec is order-0 32-bit canonical static huffman codec. It
encodes alphabet of 256 symbols with minimum-redundancy or
length-restricted codes(basic method: Alistair Moffat and Jyrki
Katajainen, modified by Artur A. Pessoa). shcodec uses efficient
method for tree packing: on text files packed tree size is approx
68 bytes, on binary files this value is about 132 bytes. Memory
requirements are very small: 1280 bytes for encoding and only 574
bytes for decoding! shcodec uses extremely fast and simple
SHIFT-OR method for encoding, and CANONICAL-DECODE with a cache
for small codewords for decoding.
shcodec package contain all routines, needed to implement fast and
efficient static huffman codec. All necessary preprocessing steps
are described in the test program. In order to keep high operating
speed, encode/decode routines are implemented as macro insead of
functions: they encode/decode one symbol at time to/from the
specified buffer The way how encode/decode loops must be organized
is also shown in the test program.
Next table presents experimental results for shcodec version 1.0.1 and
range coder version 1.3
on the calgary corpus set.
In this table we use the following notation:
|file||file to encode|
|file size||original file size in bytes|
|tree||packed tree size in bytes (tree is included into the shc size)|
|shc/rng size||encoded file size in bytes (with shcodec/range coder)|
|shc/rng bpb||bpb value (for shcodec/range coder)|
|ent bpb ||order-0 entropy bpb value|
With (#) sign we denote files where range coder is more efficient
than shcodec(only 2 files from 18).
|file||file size||tree||shc size||rng size||shc bpb||rng bpb||ent bpb|
As you can see, on most files(16 from 18), shcodec outperformes
range coder a little(on 0,201% in average). On very redundant files,
such as pic, and inhomogenious ones, adaptive entropy coders are
So, shcodec does`t suits for high order models and not so efficient,
when symbol distribution is very skewed(e.g. a lot of zeros in pic),
but in practice, under order-0 model, it shows compression performance
comparable with best known entropy coders and runs very fast.
This software may be used freely for any purpose. However, when
distributed, the original source must be clearly stated, and,
when the source code is distributed, the copyright notice must
be retained and any alterations in the code must be clearly marked.
No warranty is given regarding the quality of this software.
shc101.zip(~45 Kbytes) - shcodec source
code, win32 executable and documentation.
shclib-1.0.1.tar.gz (~5 Kbytes) - shcodec library.
shcdll.zip (~47 Kbytes) - windows dll version of the shcodec library.
sh-sfx.zip(~28 Kbytes) - utility for
creating SFX archives from shcodec files under win32.
HuffmanCode.zip(~29 Kbytes) -
My article about Huffman Code (in Russian). Also in
If you have a question about using shcodec, you can reach me via email:
xander at entropyware dot info
EPSILON - powerful Open Source wavelet image compressor